2024-04-01T22:14:51.084 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-04-01T22:14:51.084 DEBUG:teuthology.run:Teuthology command: teuthology --name yuriw-2024-04-01_20:57:46-fs-wip-yuri3-testing-2024-04-01-0837-squid-distro-default-smithi --description fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/valgrind} --owner scheduled_yuriw@teuthology --verbose --archive /home/teuthworker/archive/yuriw-2024-04-01_20:57:46-fs-wip-yuri3-testing-2024-04-01-0837-squid-distro-default-smithi/7634387 -- /home/teuthworker/archive/yuriw-2024-04-01_20:57:46-fs-wip-yuri3-testing-2024-04-01-0837-squid-distro-default-smithi/7634387/orig.config.yaml 2024-04-01T22:14:51.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T22:14:51.224 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2024-04-01_20:57:46-fs-wip-yuri3-testing-2024-04-01-0837-squid-distro-default-smithi/7634387 branch: wip-yuri3-testing-2024-04-01-0837-squid description: fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/valgrind} email: yweinste@redhat.com first_in_suite: false job_id: '7634387' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: yuriw-2024-04-01_20:57:46-fs-wip-yuri3-testing-2024-04-01-0837-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-yuri3-testing-2024-04-01-0837-squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mds beacon grace: 60 mds heartbeat grace: 60 osd heartbeat grace: 60 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds valgrind exit: true mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon osd crush smoke test: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow request - SLOW_OPS - MON_DOWN sha1: 1f941761d08add4455f209f0f2e36f8151f834a0 valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes watchdog: daemon_restart: normal ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: valgrind: - --tool=memcheck - --leak-check=full - --show-reachable=yes install: ceph: debuginfo: true flavor: default sha1: 1f941761d08add4455f209f0f2e36f8151f834a0 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri3-testing-2024-04-01-0837-squid sha1: 1f941761d08add4455f209f0f2e36f8151f834a0 owner: scheduled_yuriw@teuthology priority: 99 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 500 sha1: 1f941761d08add4455f209f0f2e36f8151f834a0 sleep_before_teardown: 0 subset: 111/120000 suite: fs suite_branch: wip-yuri3-testing-2024-04-01-0837-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_1f941761d08add4455f209f0f2e36f8151f834a0/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 1f941761d08add4455f209f0f2e36f8151f834a0 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi047.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMxDHLlPWlYJaO3zRBr2g98N5YqYQMbgWhje3WTb7zhJ1jwfSQ19t+zHVsIEorEGvl1YNmYD4PcvL6Og9xk4x1E= smithi181.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEJ+vIOtDQ5Sgj8BzKFhXhOLFFDHXs31EIsIGEmbUwBhHr8eCoC2dLps6SpnG/3V91z6oSd2b4qjoqB+QvrJJrM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-04-01_20:57:46 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-01T22:14:51.224 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_1f941761d08add4455f209f0f2e36f8151f834a0/qa; will attempt to use it 2024-04-01T22:14:51.225 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_1f941761d08add4455f209f0f2e36f8151f834a0/qa/tasks 2024-04-01T22:14:51.225 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-01T22:14:51.226 INFO:teuthology.task.internal:Checking packages... 2024-04-01T22:14:51.252 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1f941761d08add4455f209f0f2e36f8151f834a0' 2024-04-01T22:14:51.253 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-01T22:14:51.253 INFO:teuthology.packaging:ref: None 2024-04-01T22:14:51.253 INFO:teuthology.packaging:tag: None 2024-04-01T22:14:51.253 INFO:teuthology.packaging:branch: wip-yuri3-testing-2024-04-01-0837-squid 2024-04-01T22:14:51.253 INFO:teuthology.packaging:sha1: 1f941761d08add4455f209f0f2e36f8151f834a0 2024-04-01T22:14:51.253 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-yuri3-testing-2024-04-01-0837-squid 2024-04-01T22:14:51.420 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1992.g1f941761 2024-04-01T22:14:51.422 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-01T22:14:51.428 INFO:teuthology.task.internal:no buildpackages task found 2024-04-01T22:14:51.428 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-01T22:14:51.438 INFO:teuthology.task.internal:Saving configuration 2024-04-01T22:14:51.454 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-01T22:14:51.460 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-01T22:14:51.494 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi047.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-04-01_20:57:46-fs-wip-yuri3-testing-2024-04-01-0837-squid-distro-default-smithi/7634387', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-01 22:09:42.405719', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMxDHLlPWlYJaO3zRBr2g98N5YqYQMbgWhje3WTb7zhJ1jwfSQ19t+zHVsIEorEGvl1YNmYD4PcvL6Og9xk4x1E='} 2024-04-01T22:14:51.524 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-04-01_20:57:46-fs-wip-yuri3-testing-2024-04-01-0837-squid-distro-default-smithi/7634387', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-01 22:09:42.407319', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEJ+vIOtDQ5Sgj8BzKFhXhOLFFDHXs31EIsIGEmbUwBhHr8eCoC2dLps6SpnG/3V91z6oSd2b4qjoqB+QvrJJrM='} 2024-04-01T22:14:51.525 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-01T22:14:51.531 INFO:teuthology.task.internal:roles: ubuntu@smithi047.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-01T22:14:51.531 INFO:teuthology.task.internal:roles: ubuntu@smithi181.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-01T22:14:51.531 INFO:teuthology.run_tasks:Running task console_log... 2024-04-01T22:14:51.626 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f985a9d7160>, signals=[15]) 2024-04-01T22:14:51.627 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-01T22:14:51.634 INFO:teuthology.task.internal:Opening connections... 2024-04-01T22:14:51.634 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi047.front.sepia.ceph.com 2024-04-01T22:14:51.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:14:51.749 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi181.front.sepia.ceph.com 2024-04-01T22:14:51.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:14:51.846 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-01T22:14:51.853 DEBUG:teuthology.orchestra.run.smithi047:> uname -m 2024-04-01T22:14:51.870 INFO:teuthology.orchestra.run.smithi047.stdout:x86_64 2024-04-01T22:14:51.870 DEBUG:teuthology.orchestra.run.smithi047:> cat /etc/os-release 2024-04-01T22:14:51.928 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="CentOS Stream" 2024-04-01T22:14:51.928 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="9" 2024-04-01T22:14:51.928 INFO:teuthology.orchestra.run.smithi047.stdout:ID="centos" 2024-04-01T22:14:51.928 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE="rhel fedora" 2024-04-01T22:14:51.928 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="9" 2024-04-01T22:14:51.928 INFO:teuthology.orchestra.run.smithi047.stdout:PLATFORM_ID="platform:el9" 2024-04-01T22:14:51.928 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T22:14:51.928 INFO:teuthology.orchestra.run.smithi047.stdout:ANSI_COLOR="0;31" 2024-04-01T22:14:51.928 INFO:teuthology.orchestra.run.smithi047.stdout:LOGO="fedora-logo-icon" 2024-04-01T22:14:51.928 INFO:teuthology.orchestra.run.smithi047.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T22:14:51.928 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://centos.org/" 2024-04-01T22:14:51.928 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T22:14:51.929 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T22:14:51.929 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T22:14:51.929 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server 2024-04-01T22:14:51.964 DEBUG:teuthology.orchestra.run.smithi181:> uname -m 2024-04-01T22:14:51.982 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64 2024-04-01T22:14:51.982 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2024-04-01T22:14:52.039 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Stream" 2024-04-01T22:14:52.039 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="9" 2024-04-01T22:14:52.039 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos" 2024-04-01T22:14:52.039 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora" 2024-04-01T22:14:52.039 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="9" 2024-04-01T22:14:52.039 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el9" 2024-04-01T22:14:52.039 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T22:14:52.039 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2024-04-01T22:14:52.039 INFO:teuthology.orchestra.run.smithi181.stdout:LOGO="fedora-logo-icon" 2024-04-01T22:14:52.039 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T22:14:52.039 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://centos.org/" 2024-04-01T22:14:52.040 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T22:14:52.040 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T22:14:52.040 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T22:14:52.040 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2024-04-01T22:14:52.072 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-01T22:14:52.082 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-01T22:14:52.088 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-01T22:14:52.088 DEBUG:teuthology.orchestra.run.smithi047:> test '!' -e /home/ubuntu/cephtest 2024-04-01T22:14:52.091 DEBUG:teuthology.orchestra.run.smithi181:> test '!' -e /home/ubuntu/cephtest 2024-04-01T22:14:52.106 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-01T22:14:52.112 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-01T22:14:52.112 DEBUG:teuthology.orchestra.run.smithi047:> test -z $(ls -A /var/lib/ceph) 2024-04-01T22:14:52.148 DEBUG:teuthology.orchestra.run.smithi181:> test -z $(ls -A /var/lib/ceph) 2024-04-01T22:14:52.218 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-01T22:14:52.295 INFO:teuthology.run_tasks:Running task kernel... 2024-04-01T22:14:52.310 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-04-01T22:14:52.310 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-04-01T22:14:52.311 DEBUG:teuthology.orchestra.run.smithi047:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-01T22:14:52.311 DEBUG:teuthology.orchestra.run.smithi181:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-01T22:14:52.327 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T22:14:52.328 DEBUG:teuthology.orchestra.run.smithi181:> uname -r 2024-04-01T22:14:52.328 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T22:14:52.329 DEBUG:teuthology.orchestra.run.smithi047:> uname -r 2024-04-01T22:14:52.384 INFO:teuthology.orchestra.run.smithi181.stdout:5.14.0-361.el9.x86_64 2024-04-01T22:14:52.384 INFO:teuthology.task.kernel:Running kernel on smithi181: 5.14.0-361.el9.x86_64 2024-04-01T22:14:52.384 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum install -y kernel 2024-04-01T22:14:52.387 INFO:teuthology.orchestra.run.smithi047.stdout:5.14.0-361.el9.x86_64 2024-04-01T22:14:52.387 INFO:teuthology.task.kernel:Running kernel on smithi047: 5.14.0-361.el9.x86_64 2024-04-01T22:14:52.387 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum install -y kernel 2024-04-01T22:14:54.744 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS-9 - AppStream 9.3 MB/s | 6.7 MB 00:00 2024-04-01T22:14:54.785 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS-9 - AppStream 8.2 MB/s | 6.7 MB 00:00 2024-04-01T22:14:56.243 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS-9 - BaseOS 6.9 MB/s | 2.0 MB 00:00 2024-04-01T22:14:56.445 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS-9 - BaseOS 3.3 MB/s | 2.0 MB 00:00 2024-04-01T22:14:57.875 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - BaseOS 6.2 MB/s | 8.0 MB 00:01 2024-04-01T22:14:58.468 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 8.0 MB 00:01 2024-04-01T22:15:00.602 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - AppStream 12 MB/s | 19 MB 00:01 2024-04-01T22:15:03.211 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - AppStream 5.1 MB/s | 19 MB 00:03 2024-04-01T22:15:05.220 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - CRB 6.3 MB/s | 6.1 MB 00:00 2024-04-01T22:15:06.629 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - Extras packages 68 kB/s | 16 kB 00:00 2024-04-01T22:15:07.680 INFO:teuthology.orchestra.run.smithi047.stdout:Extra Packages for Enterprise Linux 23 MB/s | 21 MB 00:00 2024-04-01T22:15:08.011 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - CRB 4.6 MB/s | 6.1 MB 00:01 2024-04-01T22:15:10.253 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - Extras packages 14 kB/s | 16 kB 00:01 2024-04-01T22:15:12.130 INFO:teuthology.orchestra.run.smithi181.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-04-01T22:15:12.797 INFO:teuthology.orchestra.run.smithi047.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-04-01T22:15:15.171 INFO:teuthology.orchestra.run.smithi047.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-01T22:15:15.171 INFO:teuthology.orchestra.run.smithi047.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-04-01T22:15:15.271 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-04-01T22:15:15.280 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-01T22:15:15.280 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-04-01T22:15:15.280 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-01T22:15:15.280 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-04-01T22:15:15.280 INFO:teuthology.orchestra.run.smithi047.stdout: kernel x86_64 5.14.0-434.el9 CentOS-BaseOS 192 k 2024-04-01T22:15:15.280 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-04-01T22:15:15.280 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-core x86_64 5.14.0-434.el9 CentOS-BaseOS 15 M 2024-04-01T22:15:15.280 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-modules x86_64 5.14.0-434.el9 CentOS-BaseOS 34 M 2024-04-01T22:15:15.280 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-modules-core x86_64 5.14.0-434.el9 CentOS-BaseOS 28 M 2024-04-01T22:15:15.280 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:15:15.280 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-04-01T22:15:15.281 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-01T22:15:15.281 INFO:teuthology.orchestra.run.smithi047.stdout:Install 4 Packages 2024-04-01T22:15:15.281 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:15:15.281 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 76 M 2024-04-01T22:15:15.281 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 123 M 2024-04-01T22:15:15.281 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-04-01T22:15:15.431 INFO:teuthology.orchestra.run.smithi047.stdout:(1/4): kernel-5.14.0-434.el9.x86_64.rpm 1.3 MB/s | 192 kB 00:00 2024-04-01T22:15:16.015 INFO:teuthology.orchestra.run.smithi047.stdout:(2/4): kernel-core-5.14.0-434.el9.x86_64.rpm 21 MB/s | 15 MB 00:00 2024-04-01T22:15:16.415 INFO:teuthology.orchestra.run.smithi047.stdout:(3/4): kernel-modules-5.14.0-434.el9.x86_64.rpm 30 MB/s | 34 MB 00:01 2024-04-01T22:15:16.865 INFO:teuthology.orchestra.run.smithi047.stdout:(4/4): kernel-modules-core-5.14.0-434.el9.x86_6 19 MB/s | 28 MB 00:01 2024-04-01T22:15:16.868 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-04-01T22:15:16.868 INFO:teuthology.orchestra.run.smithi047.stdout:Total 48 MB/s | 76 MB 00:01 2024-04-01T22:15:16.869 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-04-01T22:15:17.230 INFO:teuthology.orchestra.run.smithi181.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-04-01T22:15:17.299 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-04-01T22:15:17.299 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-04-01T22:15:18.163 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-04-01T22:15:18.163 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-04-01T22:15:19.503 INFO:teuthology.orchestra.run.smithi181.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-01T22:15:19.503 INFO:teuthology.orchestra.run.smithi181.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-04-01T22:15:19.591 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-04-01T22:15:19.596 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-01T22:15:19.596 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2024-04-01T22:15:19.596 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-01T22:15:19.597 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-04-01T22:15:19.597 INFO:teuthology.orchestra.run.smithi181.stdout: kernel x86_64 5.14.0-434.el9 CentOS-BaseOS 192 k 2024-04-01T22:15:19.597 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2024-04-01T22:15:19.597 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-core x86_64 5.14.0-434.el9 CentOS-BaseOS 15 M 2024-04-01T22:15:19.597 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-modules x86_64 5.14.0-434.el9 CentOS-BaseOS 34 M 2024-04-01T22:15:19.597 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-modules-core x86_64 5.14.0-434.el9 CentOS-BaseOS 28 M 2024-04-01T22:15:19.597 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:15:19.597 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-04-01T22:15:19.597 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-04-01T22:15:19.597 INFO:teuthology.orchestra.run.smithi181.stdout:Install 4 Packages 2024-04-01T22:15:19.597 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:15:19.598 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 76 M 2024-04-01T22:15:19.598 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 123 M 2024-04-01T22:15:19.598 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-04-01T22:15:19.764 INFO:teuthology.orchestra.run.smithi181.stdout:(1/4): kernel-5.14.0-434.el9.x86_64.rpm 1.1 MB/s | 192 kB 00:00 2024-04-01T22:15:20.215 INFO:teuthology.orchestra.run.smithi181.stdout:(2/4): kernel-core-5.14.0-434.el9.x86_64.rpm 24 MB/s | 15 MB 00:00 2024-04-01T22:15:20.637 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-04-01T22:15:20.790 INFO:teuthology.orchestra.run.smithi181.stdout:(3/4): kernel-modules-5.14.0-434.el9.x86_64.rpm 28 MB/s | 34 MB 00:01 2024-04-01T22:15:21.140 INFO:teuthology.orchestra.run.smithi181.stdout:(4/4): kernel-modules-core-5.14.0-434.el9.x86_6 20 MB/s | 28 MB 00:01 2024-04-01T22:15:21.143 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-04-01T22:15:21.143 INFO:teuthology.orchestra.run.smithi181.stdout:Total 49 MB/s | 76 MB 00:01 2024-04-01T22:15:21.143 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-04-01T22:15:21.255 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : kernel-modules-core-5.14.0-434.el9.x86_64 1/4 2024-04-01T22:15:21.342 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : kernel-core-5.14.0-434.el9.x86_64 2/4 2024-04-01T22:15:21.498 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-04-01T22:15:21.498 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-04-01T22:15:22.336 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-04-01T22:15:22.336 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-04-01T22:15:24.221 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-core-5.14.0-434.el9.x86_64 2/4 2024-04-01T22:15:24.360 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : kernel-modules-5.14.0-434.el9.x86_64 3/4 2024-04-01T22:15:24.650 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-04-01T22:15:25.347 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : kernel-modules-core-5.14.0-434.el9.x86_64 1/4 2024-04-01T22:15:25.431 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : kernel-core-5.14.0-434.el9.x86_64 2/4 2024-04-01T22:15:28.171 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-core-5.14.0-434.el9.x86_64 2/4 2024-04-01T22:15:28.309 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : kernel-modules-5.14.0-434.el9.x86_64 3/4 2024-04-01T22:15:29.437 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-modules-5.14.0-434.el9.x86_64 3/4 2024-04-01T22:15:29.476 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : kernel-5.14.0-434.el9.x86_64 4/4 2024-04-01T22:15:33.027 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-modules-5.14.0-434.el9.x86_64 3/4 2024-04-01T22:15:33.183 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : kernel-5.14.0-434.el9.x86_64 4/4 2024-04-01T22:15:34.574 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-modules-core-5.14.0-434.el9.x86_64 4/4 2024-04-01T22:15:37.892 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-modules-core-5.14.0-434.el9.x86_64 4/4 2024-04-01T22:16:05.557 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-core-5.14.0-434.el9.x86_64 4/4 2024-04-01T22:16:05.557 INFO:teuthology.orchestra.run.smithi047.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-01T22:16:05.557 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:16:05.602 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-modules-5.14.0-434.el9.x86_64 4/4 2024-04-01T22:16:05.980 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-5.14.0-434.el9.x86_64 4/4 2024-04-01T22:16:05.980 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-5.14.0-434.el9.x86_64 1/4 2024-04-01T22:16:05.981 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-core-5.14.0-434.el9.x86_64 2/4 2024-04-01T22:16:05.981 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-modules-5.14.0-434.el9.x86_64 3/4 2024-04-01T22:16:06.431 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-modules-core-5.14.0-434.el9.x86_64 4/4 2024-04-01T22:16:06.431 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:16:06.432 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-04-01T22:16:06.432 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-5.14.0-434.el9.x86_64 2024-04-01T22:16:06.432 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-core-5.14.0-434.el9.x86_64 2024-04-01T22:16:06.433 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-modules-5.14.0-434.el9.x86_64 2024-04-01T22:16:06.433 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-modules-core-5.14.0-434.el9.x86_64 2024-04-01T22:16:06.434 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:16:06.434 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-04-01T22:16:06.759 DEBUG:teuthology.orchestra.run.smithi047:> rpm -q kernel | sort -rV | head -n 1 2024-04-01T22:16:06.909 INFO:teuthology.orchestra.run.smithi047.stdout:kernel-5.14.0-434.el9.x86_64 2024-04-01T22:16:06.911 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-434.el9.x86_64 2024-04-01T22:16:06.911 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-434.el9.x86_64 2024-04-01T22:16:06.911 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-01T22:16:06.911 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-01T22:16:06.911 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-01T22:16:06.912 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi047.front.sepia.ceph.com, path=None, version=distro) 2024-04-01T22:16:06.912 DEBUG:teuthology.orchestra.run.smithi047:> rpm -q kernel | sort -rV | head -n 1 2024-04-01T22:16:06.995 INFO:teuthology.orchestra.run.smithi047.stdout:kernel-5.14.0-434.el9.x86_64 2024-04-01T22:16:06.996 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-434.el9.x86_64 2024-04-01T22:16:06.996 DEBUG:teuthology.orchestra.run.smithi047:> sudo rpm -qi grub2-tools 2024-04-01T22:16:07.041 INFO:teuthology.orchestra.run.smithi047.stdout:Name : grub2-tools 2024-04-01T22:16:07.041 INFO:teuthology.orchestra.run.smithi047.stdout:Epoch : 1 2024-04-01T22:16:07.042 INFO:teuthology.orchestra.run.smithi047.stdout:Version : 2.06 2024-04-01T22:16:07.042 INFO:teuthology.orchestra.run.smithi047.stdout:Release : 68.el9 2024-04-01T22:16:07.042 INFO:teuthology.orchestra.run.smithi047.stdout:Architecture: x86_64 2024-04-01T22:16:07.042 INFO:teuthology.orchestra.run.smithi047.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-01T22:16:07.042 INFO:teuthology.orchestra.run.smithi047.stdout:Group : Unspecified 2024-04-01T22:16:07.042 INFO:teuthology.orchestra.run.smithi047.stdout:Size : 8264254 2024-04-01T22:16:07.042 INFO:teuthology.orchestra.run.smithi047.stdout:License : GPLv3+ 2024-04-01T22:16:07.042 INFO:teuthology.orchestra.run.smithi047.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-01T22:16:07.042 INFO:teuthology.orchestra.run.smithi047.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-01T22:16:07.042 INFO:teuthology.orchestra.run.smithi047.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-01T22:16:07.042 INFO:teuthology.orchestra.run.smithi047.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-01T22:16:07.042 INFO:teuthology.orchestra.run.smithi047.stdout:Packager : builder@centos.org 2024-04-01T22:16:07.042 INFO:teuthology.orchestra.run.smithi047.stdout:Vendor : CentOS 2024-04-01T22:16:07.042 INFO:teuthology.orchestra.run.smithi047.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-01T22:16:07.043 INFO:teuthology.orchestra.run.smithi047.stdout:Summary : Support tools for GRUB. 2024-04-01T22:16:07.043 INFO:teuthology.orchestra.run.smithi047.stdout:Description : 2024-04-01T22:16:07.043 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:16:07.043 INFO:teuthology.orchestra.run.smithi047.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-01T22:16:07.043 INFO:teuthology.orchestra.run.smithi047.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-01T22:16:07.043 INFO:teuthology.orchestra.run.smithi047.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-01T22:16:07.043 INFO:teuthology.orchestra.run.smithi047.stdout:hardware devices. 2024-04-01T22:16:07.043 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:16:07.043 INFO:teuthology.orchestra.run.smithi047.stdout:This subpackage provides tools for support of all platforms. 2024-04-01T22:16:07.044 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-01T22:16:07.044 INFO:teuthology.task.kernel:Updating grub on smithi047 to boot 5.14.0-434.el9.x86_64 2024-04-01T22:16:07.044 DEBUG:teuthology.orchestra.run.smithi047:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-01T22:16:07.344 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-core-5.14.0-434.el9.x86_64 4/4 2024-04-01T22:16:07.345 INFO:teuthology.orchestra.run.smithi181.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-01T22:16:07.345 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:16:07.387 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-modules-5.14.0-434.el9.x86_64 4/4 2024-04-01T22:16:07.627 INFO:teuthology.orchestra.run.smithi047.stderr:Generating grub configuration file ... 2024-04-01T22:16:07.742 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-5.14.0-434.el9.x86_64 4/4 2024-04-01T22:16:07.742 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : kernel-5.14.0-434.el9.x86_64 1/4 2024-04-01T22:16:07.742 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : kernel-core-5.14.0-434.el9.x86_64 2/4 2024-04-01T22:16:07.742 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : kernel-modules-5.14.0-434.el9.x86_64 3/4 2024-04-01T22:16:08.160 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : kernel-modules-core-5.14.0-434.el9.x86_64 4/4 2024-04-01T22:16:08.160 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:16:08.160 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-04-01T22:16:08.160 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-5.14.0-434.el9.x86_64 2024-04-01T22:16:08.160 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-core-5.14.0-434.el9.x86_64 2024-04-01T22:16:08.161 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-modules-5.14.0-434.el9.x86_64 2024-04-01T22:16:08.161 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-modules-core-5.14.0-434.el9.x86_64 2024-04-01T22:16:08.161 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:16:08.161 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-04-01T22:16:08.461 DEBUG:teuthology.orchestra.run.smithi181:> rpm -q kernel | sort -rV | head -n 1 2024-04-01T22:16:08.563 INFO:teuthology.orchestra.run.smithi181.stdout:kernel-5.14.0-434.el9.x86_64 2024-04-01T22:16:08.564 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-434.el9.x86_64 2024-04-01T22:16:08.564 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-434.el9.x86_64 2024-04-01T22:16:08.564 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-01T22:16:08.564 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-01T22:16:08.564 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-04-01T22:16:08.564 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi181.front.sepia.ceph.com, path=None, version=distro) 2024-04-01T22:16:08.565 DEBUG:teuthology.orchestra.run.smithi181:> rpm -q kernel | sort -rV | head -n 1 2024-04-01T22:16:08.644 INFO:teuthology.orchestra.run.smithi181.stdout:kernel-5.14.0-434.el9.x86_64 2024-04-01T22:16:08.645 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-434.el9.x86_64 2024-04-01T22:16:08.645 DEBUG:teuthology.orchestra.run.smithi181:> sudo rpm -qi grub2-tools 2024-04-01T22:16:08.682 INFO:teuthology.orchestra.run.smithi181.stdout:Name : grub2-tools 2024-04-01T22:16:08.682 INFO:teuthology.orchestra.run.smithi181.stdout:Epoch : 1 2024-04-01T22:16:08.682 INFO:teuthology.orchestra.run.smithi181.stdout:Version : 2.06 2024-04-01T22:16:08.682 INFO:teuthology.orchestra.run.smithi181.stdout:Release : 68.el9 2024-04-01T22:16:08.682 INFO:teuthology.orchestra.run.smithi181.stdout:Architecture: x86_64 2024-04-01T22:16:08.682 INFO:teuthology.orchestra.run.smithi181.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-01T22:16:08.683 INFO:teuthology.orchestra.run.smithi181.stdout:Group : Unspecified 2024-04-01T22:16:08.683 INFO:teuthology.orchestra.run.smithi181.stdout:Size : 8264254 2024-04-01T22:16:08.683 INFO:teuthology.orchestra.run.smithi181.stdout:License : GPLv3+ 2024-04-01T22:16:08.683 INFO:teuthology.orchestra.run.smithi181.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-01T22:16:08.683 INFO:teuthology.orchestra.run.smithi181.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-01T22:16:08.683 INFO:teuthology.orchestra.run.smithi181.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-01T22:16:08.683 INFO:teuthology.orchestra.run.smithi181.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-01T22:16:08.683 INFO:teuthology.orchestra.run.smithi181.stdout:Packager : builder@centos.org 2024-04-01T22:16:08.683 INFO:teuthology.orchestra.run.smithi181.stdout:Vendor : CentOS 2024-04-01T22:16:08.683 INFO:teuthology.orchestra.run.smithi181.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-01T22:16:08.683 INFO:teuthology.orchestra.run.smithi181.stdout:Summary : Support tools for GRUB. 2024-04-01T22:16:08.683 INFO:teuthology.orchestra.run.smithi181.stdout:Description : 2024-04-01T22:16:08.683 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:16:08.683 INFO:teuthology.orchestra.run.smithi181.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-01T22:16:08.683 INFO:teuthology.orchestra.run.smithi181.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-01T22:16:08.683 INFO:teuthology.orchestra.run.smithi181.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-01T22:16:08.684 INFO:teuthology.orchestra.run.smithi181.stdout:hardware devices. 2024-04-01T22:16:08.684 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:16:08.684 INFO:teuthology.orchestra.run.smithi181.stdout:This subpackage provides tools for support of all platforms. 2024-04-01T22:16:08.684 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-01T22:16:08.684 INFO:teuthology.task.kernel:Updating grub on smithi181 to boot 5.14.0-434.el9.x86_64 2024-04-01T22:16:08.685 DEBUG:teuthology.orchestra.run.smithi181:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-01T22:16:08.962 INFO:teuthology.orchestra.run.smithi047.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-01T22:16:08.982 INFO:teuthology.orchestra.run.smithi047.stderr:done 2024-04-01T22:16:08.987 DEBUG:teuthology.orchestra.run.smithi047:> mktemp 2024-04-01T22:16:09.002 INFO:teuthology.orchestra.run.smithi047.stdout:/tmp/tmp.GCvrhaYcdt 2024-04-01T22:16:09.003 DEBUG:teuthology.orchestra.run.smithi047:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.GCvrhaYcdt 2024-04-01T22:16:09.079 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0666 /tmp/tmp.GCvrhaYcdt 2024-04-01T22:16:09.234 DEBUG:teuthology.orchestra.remote:smithi047:/tmp/tmp.GCvrhaYcdt is 6KB 2024-04-01T22:16:09.260 DEBUG:teuthology.orchestra.run.smithi047:> rm -fr /tmp/tmp.GCvrhaYcdt 2024-04-01T22:16:09.276 DEBUG:teuthology.orchestra.run.smithi047:> sudo /bin/ls /boot/loader/entries || true 2024-04-01T22:16:09.295 INFO:teuthology.orchestra.run.smithi181.stderr:Generating grub configuration file ... 2024-04-01T22:16:09.353 INFO:teuthology.orchestra.run.smithi047.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-01T22:16:09.354 INFO:teuthology.orchestra.run.smithi047.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-01T22:16:09.354 INFO:teuthology.orchestra.run.smithi047.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-01T22:16:09.354 INFO:teuthology.orchestra.run.smithi047.stdout:15949e3c88704300882482eddfd7baae-5.14.0-434.el9.x86_64.conf 2024-04-01T22:16:09.355 DEBUG:teuthology.orchestra.run.smithi047:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-434.el9.x86_64 2024-04-01T22:16:09.509 DEBUG:teuthology.orchestra.run.smithi047:> sudo shutdown -r now 2024-04-01T22:16:10.653 INFO:teuthology.orchestra.run.smithi181.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-01T22:16:10.689 INFO:teuthology.orchestra.run.smithi181.stderr:done 2024-04-01T22:16:10.692 DEBUG:teuthology.orchestra.run.smithi181:> mktemp 2024-04-01T22:16:10.708 INFO:teuthology.orchestra.run.smithi181.stdout:/tmp/tmp.8V3ig7eCeq 2024-04-01T22:16:10.708 DEBUG:teuthology.orchestra.run.smithi181:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.8V3ig7eCeq 2024-04-01T22:16:10.777 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0666 /tmp/tmp.8V3ig7eCeq 2024-04-01T22:16:10.913 DEBUG:teuthology.orchestra.remote:smithi181:/tmp/tmp.8V3ig7eCeq is 6KB 2024-04-01T22:16:10.961 DEBUG:teuthology.orchestra.run.smithi181:> rm -fr /tmp/tmp.8V3ig7eCeq 2024-04-01T22:16:10.975 DEBUG:teuthology.orchestra.run.smithi181:> sudo /bin/ls /boot/loader/entries || true 2024-04-01T22:16:11.041 INFO:teuthology.orchestra.run.smithi181.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-01T22:16:11.041 INFO:teuthology.orchestra.run.smithi181.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-01T22:16:11.041 INFO:teuthology.orchestra.run.smithi181.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-01T22:16:11.042 INFO:teuthology.orchestra.run.smithi181.stdout:15949e3c88704300882482eddfd7baae-5.14.0-434.el9.x86_64.conf 2024-04-01T22:16:11.043 DEBUG:teuthology.orchestra.run.smithi181:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-434.el9.x86_64 2024-04-01T22:16:11.190 DEBUG:teuthology.orchestra.run.smithi181:> sudo shutdown -r now 2024-04-01T22:16:39.534 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-01T22:16:39.534 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-04-01T22:16:39.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:16:41.195 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-01T22:16:41.195 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-04-01T22:16:41.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:16:57.887 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-04-01T22:16:59.678 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-04-01T22:17:06.889 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-04-01T22:17:06.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:17:08.681 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-04-01T22:17:08.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:17:11.746 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-04-01T22:17:23.758 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-04-01T22:17:23.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:17:55.592 DEBUG:teuthology.orchestra.run.smithi181:> true 2024-04-01T22:17:55.998 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-04-01T22:17:55.998 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-434.el9.x86_64"... 2024-04-01T22:17:55.999 DEBUG:teuthology.orchestra.run.smithi181:> uname -r 2024-04-01T22:17:56.013 INFO:teuthology.orchestra.run.smithi181.stdout:5.14.0-434.el9.x86_64 2024-04-01T22:17:56.013 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-434.el9.x86_64 vs 5.14.0-434.el9.x86_64 2024-04-01T22:17:56.014 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-01T22:17:56.014 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-01T22:17:57.015 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-01T22:17:57.015 DEBUG:teuthology.orchestra.run.smithi181:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-01T22:17:57.084 INFO:teuthology.orchestra.run.smithi181.stdout:ttyS1 2024-04-01T22:17:57.124 DEBUG:teuthology.parallel:result is None 2024-04-01T22:18:06.900 DEBUG:teuthology.orchestra.remote:timed out 2024-04-01T22:18:18.901 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-04-01T22:18:18.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:18:19.230 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-04-01T22:18:19.626 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-04-01T22:18:19.626 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-434.el9.x86_64"... 2024-04-01T22:18:19.627 DEBUG:teuthology.orchestra.run.smithi047:> uname -r 2024-04-01T22:18:19.642 INFO:teuthology.orchestra.run.smithi047.stdout:5.14.0-434.el9.x86_64 2024-04-01T22:18:19.642 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-434.el9.x86_64 vs 5.14.0-434.el9.x86_64 2024-04-01T22:18:19.642 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-01T22:18:19.642 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-01T22:18:20.643 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-01T22:18:20.643 DEBUG:teuthology.orchestra.run.smithi047:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-01T22:18:20.700 INFO:teuthology.orchestra.run.smithi047.stdout:ttyS1 2024-04-01T22:18:20.742 DEBUG:teuthology.parallel:result is None 2024-04-01T22:18:20.743 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-01T22:18:20.751 INFO:teuthology.task.internal:Creating test directory... 2024-04-01T22:18:20.751 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-01T22:18:20.754 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-01T22:18:20.773 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-01T22:18:20.780 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-01T22:18:20.790 INFO:teuthology.task.internal:Creating archive directory... 2024-04-01T22:18:20.791 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-01T22:18:20.812 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-01T22:18:20.892 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-01T22:18:20.899 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-01T22:18:20.900 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-01T22:18:20.903 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-01T22:18:20.941 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-01T22:18:20.941 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-01T22:18:20.955 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-01T22:18:20.955 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-01T22:18:20.957 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-01T22:18:20.965 INFO:teuthology.task.internal:Configuring sudo... 2024-04-01T22:18:20.965 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-01T22:18:21.000 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-01T22:18:21.030 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-01T22:18:21.040 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-01T22:18:21.040 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-01T22:18:21.071 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-01T22:18:21.087 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-01T22:18:21.172 DEBUG:teuthology.orchestra.run.smithi047:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-01T22:18:21.220 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-01T22:18:21.307 DEBUG:teuthology.orchestra.run.smithi047:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-01T22:18:21.348 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-01T22:18:21.348 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-01T22:18:21.417 DEBUG:teuthology.orchestra.run.smithi181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-01T22:18:21.464 DEBUG:teuthology.orchestra.run.smithi181:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-01T22:18:21.512 DEBUG:teuthology.orchestra.run.smithi181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-01T22:18:21.598 DEBUG:teuthology.orchestra.run.smithi181:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-01T22:18:21.642 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-04-01T22:18:21.642 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-01T22:18:21.711 DEBUG:teuthology.orchestra.run.smithi047:> sudo service rsyslog restart 2024-04-01T22:18:21.714 DEBUG:teuthology.orchestra.run.smithi181:> sudo service rsyslog restart 2024-04-01T22:18:21.759 INFO:teuthology.orchestra.run.smithi047.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-01T22:18:21.808 INFO:teuthology.orchestra.run.smithi181.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-01T22:18:22.259 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-01T22:18:22.268 INFO:teuthology.task.internal:Starting timer... 2024-04-01T22:18:22.268 INFO:teuthology.run_tasks:Running task pcp... 2024-04-01T22:18:22.284 INFO:teuthology.run_tasks:Running task selinux... 2024-04-01T22:18:22.293 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-01T22:18:22.293 DEBUG:teuthology.orchestra.run.smithi047:> sudo service auditd rotate 2024-04-01T22:18:22.373 INFO:teuthology.orchestra.run.smithi047.stdout:Rotating logs: 2024-04-01T22:18:22.375 DEBUG:teuthology.orchestra.run.smithi181:> sudo service auditd rotate 2024-04-01T22:18:22.443 INFO:teuthology.orchestra.run.smithi181.stdout:Rotating logs: 2024-04-01T22:18:22.445 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-01T22:18:22.446 DEBUG:teuthology.orchestra.run.smithi047:> /usr/sbin/getenforce 2024-04-01T22:18:22.471 INFO:teuthology.orchestra.run.smithi047.stdout:Permissive 2024-04-01T22:18:22.472 DEBUG:teuthology.orchestra.run.smithi181:> /usr/sbin/getenforce 2024-04-01T22:18:22.503 INFO:teuthology.orchestra.run.smithi181.stdout:Permissive 2024-04-01T22:18:22.503 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi047.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi181.front.sepia.ceph.com': 'permissive'} 2024-04-01T22:18:22.503 DEBUG:teuthology.orchestra.run.smithi047:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-01T22:18:22.541 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T22:18:22.541 DEBUG:teuthology.orchestra.run.smithi181:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-01T22:18:22.572 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T22:18:22.572 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-01T22:18:22.573 DEBUG:teuthology.orchestra.run.smithi047:> sudo /usr/sbin/setenforce permissive 2024-04-01T22:18:22.615 DEBUG:teuthology.orchestra.run.smithi181:> sudo /usr/sbin/setenforce permissive 2024-04-01T22:18:22.646 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-01T22:18:22.655 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-01T22:18:22.671 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-01T22:18:22.672 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi047.front.sepia.ceph.com,smithi181.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-01T22:22:42.352 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi047.front.sepia.ceph.com'), Remote(name='ubuntu@smithi181.front.sepia.ceph.com')] 2024-04-01T22:22:42.353 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-04-01T22:22:42.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:22:42.468 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-04-01T22:22:42.544 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-04-01T22:22:42.544 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-04-01T22:22:42.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:22:42.658 DEBUG:teuthology.orchestra.run.smithi181:> true 2024-04-01T22:22:42.736 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-04-01T22:22:42.736 INFO:teuthology.run_tasks:Running task clock... 2024-04-01T22:22:42.747 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-01T22:22:42.747 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-01T22:22:42.748 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-01T22:22:42.750 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-01T22:22:42.750 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-01T22:22:42.779 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-01T22:22:42.796 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-01T22:22:42.807 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-01T22:22:42.823 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-01T22:22:42.826 INFO:teuthology.orchestra.run.smithi047.stderr:sudo: ntpd: command not found 2024-04-01T22:22:42.840 INFO:teuthology.orchestra.run.smithi047.stdout:506 Cannot talk to daemon 2024-04-01T22:22:42.852 INFO:teuthology.orchestra.run.smithi181.stderr:sudo: ntpd: command not found 2024-04-01T22:22:42.857 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-01T22:22:42.866 INFO:teuthology.orchestra.run.smithi181.stdout:506 Cannot talk to daemon 2024-04-01T22:22:42.873 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-01T22:22:42.882 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-01T22:22:42.899 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-01T22:22:42.920 INFO:teuthology.orchestra.run.smithi047.stderr:bash: line 1: ntpq: command not found 2024-04-01T22:22:42.923 INFO:teuthology.orchestra.run.smithi047.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-01T22:22:42.923 INFO:teuthology.orchestra.run.smithi047.stdout:=============================================================================== 2024-04-01T22:22:42.924 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T22:22:42.924 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T22:22:42.924 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T22:22:42.924 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T22:22:42.952 INFO:teuthology.orchestra.run.smithi181.stderr:bash: line 1: ntpq: command not found 2024-04-01T22:22:42.956 INFO:teuthology.orchestra.run.smithi181.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-01T22:22:42.956 INFO:teuthology.orchestra.run.smithi181.stdout:=============================================================================== 2024-04-01T22:22:42.956 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T22:22:42.956 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T22:22:42.956 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T22:22:42.956 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T22:22:42.957 INFO:teuthology.run_tasks:Running task install... 2024-04-01T22:22:42.965 DEBUG:teuthology.task.install:project ceph 2024-04-01T22:22:42.965 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '1f941761d08add4455f209f0f2e36f8151f834a0'}} 2024-04-01T22:22:42.965 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': '1f941761d08add4455f209f0f2e36f8151f834a0'} 2024-04-01T22:22:42.965 INFO:teuthology.task.install:Using flavor: default 2024-04-01T22:22:42.971 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2024-04-01T22:22:42.971 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-01T22:22:42.971 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1f941761d08add4455f209f0f2e36f8151f834a0', 'tag': None, 'wait_for_package': False} 2024-04-01T22:22:42.972 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1f941761d08add4455f209f0f2e36f8151f834a0 2024-04-01T22:22:42.974 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1f941761d08add4455f209f0f2e36f8151f834a0', 'tag': None, 'wait_for_package': False} 2024-04-01T22:22:42.974 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1f941761d08add4455f209f0f2e36f8151f834a0 2024-04-01T22:22:43.300 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2024-04-01-0837-squid/1f941761d08add4455f209f0f2e36f8151f834a0/centos/9/flavors/default/ 2024-04-01T22:22:43.300 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1992.g1f941761 2024-04-01T22:22:43.316 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2024-04-01-0837-squid/1f941761d08add4455f209f0f2e36f8151f834a0/centos/9/flavors/default/ 2024-04-01T22:22:43.316 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1992.g1f941761 2024-04-01T22:22:43.437 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2024-04-01-0837-squid/1f941761d08add4455f209f0f2e36f8151f834a0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2024-04-01-0837-squid/1f941761d08add4455f209f0f2e36f8151f834a0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2024-04-01-0837-squid/1f941761d08add4455f209f0f2e36f8151f834a0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-01T22:22:43.437 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-04-01T22:22:43.438 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-01T22:22:43.440 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2024-04-01-0837-squid/1f941761d08add4455f209f0f2e36f8151f834a0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2024-04-01-0837-squid/1f941761d08add4455f209f0f2e36f8151f834a0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2024-04-01-0837-squid/1f941761d08add4455f209f0f2e36f8151f834a0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-01T22:22:43.440 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-01T22:22:43.440 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-01T22:22:43.470 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-01T22:22:43.470 DEBUG:teuthology.orchestra.run.smithi047:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1f941761d08add4455f209f0f2e36f8151f834a0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-01T22:22:43.471 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-01T22:22:43.471 DEBUG:teuthology.orchestra.run.smithi181:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1f941761d08add4455f209f0f2e36f8151f834a0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-01T22:22:43.540 DEBUG:teuthology.orchestra.run.smithi047:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-01T22:22:43.541 DEBUG:teuthology.orchestra.run.smithi181:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-01T22:22:43.622 DEBUG:teuthology.orchestra.run.smithi047:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-01T22:22:43.625 DEBUG:teuthology.orchestra.run.smithi181:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-01T22:22:43.691 INFO:teuthology.orchestra.run.smithi047.stdout:check_obsoletes = 1 2024-04-01T22:22:43.692 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum clean all 2024-04-01T22:22:43.695 INFO:teuthology.orchestra.run.smithi181.stdout:check_obsoletes = 1 2024-04-01T22:22:43.696 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum clean all 2024-04-01T22:22:43.945 INFO:teuthology.orchestra.run.smithi047.stdout:74 files removed 2024-04-01T22:22:43.946 INFO:teuthology.orchestra.run.smithi181.stdout:74 files removed 2024-04-01T22:22:43.972 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-01T22:22:43.973 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-01T22:22:44.693 INFO:teuthology.orchestra.run.smithi181.stdout:ceph packages for x86_64 199 kB/s | 83 kB 00:00 2024-04-01T22:22:44.706 INFO:teuthology.orchestra.run.smithi047.stdout:ceph packages for x86_64 195 kB/s | 83 kB 00:00 2024-04-01T22:22:45.010 INFO:teuthology.orchestra.run.smithi181.stdout:ceph noarch packages 43 kB/s | 11 kB 00:00 2024-04-01T22:22:45.090 INFO:teuthology.orchestra.run.smithi047.stdout:ceph noarch packages 35 kB/s | 11 kB 00:00 2024-04-01T22:22:45.362 INFO:teuthology.orchestra.run.smithi181.stdout:ceph source packages 6.1 kB/s | 1.9 kB 00:00 2024-04-01T22:22:45.465 INFO:teuthology.orchestra.run.smithi047.stdout:ceph source packages 5.7 kB/s | 1.9 kB 00:00 2024-04-01T22:22:45.901 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS-9 - AppStream 17 MB/s | 6.7 MB 00:00 2024-04-01T22:22:46.356 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS-9 - AppStream 7.0 MB/s | 6.7 MB 00:00 2024-04-01T22:22:47.343 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS-9 - BaseOS 7.3 MB/s | 2.0 MB 00:00 2024-04-01T22:22:47.773 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS-9 - BaseOS 6.9 MB/s | 2.0 MB 00:00 2024-04-01T22:22:48.200 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.0 MB 00:00 2024-04-01T22:22:57.204 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - BaseOS 904 kB/s | 8.0 MB 00:09 2024-04-01T22:22:59.122 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - AppStream 23 MB/s | 19 MB 00:00 2024-04-01T22:23:03.789 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - CRB 5.0 MB/s | 6.1 MB 00:01 2024-04-01T22:23:05.240 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - Extras packages 52 kB/s | 16 kB 00:00 2024-04-01T22:23:10.207 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - AppStream 927 kB/s | 19 MB 00:20 2024-04-01T22:23:17.083 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - CRB 2.0 MB/s | 6.1 MB 00:03 2024-04-01T22:23:18.576 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - Extras packages 55 kB/s | 16 kB 00:00 2024-04-01T22:23:19.563 INFO:teuthology.orchestra.run.smithi047.stdout:Extra Packages for Enterprise Linux 24 MB/s | 21 MB 00:00 2024-04-01T22:23:24.702 INFO:teuthology.orchestra.run.smithi047.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-04-01T22:23:27.336 INFO:teuthology.orchestra.run.smithi047.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-01T22:23:27.336 INFO:teuthology.orchestra.run.smithi047.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-01T22:23:27.366 INFO:teuthology.orchestra.run.smithi047.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-04-01T22:23:27.367 INFO:teuthology.orchestra.run.smithi047.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-01T22:23:27.368 INFO:teuthology.orchestra.run.smithi047.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-04-01T22:23:27.369 INFO:teuthology.orchestra.run.smithi047.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-04-01T22:23:27.370 INFO:teuthology.orchestra.run.smithi047.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-01T22:23:27.373 INFO:teuthology.orchestra.run.smithi047.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-04-01T22:23:27.374 INFO:teuthology.orchestra.run.smithi047.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-04-01T22:23:27.461 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-04-01T22:23:27.475 INFO:teuthology.orchestra.run.smithi047.stdout:==================================================================================================== 2024-04-01T22:23:27.475 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-04-01T22:23:27.475 INFO:teuthology.orchestra.run.smithi047.stdout:==================================================================================================== 2024-04-01T22:23:27.475 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-04-01T22:23:27.475 INFO:teuthology.orchestra.run.smithi047.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-04-01T22:23:27.475 INFO:teuthology.orchestra.run.smithi047.stdout: ceph x86_64 2:19.0.0-1992.g1f941761.el9 ceph 6.6 k 2024-04-01T22:23:27.475 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-base x86_64 2:19.0.0-1992.g1f941761.el9 ceph 5.3 M 2024-04-01T22:23:27.475 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-base-debuginfo x86_64 2:19.0.0-1992.g1f941761.el9 ceph 68 M 2024-04-01T22:23:27.476 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-common-debuginfo x86_64 2:19.0.0-1992.g1f941761.el9 ceph 440 M 2024-04-01T22:23:27.476 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-fuse x86_64 2:19.0.0-1992.g1f941761.el9 ceph 889 k 2024-04-01T22:23:27.476 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-fuse-debuginfo x86_64 2:19.0.0-1992.g1f941761.el9 ceph 6.0 M 2024-04-01T22:23:27.476 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1992.g1f941761.el9 ceph 145 k 2024-04-01T22:23:27.476 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.0.0-1992.g1f941761.el9 ceph 1.5 M 2024-04-01T22:23:27.476 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mds-debuginfo x86_64 2:19.0.0-1992.g1f941761.el9 ceph 53 M 2024-04-01T22:23:27.476 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr x86_64 2:19.0.0-1992.g1f941761.el9 ceph 1.5 M 2024-04-01T22:23:27.476 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1992.g1f941761.el9 ceph-noarch 139 k 2024-04-01T22:23:27.476 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1992.g1f941761.el9 ceph-noarch 3.5 M 2024-04-01T22:23:27.476 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-debuginfo x86_64 2:19.0.0-1992.g1f941761.el9 ceph 20 M 2024-04-01T22:23:27.476 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1992.g1f941761.el9 ceph-noarch 7.4 M 2024-04-01T22:23:27.476 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-rook noarch 2:19.0.0-1992.g1f941761.el9 ceph-noarch 49 k 2024-04-01T22:23:27.476 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mon-debuginfo x86_64 2:19.0.0-1992.g1f941761.el9 ceph 99 M 2024-04-01T22:23:27.476 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-osd-debuginfo x86_64 2:19.0.0-1992.g1f941761.el9 ceph 289 M 2024-04-01T22:23:27.477 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-radosgw x86_64 2:19.0.0-1992.g1f941761.el9 ceph 9.8 M 2024-04-01T22:23:27.477 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-radosgw-debuginfo x86_64 2:19.0.0-1992.g1f941761.el9 ceph 176 M 2024-04-01T22:23:27.477 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-test x86_64 2:19.0.0-1992.g1f941761.el9 ceph 47 M 2024-04-01T22:23:27.477 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-test-debuginfo x86_64 2:19.0.0-1992.g1f941761.el9 ceph 675 M 2024-04-01T22:23:27.477 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-volume noarch 2:19.0.0-1992.g1f941761.el9 ceph-noarch 264 k 2024-04-01T22:23:27.477 INFO:teuthology.orchestra.run.smithi047.stdout: cephadm noarch 2:19.0.0-1992.g1f941761.el9 ceph-noarch 749 k 2024-04-01T22:23:27.477 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-mirror x86_64 2:19.0.0-1992.g1f941761.el9 ceph 222 k 2024-04-01T22:23:27.477 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-shell x86_64 2:19.0.0-1992.g1f941761.el9 ceph 27 k 2024-04-01T22:23:27.477 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-top noarch 2:19.0.0-1992.g1f941761.el9 ceph-noarch 18 k 2024-04-01T22:23:27.477 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-01T22:23:27.477 INFO:teuthology.orchestra.run.smithi047.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-04-01T22:23:27.477 INFO:teuthology.orchestra.run.smithi047.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-04-01T22:23:27.478 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs-devel x86_64 2:19.0.0-1992.g1f941761.el9 ceph 32 k 2024-04-01T22:23:27.478 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs2 x86_64 2:19.0.0-1992.g1f941761.el9 ceph 746 k 2024-04-01T22:23:27.478 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs2-debuginfo x86_64 2:19.0.0-1992.g1f941761.el9 ceph 5.4 M 2024-04-01T22:23:27.478 INFO:teuthology.orchestra.run.smithi047.stdout: librados-devel x86_64 2:19.0.0-1992.g1f941761.el9 ceph 127 k 2024-04-01T22:23:27.478 INFO:teuthology.orchestra.run.smithi047.stdout: librados-devel-debuginfo x86_64 2:19.0.0-1992.g1f941761.el9 ceph 109 k 2024-04-01T22:23:27.478 INFO:teuthology.orchestra.run.smithi047.stdout: librados2-debuginfo x86_64 2:19.0.0-1992.g1f941761.el9 ceph 45 M 2024-04-01T22:23:27.478 INFO:teuthology.orchestra.run.smithi047.stdout: librbd1-debuginfo x86_64 2:19.0.0-1992.g1f941761.el9 ceph 52 M 2024-04-01T22:23:27.478 INFO:teuthology.orchestra.run.smithi047.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-04-01T22:23:27.478 INFO:teuthology.orchestra.run.smithi047.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-01T22:23:27.478 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-01T22:23:27.478 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql x86_64 13.14-1.el9 CentOS-AppStream 1.5 M 2024-04-01T22:23:27.478 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-contrib x86_64 13.14-1.el9 CentOS-AppStream 817 k 2024-04-01T22:23:27.478 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-server x86_64 13.14-1.el9 CentOS-AppStream 5.7 M 2024-04-01T22:23:27.478 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cephfs x86_64 2:19.0.0-1992.g1f941761.el9 ceph 162 k 2024-04-01T22:23:27.479 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cephfs-debuginfo x86_64 2:19.0.0-1992.g1f941761.el9 ceph 615 k 2024-04-01T22:23:27.479 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rados x86_64 2:19.0.0-1992.g1f941761.el9 ceph 321 k 2024-04-01T22:23:27.479 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rados-debuginfo x86_64 2:19.0.0-1992.g1f941761.el9 ceph 769 k 2024-04-01T22:23:27.479 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rbd x86_64 2:19.0.0-1992.g1f941761.el9 ceph 299 k 2024-04-01T22:23:27.479 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rbd-debuginfo x86_64 2:19.0.0-1992.g1f941761.el9 ceph 1.1 M 2024-04-01T22:23:27.479 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rgw x86_64 2:19.0.0-1992.g1f941761.el9 ceph 99 k 2024-04-01T22:23:27.479 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rgw-debuginfo x86_64 2:19.0.0-1992.g1f941761.el9 ceph 337 k 2024-04-01T22:23:27.479 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-fuse x86_64 2:19.0.0-1992.g1f941761.el9 ceph 85 k 2024-04-01T22:23:27.479 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-fuse-debuginfo x86_64 2:19.0.0-1992.g1f941761.el9 ceph 516 k 2024-04-01T22:23:27.479 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-mirror x86_64 2:19.0.0-1992.g1f941761.el9 ceph 3.1 M 2024-04-01T22:23:27.479 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-mirror-debuginfo x86_64 2:19.0.0-1992.g1f941761.el9 ceph 52 M 2024-04-01T22:23:27.479 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-nbd x86_64 2:19.0.0-1992.g1f941761.el9 ceph 170 k 2024-04-01T22:23:27.479 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-nbd-debuginfo x86_64 2:19.0.0-1992.g1f941761.el9 ceph 1.3 M 2024-04-01T22:23:27.480 INFO:teuthology.orchestra.run.smithi047.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-01T22:23:27.480 INFO:teuthology.orchestra.run.smithi047.stdout:Upgrading: 2024-04-01T22:23:27.480 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager x86_64 1:1.47.2-1.el9 CentOS-BaseOS 2.3 M 2024-04-01T22:23:27.480 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 CentOS-BaseOS 1.8 M 2024-04-01T22:23:27.480 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 CentOS-BaseOS 41 k 2024-04-01T22:23:27.480 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 CentOS-BaseOS 247 k 2024-04-01T22:23:27.480 INFO:teuthology.orchestra.run.smithi047.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-04-01T22:23:27.480 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-04-01T22:23:27.480 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-04-01T22:23:27.480 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-04-01T22:23:27.480 INFO:teuthology.orchestra.run.smithi047.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-04-01T22:23:27.480 INFO:teuthology.orchestra.run.smithi047.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-04-01T22:23:27.480 INFO:teuthology.orchestra.run.smithi047.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-04-01T22:23:27.480 INFO:teuthology.orchestra.run.smithi047.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-04-01T22:23:27.481 INFO:teuthology.orchestra.run.smithi047.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-04-01T22:23:27.481 INFO:teuthology.orchestra.run.smithi047.stdout: librados2 x86_64 2:19.0.0-1992.g1f941761.el9 ceph 3.4 M 2024-04-01T22:23:27.481 INFO:teuthology.orchestra.run.smithi047.stdout: librbd1 x86_64 2:19.0.0-1992.g1f941761.el9 ceph 3.1 M 2024-04-01T22:23:27.481 INFO:teuthology.orchestra.run.smithi047.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-04-01T22:23:27.481 INFO:teuthology.orchestra.run.smithi047.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-04-01T22:23:27.481 INFO:teuthology.orchestra.run.smithi047.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-04-01T22:23:27.481 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-04-01T22:23:27.481 INFO:teuthology.orchestra.run.smithi047.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-04-01T22:23:27.481 INFO:teuthology.orchestra.run.smithi047.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-04-01T22:23:27.481 INFO:teuthology.orchestra.run.smithi047.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-04-01T22:23:27.481 INFO:teuthology.orchestra.run.smithi047.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-04-01T22:23:27.481 INFO:teuthology.orchestra.run.smithi047.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-04-01T22:23:27.481 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-04-01T22:23:27.481 INFO:teuthology.orchestra.run.smithi047.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-01T22:23:27.481 INFO:teuthology.orchestra.run.smithi047.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-04-01T22:23:27.481 INFO:teuthology.orchestra.run.smithi047.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-04-01T22:23:27.482 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-common x86_64 2:19.0.0-1992.g1f941761.el9 ceph 21 M 2024-04-01T22:23:27.482 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-debuginfo x86_64 2:19.0.0-1992.g1f941761.el9 ceph 23 M 2024-04-01T22:23:27.482 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1992.g1f941761.el9 ceph-noarch 31 k 2024-04-01T22:23:27.482 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mds x86_64 2:19.0.0-1992.g1f941761.el9 ceph 2.4 M 2024-04-01T22:23:27.482 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1992.g1f941761.el9 ceph-noarch 248 k 2024-04-01T22:23:27.482 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mon x86_64 2:19.0.0-1992.g1f941761.el9 ceph 4.7 M 2024-04-01T22:23:27.482 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-osd x86_64 2:19.0.0-1992.g1f941761.el9 ceph 17 M 2024-04-01T22:23:27.482 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1992.g1f941761.el9 ceph-noarch 15 k 2024-04-01T22:23:27.482 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-selinux x86_64 2:19.0.0-1992.g1f941761.el9 ceph 25 k 2024-04-01T22:23:27.482 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-04-01T22:23:27.482 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-04-01T22:23:27.482 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-04-01T22:23:27.482 INFO:teuthology.orchestra.run.smithi047.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-04-01T22:23:27.483 INFO:teuthology.orchestra.run.smithi047.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-01T22:23:27.483 INFO:teuthology.orchestra.run.smithi047.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-01T22:23:27.483 INFO:teuthology.orchestra.run.smithi047.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-01T22:23:27.483 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-01T22:23:27.483 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-01T22:23:27.483 INFO:teuthology.orchestra.run.smithi047.stdout: libcephsqlite x86_64 2:19.0.0-1992.g1f941761.el9 ceph 163 k 2024-04-01T22:23:27.483 INFO:teuthology.orchestra.run.smithi047.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-01T22:23:27.483 INFO:teuthology.orchestra.run.smithi047.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-01T22:23:27.483 INFO:teuthology.orchestra.run.smithi047.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-04-01T22:23:27.483 INFO:teuthology.orchestra.run.smithi047.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-01T22:23:27.483 INFO:teuthology.orchestra.run.smithi047.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-04-01T22:23:27.483 INFO:teuthology.orchestra.run.smithi047.stdout: libradosstriper1 x86_64 2:19.0.0-1992.g1f941761.el9 ceph 501 k 2024-04-01T22:23:27.483 INFO:teuthology.orchestra.run.smithi047.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-04-01T22:23:27.483 INFO:teuthology.orchestra.run.smithi047.stdout: librgw2 x86_64 2:19.0.0-1992.g1f941761.el9 ceph 5.1 M 2024-04-01T22:23:27.484 INFO:teuthology.orchestra.run.smithi047.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-01T22:23:27.484 INFO:teuthology.orchestra.run.smithi047.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-04-01T22:23:27.484 INFO:teuthology.orchestra.run.smithi047.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-04-01T22:23:27.484 INFO:teuthology.orchestra.run.smithi047.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-04-01T22:23:27.484 INFO:teuthology.orchestra.run.smithi047.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-01T22:23:27.484 INFO:teuthology.orchestra.run.smithi047.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-01T22:23:27.484 INFO:teuthology.orchestra.run.smithi047.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-04-01T22:23:27.484 INFO:teuthology.orchestra.run.smithi047.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-04-01T22:23:27.484 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-04-01T22:23:27.484 INFO:teuthology.orchestra.run.smithi047.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-01T22:23:27.484 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-private-libs x86_64 13.14-1.el9 CentOS-AppStream 132 k 2024-04-01T22:23:27.484 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-04-01T22:23:27.484 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-01T22:23:27.484 INFO:teuthology.orchestra.run.smithi047.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-01T22:23:27.484 INFO:teuthology.orchestra.run.smithi047.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-04-01T22:23:27.485 INFO:teuthology.orchestra.run.smithi047.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-04-01T22:23:27.485 INFO:teuthology.orchestra.run.smithi047.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-01T22:23:27.485 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-01T22:23:27.485 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-argparse x86_64 2:19.0.0-1992.g1f941761.el9 ceph 45 k 2024-04-01T22:23:27.485 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-common x86_64 2:19.0.0-1992.g1f941761.el9 ceph 131 k 2024-04-01T22:23:27.485 INFO:teuthology.orchestra.run.smithi047.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-01T22:23:27.485 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-04-01T22:23:27.485 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-01T22:23:27.485 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-01T22:23:27.485 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-01T22:23:27.485 INFO:teuthology.orchestra.run.smithi047.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-01T22:23:27.485 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-04-01T22:23:27.485 INFO:teuthology.orchestra.run.smithi047.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-01T22:23:27.485 INFO:teuthology.orchestra.run.smithi047.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-01T22:23:27.485 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-01T22:23:27.485 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-01T22:23:27.486 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-01T22:23:27.486 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-01T22:23:27.486 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-01T22:23:27.486 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-01T22:23:27.486 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-01T22:23:27.486 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-01T22:23:27.486 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-04-01T22:23:27.486 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-04-01T22:23:27.486 INFO:teuthology.orchestra.run.smithi047.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-01T22:23:27.486 INFO:teuthology.orchestra.run.smithi047.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-01T22:23:27.486 INFO:teuthology.orchestra.run.smithi047.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-04-01T22:23:27.486 INFO:teuthology.orchestra.run.smithi047.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-04-01T22:23:27.486 INFO:teuthology.orchestra.run.smithi047.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-01T22:23:27.486 INFO:teuthology.orchestra.run.smithi047.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-01T22:23:27.486 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-04-01T22:23:27.487 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-04-01T22:23:27.487 INFO:teuthology.orchestra.run.smithi047.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-04-01T22:23:27.487 INFO:teuthology.orchestra.run.smithi047.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-04-01T22:23:27.487 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-01T22:23:27.487 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-04-01T22:23:27.487 INFO:teuthology.orchestra.run.smithi047.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-01T22:23:27.487 INFO:teuthology.orchestra.run.smithi047.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-04-01T22:23:27.487 INFO:teuthology.orchestra.run.smithi047.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-04-01T22:23:27.487 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-01T22:23:27.487 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-04-01T22:23:27.487 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-04-01T22:23:27.487 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-04-01T22:23:27.487 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-01T22:23:27.487 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-04-01T22:23:27.487 INFO:teuthology.orchestra.run.smithi047.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-01T22:23:27.488 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-01T22:23:27.488 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-04-01T22:23:27.488 INFO:teuthology.orchestra.run.smithi047.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-01T22:23:27.488 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-01T22:23:27.488 INFO:teuthology.orchestra.run.smithi047.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-04-01T22:23:27.488 INFO:teuthology.orchestra.run.smithi047.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-01T22:23:27.488 INFO:teuthology.orchestra.run.smithi047.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-04-01T22:23:27.488 INFO:teuthology.orchestra.run.smithi047.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-01T22:23:27.488 INFO:teuthology.orchestra.run.smithi047.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-04-01T22:23:27.488 INFO:teuthology.orchestra.run.smithi047.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-04-01T22:23:27.488 INFO:teuthology.orchestra.run.smithi047.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-01T22:23:27.488 INFO:teuthology.orchestra.run.smithi047.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-01T22:23:27.488 INFO:teuthology.orchestra.run.smithi047.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-01T22:23:27.488 INFO:teuthology.orchestra.run.smithi047.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-01T22:23:27.488 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-04-01T22:23:27.489 INFO:teuthology.orchestra.run.smithi047.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-04-01T22:23:27.489 INFO:teuthology.orchestra.run.smithi047.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-01T22:23:27.489 INFO:teuthology.orchestra.run.smithi047.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-04-01T22:23:27.489 INFO:teuthology.orchestra.run.smithi047.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-01T22:23:27.489 INFO:teuthology.orchestra.run.smithi047.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-04-01T22:23:27.489 INFO:teuthology.orchestra.run.smithi047.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-04-01T22:23:27.489 INFO:teuthology.orchestra.run.smithi047.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-04-01T22:23:27.489 INFO:teuthology.orchestra.run.smithi047.stdout:Installing weak dependencies: 2024-04-01T22:23:27.489 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-04-01T22:23:27.489 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:23:27.489 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-04-01T22:23:27.489 INFO:teuthology.orchestra.run.smithi047.stdout:==================================================================================================== 2024-04-01T22:23:27.489 INFO:teuthology.orchestra.run.smithi047.stdout:Install 172 Packages 2024-04-01T22:23:27.489 INFO:teuthology.orchestra.run.smithi047.stdout:Upgrade 24 Packages 2024-04-01T22:23:27.489 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:23:27.490 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 2.2 G 2024-04-01T22:23:27.490 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-04-01T22:23:28.220 INFO:teuthology.orchestra.run.smithi047.stdout:(1/196): ceph-19.0.0-1992.g1f941761.el9.x86_64. 19 kB/s | 6.6 kB 00:00 2024-04-01T22:23:30.420 INFO:teuthology.orchestra.run.smithi047.stdout:(2/196): ceph-base-19.0.0-1992.g1f941761.el9.x8 2.1 MB/s | 5.3 MB 00:02 2024-04-01T22:23:32.362 INFO:teuthology.orchestra.run.smithi047.stdout:(3/196): ceph-common-19.0.0-1992.g1f941761.el9. 5.0 MB/s | 21 MB 00:04 2024-04-01T22:23:37.578 INFO:teuthology.orchestra.run.smithi047.stdout:(4/196): ceph-debuginfo-19.0.0-1992.g1f941761.e 4.4 MB/s | 23 MB 00:05 2024-04-01T22:23:37.745 INFO:teuthology.orchestra.run.smithi047.stdout:(5/196): ceph-fuse-19.0.0-1992.g1f941761.el9.x8 5.2 MB/s | 889 kB 00:00 2024-04-01T22:23:38.837 INFO:teuthology.orchestra.run.smithi047.stdout:(6/196): ceph-base-debuginfo-19.0.0-1992.g1f941 6.3 MB/s | 68 MB 00:10 2024-04-01T22:23:38.962 INFO:teuthology.orchestra.run.smithi047.stdout:(7/196): ceph-fuse-debuginfo-19.0.0-1992.g1f941 4.9 MB/s | 6.0 MB 00:01 2024-04-01T22:23:38.987 INFO:teuthology.orchestra.run.smithi047.stdout:(8/196): ceph-immutable-object-cache-19.0.0-199 966 kB/s | 145 kB 00:00 2024-04-01T22:23:39.171 INFO:teuthology.orchestra.run.smithi047.stdout:(9/196): ceph-immutable-object-cache-debuginfo- 7.0 MB/s | 1.5 MB 00:00 2024-04-01T22:23:39.272 INFO:teuthology.orchestra.run.smithi047.stdout:(10/196): ceph-mds-19.0.0-1992.g1f941761.el9.x8 8.3 MB/s | 2.4 MB 00:00 2024-04-01T22:23:39.464 INFO:teuthology.orchestra.run.smithi047.stdout:(11/196): ceph-mgr-19.0.0-1992.g1f941761.el9.x8 7.8 MB/s | 1.5 MB 00:00 2024-04-01T22:23:41.597 INFO:teuthology.orchestra.run.smithi047.stdout:(12/196): ceph-mgr-debuginfo-19.0.0-1992.g1f941 9.4 MB/s | 20 MB 00:02 2024-04-01T22:23:42.164 INFO:teuthology.orchestra.run.smithi047.stdout:(13/196): ceph-mon-19.0.0-1992.g1f941761.el9.x8 8.3 MB/s | 4.7 MB 00:00 2024-04-01T22:23:46.481 INFO:teuthology.orchestra.run.smithi047.stdout:(14/196): ceph-mds-debuginfo-19.0.0-1992.g1f941 7.3 MB/s | 53 MB 00:07 2024-04-01T22:23:49.322 INFO:teuthology.orchestra.run.smithi047.stdout:(15/196): ceph-osd-19.0.0-1992.g1f941761.el9.x8 5.9 MB/s | 17 MB 00:02 2024-04-01T22:23:56.389 INFO:teuthology.orchestra.run.smithi047.stdout:(16/196): ceph-mon-debuginfo-19.0.0-1992.g1f941 7.0 MB/s | 99 MB 00:14 2024-04-01T22:23:58.697 INFO:teuthology.orchestra.run.smithi047.stdout:(17/196): ceph-radosgw-19.0.0-1992.g1f941761.el 4.2 MB/s | 9.8 MB 00:02 2024-04-01T22:24:19.884 INFO:teuthology.orchestra.run.smithi181.stdout:Extra Packages for Enterprise Linux 286 kB/s | 21 MB 01:14 2024-04-01T22:24:22.845 INFO:teuthology.orchestra.run.smithi047.stdout:(18/196): ceph-osd-debuginfo-19.0.0-1992.g1f941 8.6 MB/s | 289 MB 00:33 2024-04-01T22:24:22.903 INFO:teuthology.orchestra.run.smithi047.stdout:(19/196): ceph-selinux-19.0.0-1992.g1f941761.el 434 kB/s | 25 kB 00:00 2024-04-01T22:24:24.908 INFO:teuthology.orchestra.run.smithi181.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-04-01T22:24:27.475 INFO:teuthology.orchestra.run.smithi181.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-01T22:24:27.475 INFO:teuthology.orchestra.run.smithi181.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-01T22:24:27.501 INFO:teuthology.orchestra.run.smithi181.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-04-01T22:24:27.504 INFO:teuthology.orchestra.run.smithi181.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-01T22:24:27.505 INFO:teuthology.orchestra.run.smithi181.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-04-01T22:24:27.506 INFO:teuthology.orchestra.run.smithi181.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-04-01T22:24:27.506 INFO:teuthology.orchestra.run.smithi181.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-01T22:24:27.508 INFO:teuthology.orchestra.run.smithi181.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-04-01T22:24:27.509 INFO:teuthology.orchestra.run.smithi181.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-04-01T22:24:27.592 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-04-01T22:24:27.616 INFO:teuthology.orchestra.run.smithi181.stdout:==================================================================================================== 2024-04-01T22:24:27.616 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2024-04-01T22:24:27.616 INFO:teuthology.orchestra.run.smithi181.stdout:==================================================================================================== 2024-04-01T22:24:27.616 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-04-01T22:24:27.616 INFO:teuthology.orchestra.run.smithi181.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-04-01T22:24:27.616 INFO:teuthology.orchestra.run.smithi181.stdout: ceph x86_64 2:19.0.0-1992.g1f941761.el9 ceph 6.6 k 2024-04-01T22:24:27.616 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-base x86_64 2:19.0.0-1992.g1f941761.el9 ceph 5.3 M 2024-04-01T22:24:27.616 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-base-debuginfo x86_64 2:19.0.0-1992.g1f941761.el9 ceph 68 M 2024-04-01T22:24:27.616 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-common-debuginfo x86_64 2:19.0.0-1992.g1f941761.el9 ceph 440 M 2024-04-01T22:24:27.616 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-fuse x86_64 2:19.0.0-1992.g1f941761.el9 ceph 889 k 2024-04-01T22:24:27.616 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-fuse-debuginfo x86_64 2:19.0.0-1992.g1f941761.el9 ceph 6.0 M 2024-04-01T22:24:27.617 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1992.g1f941761.el9 ceph 145 k 2024-04-01T22:24:27.617 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.0.0-1992.g1f941761.el9 ceph 1.5 M 2024-04-01T22:24:27.617 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mds-debuginfo x86_64 2:19.0.0-1992.g1f941761.el9 ceph 53 M 2024-04-01T22:24:27.617 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr x86_64 2:19.0.0-1992.g1f941761.el9 ceph 1.5 M 2024-04-01T22:24:27.617 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1992.g1f941761.el9 ceph-noarch 139 k 2024-04-01T22:24:27.617 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1992.g1f941761.el9 ceph-noarch 3.5 M 2024-04-01T22:24:27.617 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-debuginfo x86_64 2:19.0.0-1992.g1f941761.el9 ceph 20 M 2024-04-01T22:24:27.617 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1992.g1f941761.el9 ceph-noarch 7.4 M 2024-04-01T22:24:27.617 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-rook noarch 2:19.0.0-1992.g1f941761.el9 ceph-noarch 49 k 2024-04-01T22:24:27.617 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mon-debuginfo x86_64 2:19.0.0-1992.g1f941761.el9 ceph 99 M 2024-04-01T22:24:27.617 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-osd-debuginfo x86_64 2:19.0.0-1992.g1f941761.el9 ceph 289 M 2024-04-01T22:24:27.617 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-radosgw x86_64 2:19.0.0-1992.g1f941761.el9 ceph 9.8 M 2024-04-01T22:24:27.617 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-radosgw-debuginfo x86_64 2:19.0.0-1992.g1f941761.el9 ceph 176 M 2024-04-01T22:24:27.618 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-test x86_64 2:19.0.0-1992.g1f941761.el9 ceph 47 M 2024-04-01T22:24:27.618 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-test-debuginfo x86_64 2:19.0.0-1992.g1f941761.el9 ceph 675 M 2024-04-01T22:24:27.618 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-volume noarch 2:19.0.0-1992.g1f941761.el9 ceph-noarch 264 k 2024-04-01T22:24:27.618 INFO:teuthology.orchestra.run.smithi181.stdout: cephadm noarch 2:19.0.0-1992.g1f941761.el9 ceph-noarch 749 k 2024-04-01T22:24:27.618 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-mirror x86_64 2:19.0.0-1992.g1f941761.el9 ceph 222 k 2024-04-01T22:24:27.618 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-shell x86_64 2:19.0.0-1992.g1f941761.el9 ceph 27 k 2024-04-01T22:24:27.618 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-top noarch 2:19.0.0-1992.g1f941761.el9 ceph-noarch 18 k 2024-04-01T22:24:27.618 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-01T22:24:27.618 INFO:teuthology.orchestra.run.smithi181.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-04-01T22:24:27.618 INFO:teuthology.orchestra.run.smithi181.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-04-01T22:24:27.618 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs-devel x86_64 2:19.0.0-1992.g1f941761.el9 ceph 32 k 2024-04-01T22:24:27.618 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs2 x86_64 2:19.0.0-1992.g1f941761.el9 ceph 746 k 2024-04-01T22:24:27.619 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs2-debuginfo x86_64 2:19.0.0-1992.g1f941761.el9 ceph 5.4 M 2024-04-01T22:24:27.619 INFO:teuthology.orchestra.run.smithi181.stdout: librados-devel x86_64 2:19.0.0-1992.g1f941761.el9 ceph 127 k 2024-04-01T22:24:27.619 INFO:teuthology.orchestra.run.smithi181.stdout: librados-devel-debuginfo x86_64 2:19.0.0-1992.g1f941761.el9 ceph 109 k 2024-04-01T22:24:27.619 INFO:teuthology.orchestra.run.smithi181.stdout: librados2-debuginfo x86_64 2:19.0.0-1992.g1f941761.el9 ceph 45 M 2024-04-01T22:24:27.619 INFO:teuthology.orchestra.run.smithi181.stdout: librbd1-debuginfo x86_64 2:19.0.0-1992.g1f941761.el9 ceph 52 M 2024-04-01T22:24:27.619 INFO:teuthology.orchestra.run.smithi181.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-04-01T22:24:27.619 INFO:teuthology.orchestra.run.smithi181.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-01T22:24:27.619 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-01T22:24:27.619 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql x86_64 13.14-1.el9 CentOS-AppStream 1.5 M 2024-04-01T22:24:27.619 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-contrib x86_64 13.14-1.el9 CentOS-AppStream 817 k 2024-04-01T22:24:27.619 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-server x86_64 13.14-1.el9 CentOS-AppStream 5.7 M 2024-04-01T22:24:27.619 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cephfs x86_64 2:19.0.0-1992.g1f941761.el9 ceph 162 k 2024-04-01T22:24:27.619 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cephfs-debuginfo x86_64 2:19.0.0-1992.g1f941761.el9 ceph 615 k 2024-04-01T22:24:27.619 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rados x86_64 2:19.0.0-1992.g1f941761.el9 ceph 321 k 2024-04-01T22:24:27.620 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rados-debuginfo x86_64 2:19.0.0-1992.g1f941761.el9 ceph 769 k 2024-04-01T22:24:27.620 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rbd x86_64 2:19.0.0-1992.g1f941761.el9 ceph 299 k 2024-04-01T22:24:27.620 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rbd-debuginfo x86_64 2:19.0.0-1992.g1f941761.el9 ceph 1.1 M 2024-04-01T22:24:27.620 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rgw x86_64 2:19.0.0-1992.g1f941761.el9 ceph 99 k 2024-04-01T22:24:27.620 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rgw-debuginfo x86_64 2:19.0.0-1992.g1f941761.el9 ceph 337 k 2024-04-01T22:24:27.620 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-fuse x86_64 2:19.0.0-1992.g1f941761.el9 ceph 85 k 2024-04-01T22:24:27.620 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-fuse-debuginfo x86_64 2:19.0.0-1992.g1f941761.el9 ceph 516 k 2024-04-01T22:24:27.620 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-mirror x86_64 2:19.0.0-1992.g1f941761.el9 ceph 3.1 M 2024-04-01T22:24:27.620 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-mirror-debuginfo x86_64 2:19.0.0-1992.g1f941761.el9 ceph 52 M 2024-04-01T22:24:27.620 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-nbd x86_64 2:19.0.0-1992.g1f941761.el9 ceph 170 k 2024-04-01T22:24:27.620 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-nbd-debuginfo x86_64 2:19.0.0-1992.g1f941761.el9 ceph 1.3 M 2024-04-01T22:24:27.620 INFO:teuthology.orchestra.run.smithi181.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-01T22:24:27.620 INFO:teuthology.orchestra.run.smithi181.stdout:Upgrading: 2024-04-01T22:24:27.621 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager x86_64 1:1.47.2-1.el9 CentOS-BaseOS 2.3 M 2024-04-01T22:24:27.621 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 CentOS-BaseOS 1.8 M 2024-04-01T22:24:27.621 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 CentOS-BaseOS 41 k 2024-04-01T22:24:27.621 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 CentOS-BaseOS 247 k 2024-04-01T22:24:27.621 INFO:teuthology.orchestra.run.smithi181.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-04-01T22:24:27.621 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-04-01T22:24:27.621 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-04-01T22:24:27.621 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-04-01T22:24:27.621 INFO:teuthology.orchestra.run.smithi181.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-04-01T22:24:27.621 INFO:teuthology.orchestra.run.smithi181.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-04-01T22:24:27.621 INFO:teuthology.orchestra.run.smithi181.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-04-01T22:24:27.621 INFO:teuthology.orchestra.run.smithi181.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-04-01T22:24:27.621 INFO:teuthology.orchestra.run.smithi181.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-04-01T22:24:27.621 INFO:teuthology.orchestra.run.smithi181.stdout: librados2 x86_64 2:19.0.0-1992.g1f941761.el9 ceph 3.4 M 2024-04-01T22:24:27.622 INFO:teuthology.orchestra.run.smithi181.stdout: librbd1 x86_64 2:19.0.0-1992.g1f941761.el9 ceph 3.1 M 2024-04-01T22:24:27.622 INFO:teuthology.orchestra.run.smithi181.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-04-01T22:24:27.622 INFO:teuthology.orchestra.run.smithi181.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-04-01T22:24:27.622 INFO:teuthology.orchestra.run.smithi181.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-04-01T22:24:27.622 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-04-01T22:24:27.622 INFO:teuthology.orchestra.run.smithi181.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-04-01T22:24:27.622 INFO:teuthology.orchestra.run.smithi181.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-04-01T22:24:27.622 INFO:teuthology.orchestra.run.smithi181.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-04-01T22:24:27.622 INFO:teuthology.orchestra.run.smithi181.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-04-01T22:24:27.622 INFO:teuthology.orchestra.run.smithi181.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-04-01T22:24:27.622 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2024-04-01T22:24:27.622 INFO:teuthology.orchestra.run.smithi181.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-01T22:24:27.623 INFO:teuthology.orchestra.run.smithi181.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-04-01T22:24:27.623 INFO:teuthology.orchestra.run.smithi181.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-04-01T22:24:27.623 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-common x86_64 2:19.0.0-1992.g1f941761.el9 ceph 21 M 2024-04-01T22:24:27.623 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-debuginfo x86_64 2:19.0.0-1992.g1f941761.el9 ceph 23 M 2024-04-01T22:24:27.623 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1992.g1f941761.el9 ceph-noarch 31 k 2024-04-01T22:24:27.623 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mds x86_64 2:19.0.0-1992.g1f941761.el9 ceph 2.4 M 2024-04-01T22:24:27.623 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1992.g1f941761.el9 ceph-noarch 248 k 2024-04-01T22:24:27.623 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mon x86_64 2:19.0.0-1992.g1f941761.el9 ceph 4.7 M 2024-04-01T22:24:27.623 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-osd x86_64 2:19.0.0-1992.g1f941761.el9 ceph 17 M 2024-04-01T22:24:27.623 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1992.g1f941761.el9 ceph-noarch 15 k 2024-04-01T22:24:27.623 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-selinux x86_64 2:19.0.0-1992.g1f941761.el9 ceph 25 k 2024-04-01T22:24:27.623 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-04-01T22:24:27.623 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-04-01T22:24:27.623 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-04-01T22:24:27.624 INFO:teuthology.orchestra.run.smithi181.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-04-01T22:24:27.624 INFO:teuthology.orchestra.run.smithi181.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-01T22:24:27.624 INFO:teuthology.orchestra.run.smithi181.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-01T22:24:27.624 INFO:teuthology.orchestra.run.smithi181.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-01T22:24:27.624 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-01T22:24:27.624 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-01T22:24:27.624 INFO:teuthology.orchestra.run.smithi181.stdout: libcephsqlite x86_64 2:19.0.0-1992.g1f941761.el9 ceph 163 k 2024-04-01T22:24:27.624 INFO:teuthology.orchestra.run.smithi181.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-01T22:24:27.624 INFO:teuthology.orchestra.run.smithi181.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-01T22:24:27.625 INFO:teuthology.orchestra.run.smithi181.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-04-01T22:24:27.625 INFO:teuthology.orchestra.run.smithi181.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-01T22:24:27.625 INFO:teuthology.orchestra.run.smithi181.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-04-01T22:24:27.625 INFO:teuthology.orchestra.run.smithi181.stdout: libradosstriper1 x86_64 2:19.0.0-1992.g1f941761.el9 ceph 501 k 2024-04-01T22:24:27.625 INFO:teuthology.orchestra.run.smithi181.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-04-01T22:24:27.625 INFO:teuthology.orchestra.run.smithi181.stdout: librgw2 x86_64 2:19.0.0-1992.g1f941761.el9 ceph 5.1 M 2024-04-01T22:24:27.625 INFO:teuthology.orchestra.run.smithi181.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-01T22:24:27.625 INFO:teuthology.orchestra.run.smithi181.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-04-01T22:24:27.625 INFO:teuthology.orchestra.run.smithi181.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-04-01T22:24:27.625 INFO:teuthology.orchestra.run.smithi181.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-04-01T22:24:27.625 INFO:teuthology.orchestra.run.smithi181.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-01T22:24:27.625 INFO:teuthology.orchestra.run.smithi181.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-01T22:24:27.625 INFO:teuthology.orchestra.run.smithi181.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-04-01T22:24:27.626 INFO:teuthology.orchestra.run.smithi181.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-04-01T22:24:27.626 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-04-01T22:24:27.626 INFO:teuthology.orchestra.run.smithi181.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-01T22:24:27.626 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-private-libs x86_64 13.14-1.el9 CentOS-AppStream 132 k 2024-04-01T22:24:27.626 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-04-01T22:24:27.626 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-01T22:24:27.626 INFO:teuthology.orchestra.run.smithi181.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-01T22:24:27.626 INFO:teuthology.orchestra.run.smithi181.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-04-01T22:24:27.626 INFO:teuthology.orchestra.run.smithi181.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-04-01T22:24:27.626 INFO:teuthology.orchestra.run.smithi181.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-01T22:24:27.626 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-01T22:24:27.626 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-argparse x86_64 2:19.0.0-1992.g1f941761.el9 ceph 45 k 2024-04-01T22:24:27.626 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-common x86_64 2:19.0.0-1992.g1f941761.el9 ceph 131 k 2024-04-01T22:24:27.627 INFO:teuthology.orchestra.run.smithi181.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-01T22:24:27.627 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-04-01T22:24:27.627 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-01T22:24:27.627 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-01T22:24:27.627 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-01T22:24:27.627 INFO:teuthology.orchestra.run.smithi181.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-01T22:24:27.627 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-04-01T22:24:27.627 INFO:teuthology.orchestra.run.smithi181.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-01T22:24:27.627 INFO:teuthology.orchestra.run.smithi181.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-01T22:24:27.627 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-01T22:24:27.627 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-01T22:24:27.627 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-01T22:24:27.627 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-01T22:24:27.627 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-01T22:24:27.628 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-01T22:24:27.628 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-01T22:24:27.628 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-01T22:24:27.628 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-04-01T22:24:27.628 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-04-01T22:24:27.628 INFO:teuthology.orchestra.run.smithi181.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-01T22:24:27.628 INFO:teuthology.orchestra.run.smithi181.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-01T22:24:27.628 INFO:teuthology.orchestra.run.smithi181.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-04-01T22:24:27.628 INFO:teuthology.orchestra.run.smithi181.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-04-01T22:24:27.628 INFO:teuthology.orchestra.run.smithi181.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-01T22:24:27.628 INFO:teuthology.orchestra.run.smithi181.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-01T22:24:27.628 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-04-01T22:24:27.628 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-04-01T22:24:27.629 INFO:teuthology.orchestra.run.smithi181.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-04-01T22:24:27.629 INFO:teuthology.orchestra.run.smithi181.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-04-01T22:24:27.629 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-01T22:24:27.629 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-04-01T22:24:27.629 INFO:teuthology.orchestra.run.smithi181.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-01T22:24:27.629 INFO:teuthology.orchestra.run.smithi181.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-04-01T22:24:27.629 INFO:teuthology.orchestra.run.smithi181.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-04-01T22:24:27.629 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-01T22:24:27.629 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-04-01T22:24:27.629 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-04-01T22:24:27.629 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-04-01T22:24:27.629 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-01T22:24:27.629 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-04-01T22:24:27.629 INFO:teuthology.orchestra.run.smithi181.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-01T22:24:27.630 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-01T22:24:27.630 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-04-01T22:24:27.630 INFO:teuthology.orchestra.run.smithi181.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-01T22:24:27.630 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-01T22:24:27.630 INFO:teuthology.orchestra.run.smithi181.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-04-01T22:24:27.630 INFO:teuthology.orchestra.run.smithi181.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-01T22:24:27.630 INFO:teuthology.orchestra.run.smithi181.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-04-01T22:24:27.630 INFO:teuthology.orchestra.run.smithi181.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-01T22:24:27.630 INFO:teuthology.orchestra.run.smithi181.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-04-01T22:24:27.630 INFO:teuthology.orchestra.run.smithi181.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-04-01T22:24:27.630 INFO:teuthology.orchestra.run.smithi181.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-01T22:24:27.630 INFO:teuthology.orchestra.run.smithi181.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-01T22:24:27.630 INFO:teuthology.orchestra.run.smithi181.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-01T22:24:27.631 INFO:teuthology.orchestra.run.smithi181.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-01T22:24:27.631 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-04-01T22:24:27.631 INFO:teuthology.orchestra.run.smithi181.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-04-01T22:24:27.631 INFO:teuthology.orchestra.run.smithi181.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-01T22:24:27.631 INFO:teuthology.orchestra.run.smithi181.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-04-01T22:24:27.631 INFO:teuthology.orchestra.run.smithi181.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-01T22:24:27.631 INFO:teuthology.orchestra.run.smithi181.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-04-01T22:24:27.631 INFO:teuthology.orchestra.run.smithi181.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-04-01T22:24:27.631 INFO:teuthology.orchestra.run.smithi181.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-04-01T22:24:27.631 INFO:teuthology.orchestra.run.smithi181.stdout:Installing weak dependencies: 2024-04-01T22:24:27.631 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-04-01T22:24:27.631 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:24:27.631 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-04-01T22:24:27.632 INFO:teuthology.orchestra.run.smithi181.stdout:==================================================================================================== 2024-04-01T22:24:27.632 INFO:teuthology.orchestra.run.smithi181.stdout:Install 172 Packages 2024-04-01T22:24:27.632 INFO:teuthology.orchestra.run.smithi181.stdout:Upgrade 24 Packages 2024-04-01T22:24:27.632 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:24:27.633 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 2.2 G 2024-04-01T22:24:27.633 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-04-01T22:24:28.420 INFO:teuthology.orchestra.run.smithi047.stdout:(20/196): ceph-test-19.0.0-1992.g1f941761.el9.x 8.6 MB/s | 47 MB 00:05 2024-04-01T22:24:29.142 INFO:teuthology.orchestra.run.smithi181.stdout:(1/196): ceph-19.0.0-1992.g1f941761.el9.x86_64. 14 kB/s | 6.6 kB 00:00 2024-04-01T22:24:32.642 INFO:teuthology.orchestra.run.smithi181.stdout:(2/196): ceph-base-19.0.0-1992.g1f941761.el9.x8 1.3 MB/s | 5.3 MB 00:03 2024-04-01T22:24:33.011 INFO:teuthology.orchestra.run.smithi047.stdout:(21/196): ceph-radosgw-debuginfo-19.0.0-1992.g1 5.1 MB/s | 176 MB 00:34 2024-04-01T22:24:33.553 INFO:teuthology.orchestra.run.smithi047.stdout:(22/196): cephfs-mirror-19.0.0-1992.g1f941761.e 409 kB/s | 222 kB 00:00 2024-04-01T22:24:33.878 INFO:teuthology.orchestra.run.smithi047.stdout:(23/196): cephfs-shell-19.0.0-1992.g1f941761.el 83 kB/s | 27 kB 00:00 2024-04-01T22:24:33.962 INFO:teuthology.orchestra.run.smithi047.stdout:(24/196): libcephfs-devel-19.0.0-1992.g1f941761 382 kB/s | 32 kB 00:00 2024-04-01T22:24:34.296 INFO:teuthology.orchestra.run.smithi047.stdout:(25/196): libcephfs2-19.0.0-1992.g1f941761.el9. 2.2 MB/s | 746 kB 00:00 2024-04-01T22:24:35.287 INFO:teuthology.orchestra.run.smithi047.stdout:(26/196): libcephfs2-debuginfo-19.0.0-1992.g1f9 5.4 MB/s | 5.4 MB 00:00 2024-04-01T22:24:35.346 INFO:teuthology.orchestra.run.smithi047.stdout:(27/196): libcephsqlite-19.0.0-1992.g1f941761.e 2.7 MB/s | 163 kB 00:00 2024-04-01T22:24:35.413 INFO:teuthology.orchestra.run.smithi047.stdout:(28/196): librados-devel-19.0.0-1992.g1f941761. 1.9 MB/s | 127 kB 00:00 2024-04-01T22:24:35.496 INFO:teuthology.orchestra.run.smithi047.stdout:(29/196): librados-devel-debuginfo-19.0.0-1992. 1.3 MB/s | 109 kB 00:00 2024-04-01T22:24:41.150 INFO:teuthology.orchestra.run.smithi181.stdout:(3/196): ceph-common-19.0.0-1992.g1f941761.el9. 1.7 MB/s | 21 MB 00:12 2024-04-01T22:24:41.763 INFO:teuthology.orchestra.run.smithi047.stdout:(30/196): librados2-debuginfo-19.0.0-1992.g1f94 7.2 MB/s | 45 MB 00:06 2024-04-01T22:24:41.921 INFO:teuthology.orchestra.run.smithi047.stdout:(31/196): libradosstriper1-19.0.0-1992.g1f94176 3.1 MB/s | 501 kB 00:00 2024-04-01T22:24:44.549 INFO:teuthology.orchestra.run.smithi181.stdout:(4/196): ceph-base-debuginfo-19.0.0-1992.g1f941 4.3 MB/s | 68 MB 00:15 2024-04-01T22:24:44.825 INFO:teuthology.orchestra.run.smithi181.stdout:(5/196): ceph-fuse-19.0.0-1992.g1f941761.el9.x8 3.2 MB/s | 889 kB 00:00 2024-04-01T22:24:45.792 INFO:teuthology.orchestra.run.smithi181.stdout:(6/196): ceph-fuse-debuginfo-19.0.0-1992.g1f941 6.2 MB/s | 6.0 MB 00:00 2024-04-01T22:24:45.892 INFO:teuthology.orchestra.run.smithi181.stdout:(7/196): ceph-immutable-object-cache-19.0.0-199 1.4 MB/s | 145 kB 00:00 2024-04-01T22:24:46.209 INFO:teuthology.orchestra.run.smithi181.stdout:(8/196): ceph-immutable-object-cache-debuginfo- 4.6 MB/s | 1.5 MB 00:00 2024-04-01T22:24:46.676 INFO:teuthology.orchestra.run.smithi181.stdout:(9/196): ceph-mds-19.0.0-1992.g1f941761.el9.x86 5.1 MB/s | 2.4 MB 00:00 2024-04-01T22:24:51.804 INFO:teuthology.orchestra.run.smithi047.stdout:(32/196): librbd1-debuginfo-19.0.0-1992.g1f9417 5.3 MB/s | 52 MB 00:09 2024-04-01T22:24:52.250 INFO:teuthology.orchestra.run.smithi181.stdout:(10/196): ceph-debuginfo-19.0.0-1992.g1f941761. 2.1 MB/s | 23 MB 00:11 2024-04-01T22:24:52.812 INFO:teuthology.orchestra.run.smithi047.stdout:(33/196): librgw2-19.0.0-1992.g1f941761.el9.x86 5.1 MB/s | 5.1 MB 00:01 2024-04-01T22:24:52.888 INFO:teuthology.orchestra.run.smithi047.stdout:(34/196): python3-ceph-argparse-19.0.0-1992.g1f 604 kB/s | 45 kB 00:00 2024-04-01T22:24:52.951 INFO:teuthology.orchestra.run.smithi181.stdout:(11/196): ceph-mgr-19.0.0-1992.g1f941761.el9.x8 2.1 MB/s | 1.5 MB 00:00 2024-04-01T22:24:52.996 INFO:teuthology.orchestra.run.smithi047.stdout:(35/196): python3-ceph-common-19.0.0-1992.g1f94 1.2 MB/s | 131 kB 00:00 2024-04-01T22:24:53.072 INFO:teuthology.orchestra.run.smithi047.stdout:(36/196): python3-cephfs-19.0.0-1992.g1f941761. 2.1 MB/s | 162 kB 00:00 2024-04-01T22:24:53.205 INFO:teuthology.orchestra.run.smithi047.stdout:(37/196): python3-cephfs-debuginfo-19.0.0-1992. 4.5 MB/s | 615 kB 00:00 2024-04-01T22:24:53.330 INFO:teuthology.orchestra.run.smithi047.stdout:(38/196): python3-rados-19.0.0-1992.g1f941761.e 2.5 MB/s | 321 kB 00:00 2024-04-01T22:24:53.531 INFO:teuthology.orchestra.run.smithi047.stdout:(39/196): python3-rados-debuginfo-19.0.0-1992.g 3.8 MB/s | 769 kB 00:00 2024-04-01T22:24:53.614 INFO:teuthology.orchestra.run.smithi047.stdout:(40/196): python3-rbd-19.0.0-1992.g1f941761.el9 3.5 MB/s | 299 kB 00:00 2024-04-01T22:24:53.873 INFO:teuthology.orchestra.run.smithi047.stdout:(41/196): python3-rbd-debuginfo-19.0.0-1992.g1f 4.4 MB/s | 1.1 MB 00:00 2024-04-01T22:24:53.940 INFO:teuthology.orchestra.run.smithi047.stdout:(42/196): python3-rgw-19.0.0-1992.g1f941761.el9 1.5 MB/s | 99 kB 00:00 2024-04-01T22:24:54.074 INFO:teuthology.orchestra.run.smithi047.stdout:(43/196): python3-rgw-debuginfo-19.0.0-1992.g1f 2.5 MB/s | 337 kB 00:00 2024-04-01T22:24:54.166 INFO:teuthology.orchestra.run.smithi047.stdout:(44/196): rbd-fuse-19.0.0-1992.g1f941761.el9.x8 932 kB/s | 85 kB 00:00 2024-04-01T22:24:54.299 INFO:teuthology.orchestra.run.smithi047.stdout:(45/196): rbd-fuse-debuginfo-19.0.0-1992.g1f941 3.8 MB/s | 516 kB 00:00 2024-04-01T22:24:54.858 INFO:teuthology.orchestra.run.smithi047.stdout:(46/196): rbd-mirror-19.0.0-1992.g1f941761.el9. 5.5 MB/s | 3.1 MB 00:00 2024-04-01T22:24:55.526 INFO:teuthology.orchestra.run.smithi181.stdout:(12/196): ceph-mds-debuginfo-19.0.0-1992.g1f941 6.0 MB/s | 53 MB 00:08 2024-04-01T22:24:56.342 INFO:teuthology.orchestra.run.smithi181.stdout:(13/196): ceph-mon-19.0.0-1992.g1f941761.el9.x8 5.7 MB/s | 4.7 MB 00:00 2024-04-01T22:24:59.118 INFO:teuthology.orchestra.run.smithi181.stdout:(14/196): ceph-mgr-debuginfo-19.0.0-1992.g1f941 3.3 MB/s | 20 MB 00:06 2024-04-01T22:25:03.207 INFO:teuthology.orchestra.run.smithi047.stdout:(47/196): rbd-mirror-debuginfo-19.0.0-1992.g1f9 6.2 MB/s | 52 MB 00:08 2024-04-01T22:25:03.291 INFO:teuthology.orchestra.run.smithi047.stdout:(48/196): rbd-nbd-19.0.0-1992.g1f941761.el9.x86 2.0 MB/s | 170 kB 00:00 2024-04-01T22:25:03.525 INFO:teuthology.orchestra.run.smithi047.stdout:(49/196): rbd-nbd-debuginfo-19.0.0-1992.g1f9417 5.5 MB/s | 1.3 MB 00:00 2024-04-01T22:25:03.608 INFO:teuthology.orchestra.run.smithi047.stdout:(50/196): ceph-grafana-dashboards-19.0.0-1992.g 378 kB/s | 31 kB 00:00 2024-04-01T22:25:03.675 INFO:teuthology.orchestra.run.smithi181.stdout:(15/196): ceph-osd-19.0.0-1992.g1f941761.el9.x8 3.7 MB/s | 17 MB 00:04 2024-04-01T22:25:03.683 INFO:teuthology.orchestra.run.smithi047.stdout:(51/196): ceph-mgr-cephadm-19.0.0-1992.g1f94176 1.8 MB/s | 139 kB 00:00 2024-04-01T22:25:04.309 INFO:teuthology.orchestra.run.smithi047.stdout:(52/196): ceph-mgr-dashboard-19.0.0-1992.g1f941 5.6 MB/s | 3.5 MB 00:00 2024-04-01T22:25:05.551 INFO:teuthology.orchestra.run.smithi047.stdout:(53/196): ceph-mgr-diskprediction-local-19.0.0- 6.0 MB/s | 7.4 MB 00:01 2024-04-01T22:25:05.867 INFO:teuthology.orchestra.run.smithi047.stdout:(54/196): ceph-mgr-modules-core-19.0.0-1992.g1f 785 kB/s | 248 kB 00:00 2024-04-01T22:25:06.134 INFO:teuthology.orchestra.run.smithi047.stdout:(55/196): ceph-mgr-rook-19.0.0-1992.g1f941761.e 185 kB/s | 49 kB 00:00 2024-04-01T22:25:06.210 INFO:teuthology.orchestra.run.smithi047.stdout:(56/196): ceph-prometheus-alerts-19.0.0-1992.g1 204 kB/s | 15 kB 00:00 2024-04-01T22:25:06.360 INFO:teuthology.orchestra.run.smithi047.stdout:(57/196): ceph-volume-19.0.0-1992.g1f941761.el9 1.7 MB/s | 264 kB 00:00 2024-04-01T22:25:06.535 INFO:teuthology.orchestra.run.smithi047.stdout:(58/196): cephadm-19.0.0-1992.g1f941761.el9.noa 4.2 MB/s | 749 kB 00:00 2024-04-01T22:25:06.619 INFO:teuthology.orchestra.run.smithi047.stdout:(59/196): cephfs-top-19.0.0-1992.g1f941761.el9. 219 kB/s | 18 kB 00:00 2024-04-01T22:25:06.761 INFO:teuthology.orchestra.run.smithi047.stdout:(60/196): automake-1.16.2-8.el9.noarch.rpm 4.6 MB/s | 662 kB 00:00 2024-04-01T22:25:06.811 INFO:teuthology.orchestra.run.smithi047.stdout:(61/196): bison-3.7.4-5.el9.x86_64.rpm 18 MB/s | 920 kB 00:00 2024-04-01T22:25:06.853 INFO:teuthology.orchestra.run.smithi047.stdout:(62/196): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 106 kB 00:00 2024-04-01T22:25:06.895 INFO:teuthology.orchestra.run.smithi047.stdout:(63/196): flex-2.6.4-9.el9.x86_64.rpm 7.2 MB/s | 307 kB 00:00 2024-04-01T22:25:06.929 INFO:teuthology.orchestra.run.smithi047.stdout:(64/196): flexiblas-3.0.4-8.el9.x86_64.rpm 948 kB/s | 32 kB 00:00 2024-04-01T22:25:07.021 INFO:teuthology.orchestra.run.smithi047.stdout:(65/196): flexiblas-netlib-3.0.4-8.el9.x86_64.r 33 MB/s | 3.0 MB 00:00 2024-04-01T22:25:07.055 INFO:teuthology.orchestra.run.smithi047.stdout:(66/196): flexiblas-openblas-openmp-3.0.4-8.el9 515 kB/s | 17 kB 00:00 2024-04-01T22:25:07.088 INFO:teuthology.orchestra.run.smithi047.stdout:(67/196): libaio-devel-0.3.111-13.el9.x86_64.rp 303 kB/s | 10 kB 00:00 2024-04-01T22:25:07.122 INFO:teuthology.orchestra.run.smithi047.stdout:(68/196): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.7 MB/s | 159 kB 00:00 2024-04-01T22:25:07.155 INFO:teuthology.orchestra.run.smithi047.stdout:(69/196): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-04-01T22:25:07.197 INFO:teuthology.orchestra.run.smithi047.stdout:(70/196): librdkafka-1.6.1-102.el9.x86_64.rpm 16 MB/s | 661 kB 00:00 2024-04-01T22:25:07.239 INFO:teuthology.orchestra.run.smithi047.stdout:(71/196): libtool-2.4.6-45.el9.x86_64.rpm 14 MB/s | 578 kB 00:00 2024-04-01T22:25:07.273 INFO:teuthology.orchestra.run.smithi047.stdout:(72/196): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 46 kB 00:00 2024-04-01T22:25:07.315 INFO:teuthology.orchestra.run.smithi047.stdout:(73/196): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.6 MB/s | 282 kB 00:00 2024-04-01T22:25:07.357 INFO:teuthology.orchestra.run.smithi047.stdout:(74/196): lua-5.4.4-4.el9.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2024-04-01T22:25:07.399 INFO:teuthology.orchestra.run.smithi047.stdout:(75/196): oniguruma-6.9.6-1.el9.5.x86_64.rpm 5.1 MB/s | 217 kB 00:00 2024-04-01T22:25:07.424 INFO:teuthology.orchestra.run.smithi047.stdout:(76/196): openblas-0.3.21-2.el9.x86_64.rpm 1.3 MB/s | 34 kB 00:00 2024-04-01T22:25:07.549 INFO:teuthology.orchestra.run.smithi047.stdout:(77/196): openblas-openmp-0.3.21-2.el9.x86_64.r 38 MB/s | 4.7 MB 00:00 2024-04-01T22:25:07.608 INFO:teuthology.orchestra.run.smithi047.stdout:(78/196): postgresql-13.14-1.el9.x86_64.rpm 26 MB/s | 1.5 MB 00:00 2024-04-01T22:25:07.658 INFO:teuthology.orchestra.run.smithi047.stdout:(79/196): postgresql-contrib-13.14-1.el9.x86_64 16 MB/s | 817 kB 00:00 2024-04-01T22:25:07.692 INFO:teuthology.orchestra.run.smithi047.stdout:(80/196): postgresql-private-libs-13.14-1.el9.x 3.9 MB/s | 132 kB 00:00 2024-04-01T22:25:07.834 INFO:teuthology.orchestra.run.smithi047.stdout:(81/196): postgresql-server-13.14-1.el9.x86_64. 40 MB/s | 5.7 MB 00:00 2024-04-01T22:25:07.884 INFO:teuthology.orchestra.run.smithi047.stdout:(82/196): protobuf-3.14.0-13.el9.x86_64.rpm 20 MB/s | 1.0 MB 00:00 2024-04-01T22:25:07.918 INFO:teuthology.orchestra.run.smithi047.stdout:(83/196): python3-attrs-20.3.0-7.el9.noarch.rpm 2.3 MB/s | 78 kB 00:00 2024-04-01T22:25:08.060 INFO:teuthology.orchestra.run.smithi047.stdout:(84/196): python3-babel-2.9.1-2.el9.noarch.rpm 41 MB/s | 5.8 MB 00:00 2024-04-01T22:25:08.085 INFO:teuthology.orchestra.run.smithi047.stdout:(85/196): python3-jsonpatch-1.21-16.el9.noarch. 989 kB/s | 24 kB 00:00 2024-04-01T22:25:08.110 INFO:teuthology.orchestra.run.smithi047.stdout:(86/196): python3-jsonpointer-2.0-4.el9.noarch. 719 kB/s | 18 kB 00:00 2024-04-01T22:25:08.160 INFO:teuthology.orchestra.run.smithi047.stdout:(87/196): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2024-04-01T22:25:08.186 INFO:teuthology.orchestra.run.smithi047.stdout:(88/196): python3-markupsafe-1.1.1-12.el9.x86_6 1.2 MB/s | 32 kB 00:00 2024-04-01T22:25:08.311 INFO:teuthology.orchestra.run.smithi047.stdout:(89/196): python3-numpy-1.20.1-5.el9.x86_64.rpm 38 MB/s | 4.8 MB 00:00 2024-04-01T22:25:08.361 INFO:teuthology.orchestra.run.smithi047.stdout:(90/196): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 217 kB 00:00 2024-04-01T22:25:08.395 INFO:teuthology.orchestra.run.smithi047.stdout:(91/196): python3-oauthlib-3.1.1-5.el9.noarch.r 5.1 MB/s | 174 kB 00:00 2024-04-01T22:25:08.429 INFO:teuthology.orchestra.run.smithi047.stdout:(92/196): python3-packaging-20.9-5.el9.noarch.r 2.0 MB/s | 69 kB 00:00 2024-04-01T22:25:08.463 INFO:teuthology.orchestra.run.smithi047.stdout:(93/196): python3-prettytable-0.7.2-27.el9.noar 1.2 MB/s | 41 kB 00:00 2024-04-01T22:25:08.505 INFO:teuthology.orchestra.run.smithi047.stdout:(94/196): python3-protobuf-3.14.0-13.el9.noarch 5.6 MB/s | 238 kB 00:00 2024-04-01T22:25:08.538 INFO:teuthology.orchestra.run.smithi047.stdout:(95/196): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.9 MB/s | 132 kB 00:00 2024-04-01T22:25:08.580 INFO:teuthology.orchestra.run.smithi047.stdout:(96/196): python3-pyasn1-modules-0.4.8-6.el9.no 4.9 MB/s | 211 kB 00:00 2024-04-01T22:25:08.613 INFO:teuthology.orchestra.run.smithi047.stdout:(97/196): python3-pytz-2021.1-5.el9.noarch.rpm 1.4 MB/s | 47 kB 00:00 2024-04-01T22:25:08.647 INFO:teuthology.orchestra.run.smithi047.stdout:(98/196): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 43 kB 00:00 2024-04-01T22:25:08.972 INFO:teuthology.orchestra.run.smithi047.stdout:(99/196): python3-scipy-1.6.2-8.el9.x86_64.rpm 48 MB/s | 16 MB 00:00 2024-04-01T22:25:09.006 INFO:teuthology.orchestra.run.smithi047.stdout:(100/196): python3-toml-0.10.2-6.el9.noarch.rpm 1.1 MB/s | 39 kB 00:00 2024-04-01T22:25:09.039 INFO:teuthology.orchestra.run.smithi047.stdout:(101/196): python3-wcwidth-0.2.5-8.el9.noarch.r 1.2 MB/s | 41 kB 00:00 2024-04-01T22:25:09.082 INFO:teuthology.orchestra.run.smithi047.stdout:(102/196): qatlib-24.02.0-1.el9.x86_64.rpm 5.1 MB/s | 220 kB 00:00 2024-04-01T22:25:09.118 INFO:teuthology.orchestra.run.smithi047.stdout:(103/196): qatlib-service-24.02.0-1.el9.x86_64. 1.0 MB/s | 35 kB 00:00 2024-04-01T22:25:09.149 INFO:teuthology.orchestra.run.smithi047.stdout:(104/196): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 46 kB 00:00 2024-04-01T22:25:09.191 INFO:teuthology.orchestra.run.smithi047.stdout:(105/196): socat-1.7.4.1-5.el9.x86_64.rpm 7.0 MB/s | 300 kB 00:00 2024-04-01T22:25:09.225 INFO:teuthology.orchestra.run.smithi047.stdout:(106/196): uuid-1.6.2-55.el9.x86_64.rpm 1.7 MB/s | 56 kB 00:00 2024-04-01T22:25:09.258 INFO:teuthology.orchestra.run.smithi047.stdout:(107/196): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 63 kB 00:00 2024-04-01T22:25:09.292 INFO:teuthology.orchestra.run.smithi047.stdout:(108/196): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-04-01T22:25:09.325 INFO:teuthology.orchestra.run.smithi047.stdout:(109/196): fuse-2.9.9-15.el9.x86_64.rpm 2.3 MB/s | 79 kB 00:00 2024-04-01T22:25:09.367 INFO:teuthology.orchestra.run.smithi047.stdout:(110/196): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.6 MB/s | 241 kB 00:00 2024-04-01T22:25:09.418 INFO:teuthology.orchestra.run.smithi047.stdout:(111/196): python3-cryptography-36.0.1-4.el9.x8 23 MB/s | 1.1 MB 00:00 2024-04-01T22:25:09.451 INFO:teuthology.orchestra.run.smithi047.stdout:(112/196): python3-ply-3.11-14.el9.noarch.rpm 3.0 MB/s | 103 kB 00:00 2024-04-01T22:25:09.485 INFO:teuthology.orchestra.run.smithi047.stdout:(113/196): python3-pycparser-2.20-6.el9.noarch. 3.6 MB/s | 124 kB 00:00 2024-04-01T22:25:09.518 INFO:teuthology.orchestra.run.smithi047.stdout:(114/196): python3-urllib3-1.26.5-5.el9.noarch. 5.5 MB/s | 187 kB 00:00 2024-04-01T22:25:09.644 INFO:teuthology.orchestra.run.smithi047.stdout:(115/196): jq-1.6-16.el9.x86_64.rpm 1.5 MB/s | 187 kB 00:00 2024-04-01T22:25:09.729 INFO:teuthology.orchestra.run.smithi047.stdout:(116/196): libgfortran-11.4.1-3.el9.x86_64.rpm 9.4 MB/s | 803 kB 00:00 2024-04-01T22:25:09.769 INFO:teuthology.orchestra.run.smithi047.stdout:(117/196): libquadmath-11.4.1-3.el9.x86_64.rpm 4.6 MB/s | 195 kB 00:00 2024-04-01T22:25:09.812 INFO:teuthology.orchestra.run.smithi047.stdout:(118/196): python3-requests-2.25.1-8.el9.noarch 2.9 MB/s | 125 kB 00:00 2024-04-01T22:25:09.970 INFO:teuthology.orchestra.run.smithi047.stdout:(119/196): elfutils-libelf-devel-0.190-2.el9.x8 136 kB/s | 21 kB 00:00 2024-04-01T22:25:10.029 INFO:teuthology.orchestra.run.smithi047.stdout:(120/196): libuuid-devel-2.37.4-18.el9.x86_64.r 436 kB/s | 25 kB 00:00 2024-04-01T22:25:10.388 INFO:teuthology.orchestra.run.smithi047.stdout:(121/196): openssl-devel-3.0.7-27.el9.x86_64.rp 12 MB/s | 4.1 MB 00:00 2024-04-01T22:25:10.446 INFO:teuthology.orchestra.run.smithi047.stdout:(122/196): python3-devel-3.9.17-2.el9.x86_64.rp 4.1 MB/s | 245 kB 00:00 2024-04-01T22:25:10.505 INFO:teuthology.orchestra.run.smithi047.stdout:(123/196): python3-jinja2-2.11.3-5.el9.noarch.r 4.1 MB/s | 248 kB 00:00 2024-04-01T22:25:10.563 INFO:teuthology.orchestra.run.smithi047.stdout:(124/196): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.6 MB/s | 94 kB 00:00 2024-04-01T22:25:10.642 INFO:teuthology.orchestra.run.smithi181.stdout:(16/196): ceph-mon-debuginfo-19.0.0-1992.g1f941 6.9 MB/s | 99 MB 00:14 2024-04-01T22:25:11.138 INFO:teuthology.orchestra.run.smithi047.stdout:(125/196): lua-devel-5.4.4-4.el9.x86_64.rpm 39 kB/s | 22 kB 00:00 2024-04-01T22:25:12.050 INFO:teuthology.orchestra.run.smithi181.stdout:(17/196): ceph-radosgw-19.0.0-1992.g1f941761.el 7.0 MB/s | 9.8 MB 00:01 2024-04-01T22:25:12.822 INFO:teuthology.orchestra.run.smithi047.stdout:(126/196): protobuf-compiler-3.14.0-13.el9.x86_ 513 kB/s | 863 kB 00:01 2024-04-01T22:25:13.055 INFO:teuthology.orchestra.run.smithi047.stdout:(127/196): abseil-cpp-20211102.0-3.el9.x86_64.r 2.3 MB/s | 548 kB 00:00 2024-04-01T22:25:13.106 INFO:teuthology.orchestra.run.smithi047.stdout:(128/196): gperftools-libs-2.9.1-2.el9.x86_64.r 6.1 MB/s | 309 kB 00:00 2024-04-01T22:25:13.156 INFO:teuthology.orchestra.run.smithi047.stdout:(129/196): grpc-data-1.46.7-10.el9.noarch.rpm 389 kB/s | 19 kB 00:00 2024-04-01T22:25:13.423 INFO:teuthology.orchestra.run.smithi047.stdout:(130/196): libarrow-9.0.0-10.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2024-04-01T22:25:13.465 INFO:teuthology.orchestra.run.smithi047.stdout:(131/196): libarrow-doc-9.0.0-10.el9.noarch.rpm 626 kB/s | 26 kB 00:00 2024-04-01T22:25:13.507 INFO:teuthology.orchestra.run.smithi047.stdout:(132/196): liboath-2.6.7-2.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2024-04-01T22:25:13.557 INFO:teuthology.orchestra.run.smithi047.stdout:(133/196): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-04-01T22:25:13.611 INFO:teuthology.orchestra.run.smithi047.stdout:(134/196): luarocks-3.9.2-1.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-04-01T22:25:13.666 INFO:teuthology.orchestra.run.smithi047.stdout:(135/196): parquet-libs-9.0.0-10.el9.x86_64.rpm 14 MB/s | 838 kB 00:00 2024-04-01T22:25:13.716 INFO:teuthology.orchestra.run.smithi047.stdout:(136/196): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-04-01T22:25:13.767 INFO:teuthology.orchestra.run.smithi047.stdout:(137/196): python3-bcrypt-3.2.2-1.el9.x86_64.rp 869 kB/s | 43 kB 00:00 2024-04-01T22:25:13.809 INFO:teuthology.orchestra.run.smithi047.stdout:(138/196): python3-cachetools-4.2.4-1.el9.noarc 773 kB/s | 32 kB 00:00 2024-04-01T22:25:13.851 INFO:teuthology.orchestra.run.smithi047.stdout:(139/196): python3-certifi-2021.10.8-2.el9.noar 361 kB/s | 15 kB 00:00 2024-04-01T22:25:13.909 INFO:teuthology.orchestra.run.smithi047.stdout:(140/196): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-04-01T22:25:13.960 INFO:teuthology.orchestra.run.smithi047.stdout:(141/196): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-04-01T22:25:14.010 INFO:teuthology.orchestra.run.smithi047.stdout:(142/196): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-04-01T22:25:14.060 INFO:teuthology.orchestra.run.smithi047.stdout:(143/196): python3-colorama-0.4.4-12.el9.noarch 707 kB/s | 35 kB 00:00 2024-04-01T22:25:14.110 INFO:teuthology.orchestra.run.smithi047.stdout:(144/196): python3-google-auth-2.28.2-1.el9.noa 4.0 MB/s | 203 kB 00:00 2024-04-01T22:25:14.194 INFO:teuthology.orchestra.run.smithi047.stdout:(145/196): python3-grpcio-1.46.7-10.el9.x86_64. 25 MB/s | 2.0 MB 00:00 2024-04-01T22:25:14.244 INFO:teuthology.orchestra.run.smithi047.stdout:(146/196): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-04-01T22:25:14.303 INFO:teuthology.orchestra.run.smithi047.stdout:(147/196): python3-jaraco-8.2.1-3.el9.noarch.rp 182 kB/s | 11 kB 00:00 2024-04-01T22:25:14.353 INFO:teuthology.orchestra.run.smithi047.stdout:(148/196): python3-jaraco-classes-3.2.1-5.el9.n 355 kB/s | 18 kB 00:00 2024-04-01T22:25:14.404 INFO:teuthology.orchestra.run.smithi047.stdout:(149/196): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-04-01T22:25:14.454 INFO:teuthology.orchestra.run.smithi047.stdout:(150/196): python3-jaraco-functools-3.5.0-2.el9 390 kB/s | 19 kB 00:00 2024-04-01T22:25:14.504 INFO:teuthology.orchestra.run.smithi047.stdout:(151/196): python3-jaraco-text-3.2.0-6.el9.noar 395 kB/s | 20 kB 00:00 2024-04-01T22:25:14.571 INFO:teuthology.orchestra.run.smithi047.stdout:(152/196): python3-kubernetes-26.1.0-2.el9.noar 15 MB/s | 1.0 MB 00:00 2024-04-01T22:25:14.613 INFO:teuthology.orchestra.run.smithi047.stdout:(153/196): python3-logutils-0.3.5-21.el9.noarch 1.1 MB/s | 46 kB 00:00 2024-04-01T22:25:14.663 INFO:teuthology.orchestra.run.smithi047.stdout:(154/196): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-04-01T22:25:14.706 INFO:teuthology.orchestra.run.smithi047.stdout:(155/196): python3-natsort-7.1.1-5.el9.noarch.r 1.4 MB/s | 58 kB 00:00 2024-04-01T22:25:14.789 INFO:teuthology.orchestra.run.smithi047.stdout:(156/196): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-04-01T22:25:14.856 INFO:teuthology.orchestra.run.smithi047.stdout:(157/196): python3-portend-3.1.0-2.el9.noarch.r 247 kB/s | 16 kB 00:00 2024-04-01T22:25:14.914 INFO:teuthology.orchestra.run.smithi047.stdout:(158/196): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-04-01T22:25:14.973 INFO:teuthology.orchestra.run.smithi047.stdout:(159/196): python3-pyperclip-1.8.2-2.el9.noarch 485 kB/s | 28 kB 00:00 2024-04-01T22:25:15.040 INFO:teuthology.orchestra.run.smithi047.stdout:(160/196): python3-repoze-lru-0.7-16.el9.noarch 460 kB/s | 31 kB 00:00 2024-04-01T22:25:15.107 INFO:teuthology.orchestra.run.smithi047.stdout:(161/196): python3-routes-2.5.1-5.el9.noarch.rp 2.8 MB/s | 188 kB 00:00 2024-04-01T22:25:15.166 INFO:teuthology.orchestra.run.smithi047.stdout:(162/196): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-04-01T22:25:15.224 INFO:teuthology.orchestra.run.smithi047.stdout:(163/196): python3-tempora-5.0.0-2.el9.noarch.r 612 kB/s | 36 kB 00:00 2024-04-01T22:25:15.266 INFO:teuthology.orchestra.run.smithi047.stdout:(164/196): python3-typing-extensions-4.4.0-2.el 1.2 MB/s | 51 kB 00:00 2024-04-01T22:25:15.308 INFO:teuthology.orchestra.run.smithi047.stdout:(165/196): python3-webob-1.8.7-6.el9.noarch.rpm 5.4 MB/s | 230 kB 00:00 2024-04-01T22:25:15.358 INFO:teuthology.orchestra.run.smithi047.stdout:(166/196): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-04-01T22:25:15.409 INFO:teuthology.orchestra.run.smithi047.stdout:(167/196): python3-werkzeug-2.0.3-3.el9.1.noarc 8.4 MB/s | 427 kB 00:00 2024-04-01T22:25:15.452 INFO:teuthology.orchestra.run.smithi047.stdout:(168/196): python3-zc-lockfile-2.0-10.el9.noarc 468 kB/s | 20 kB 00:00 2024-04-01T22:25:15.502 INFO:teuthology.orchestra.run.smithi047.stdout:(169/196): re2-20211101-3.el9.x86_64.rpm 3.8 MB/s | 192 kB 00:00 2024-04-01T22:25:15.577 INFO:teuthology.orchestra.run.smithi047.stdout:(170/196): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-04-01T22:25:16.753 INFO:teuthology.orchestra.run.smithi047.stdout:(171/196): librados2-19.0.0-1992.g1f941761.el9. 2.9 MB/s | 3.4 MB 00:01 2024-04-01T22:25:17.503 INFO:teuthology.orchestra.run.smithi047.stdout:(172/196): librbd1-19.0.0-1992.g1f941761.el9.x8 4.2 MB/s | 3.1 MB 00:00 2024-04-01T22:25:17.595 INFO:teuthology.orchestra.run.smithi047.stdout:(173/196): NetworkManager-1.47.2-1.el9.x86_64.r 25 MB/s | 2.3 MB 00:00 2024-04-01T22:25:17.662 INFO:teuthology.orchestra.run.smithi047.stdout:(174/196): NetworkManager-libnm-1.47.2-1.el9.x8 27 MB/s | 1.8 MB 00:00 2024-04-01T22:25:17.696 INFO:teuthology.orchestra.run.smithi047.stdout:(175/196): NetworkManager-team-1.47.2-1.el9.x86 1.2 MB/s | 41 kB 00:00 2024-04-01T22:25:17.729 INFO:teuthology.orchestra.run.smithi047.stdout:(176/196): NetworkManager-tui-1.47.2-1.el9.x86_ 7.2 MB/s | 247 kB 00:00 2024-04-01T22:25:17.771 INFO:teuthology.orchestra.run.smithi047.stdout:(177/196): xfsdump-3.1.12-4.el9.x86_64.rpm 7.6 MB/s | 321 kB 00:00 2024-04-01T22:25:17.855 INFO:teuthology.orchestra.run.smithi047.stdout:(178/196): acl-2.3.1-4.el9.x86_64.rpm 855 kB/s | 71 kB 00:00 2024-04-01T22:25:17.897 INFO:teuthology.orchestra.run.smithi047.stdout:(179/196): elfutils-debuginfod-client-0.190-2.e 878 kB/s | 36 kB 00:00 2024-04-01T22:25:17.964 INFO:teuthology.orchestra.run.smithi047.stdout:(180/196): elfutils-libelf-0.190-2.el9.x86_64.r 2.8 MB/s | 192 kB 00:00 2024-04-01T22:25:18.014 INFO:teuthology.orchestra.run.smithi047.stdout:(181/196): elfutils-libs-0.190-2.el9.x86_64.rpm 5.0 MB/s | 256 kB 00:00 2024-04-01T22:25:18.056 INFO:teuthology.orchestra.run.smithi047.stdout:(182/196): libacl-2.3.1-4.el9.x86_64.rpm 553 kB/s | 23 kB 00:00 2024-04-01T22:25:18.098 INFO:teuthology.orchestra.run.smithi047.stdout:(183/196): libblkid-2.37.4-18.el9.x86_64.rpm 2.6 MB/s | 108 kB 00:00 2024-04-01T22:25:18.140 INFO:teuthology.orchestra.run.smithi047.stdout:(184/196): libfdisk-2.37.4-18.el9.x86_64.rpm 3.6 MB/s | 155 kB 00:00 2024-04-01T22:25:18.182 INFO:teuthology.orchestra.run.smithi047.stdout:(185/196): libmount-2.37.4-18.el9.x86_64.rpm 3.2 MB/s | 136 kB 00:00 2024-04-01T22:25:18.224 INFO:teuthology.orchestra.run.smithi047.stdout:(186/196): libsmartcols-2.37.4-18.el9.x86_64.rp 1.5 MB/s | 64 kB 00:00 2024-04-01T22:25:18.266 INFO:teuthology.orchestra.run.smithi047.stdout:(187/196): libuuid-2.37.4-18.el9.x86_64.rpm 693 kB/s | 29 kB 00:00 2024-04-01T22:25:18.341 INFO:teuthology.orchestra.run.smithi047.stdout:(188/196): openssl-3.0.7-27.el9.x86_64.rpm 16 MB/s | 1.2 MB 00:00 2024-04-01T22:25:18.417 INFO:teuthology.orchestra.run.smithi047.stdout:(189/196): openssl-libs-3.0.7-27.el9.x86_64.rpm 29 MB/s | 2.2 MB 00:00 2024-04-01T22:25:18.492 INFO:teuthology.orchestra.run.smithi047.stdout:(190/196): util-linux-2.37.4-18.el9.x86_64.rpm 31 MB/s | 2.3 MB 00:00 2024-04-01T22:25:18.534 INFO:teuthology.orchestra.run.smithi047.stdout:(191/196): util-linux-core-2.37.4-18.el9.x86_64 11 MB/s | 465 kB 00:00 2024-04-01T22:25:18.568 INFO:teuthology.orchestra.run.smithi047.stdout:(192/196): util-linux-user-2.37.4-18.el9.x86_64 932 kB/s | 31 kB 00:00 2024-04-01T22:25:18.618 INFO:teuthology.orchestra.run.smithi047.stdout:(193/196): xfsprogs-6.3.0-1.el9.x86_64.rpm 22 MB/s | 1.1 MB 00:00 2024-04-01T22:25:18.752 INFO:teuthology.orchestra.run.smithi047.stdout:(194/196): libacl-devel-2.3.1-4.el9.x86_64.rpm 558 kB/s | 74 kB 00:00 2024-04-01T22:25:45.947 INFO:teuthology.orchestra.run.smithi181.stdout:(18/196): ceph-radosgw-debuginfo-19.0.0-1992.g1 5.2 MB/s | 176 MB 00:33 2024-04-01T22:25:46.079 INFO:teuthology.orchestra.run.smithi181.stdout:(19/196): ceph-selinux-19.0.0-1992.g1f941761.el 189 kB/s | 25 kB 00:00 2024-04-01T22:26:08.539 INFO:teuthology.orchestra.run.smithi047.stdout:(195/196): ceph-common-debuginfo-19.0.0-1992.g1 2.8 MB/s | 440 MB 02:38 2024-04-01T22:26:09.744 INFO:teuthology.orchestra.run.smithi181.stdout:(20/196): ceph-test-19.0.0-1992.g1f941761.el9.x 2.0 MB/s | 47 MB 00:23 2024-04-01T22:26:17.835 INFO:teuthology.orchestra.run.smithi181.stdout:(21/196): ceph-osd-debuginfo-19.0.0-1992.g1f941 3.9 MB/s | 289 MB 01:14 2024-04-01T22:26:18.176 INFO:teuthology.orchestra.run.smithi181.stdout:(22/196): cephfs-mirror-19.0.0-1992.g1f941761.e 649 kB/s | 222 kB 00:00 2024-04-01T22:26:18.276 INFO:teuthology.orchestra.run.smithi181.stdout:(23/196): cephfs-shell-19.0.0-1992.g1f941761.el 271 kB/s | 27 kB 00:00 2024-04-01T22:26:18.377 INFO:teuthology.orchestra.run.smithi181.stdout:(24/196): libcephfs-devel-19.0.0-1992.g1f941761 317 kB/s | 32 kB 00:00 2024-04-01T22:26:18.736 INFO:teuthology.orchestra.run.smithi181.stdout:(25/196): libcephfs2-19.0.0-1992.g1f941761.el9. 2.0 MB/s | 746 kB 00:00 2024-04-01T22:26:20.919 INFO:teuthology.orchestra.run.smithi181.stdout:(26/196): libcephfs2-debuginfo-19.0.0-1992.g1f9 2.5 MB/s | 5.4 MB 00:02 2024-04-01T22:26:21.028 INFO:teuthology.orchestra.run.smithi181.stdout:(27/196): libcephsqlite-19.0.0-1992.g1f941761.e 1.5 MB/s | 163 kB 00:00 2024-04-01T22:26:21.128 INFO:teuthology.orchestra.run.smithi181.stdout:(28/196): librados-devel-19.0.0-1992.g1f941761. 1.2 MB/s | 127 kB 00:00 2024-04-01T22:26:21.228 INFO:teuthology.orchestra.run.smithi181.stdout:(29/196): librados-devel-debuginfo-19.0.0-1992. 1.1 MB/s | 109 kB 00:00 2024-04-01T22:26:28.420 INFO:teuthology.orchestra.run.smithi047.stdout:(196/196): ceph-test-debuginfo-19.0.0-1992.g1f9 5.6 MB/s | 675 MB 01:59 2024-04-01T22:26:28.425 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-04-01T22:26:28.425 INFO:teuthology.orchestra.run.smithi047.stdout:Total 12 MB/s | 2.2 GB 03:00 2024-04-01T22:26:28.784 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-04-01T22:26:29.088 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-04-01T22:26:29.089 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-04-01T22:26:39.618 INFO:teuthology.orchestra.run.smithi181.stdout:(30/196): ceph-common-debuginfo-19.0.0-1992.g1f 3.5 MB/s | 440 MB 02:06 2024-04-01T22:26:39.877 INFO:teuthology.orchestra.run.smithi181.stdout:(31/196): libradosstriper1-19.0.0-1992.g1f94176 1.9 MB/s | 501 kB 00:00 2024-04-01T22:26:42.693 INFO:teuthology.orchestra.run.smithi181.stdout:(32/196): librados2-debuginfo-19.0.0-1992.g1f94 2.1 MB/s | 45 MB 00:21 2024-04-01T22:26:43.508 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-04-01T22:26:43.509 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-04-01T22:26:45.451 INFO:teuthology.orchestra.run.smithi181.stdout:(33/196): librgw2-19.0.0-1992.g1f941761.el9.x86 1.9 MB/s | 5.1 MB 00:02 2024-04-01T22:26:45.526 INFO:teuthology.orchestra.run.smithi181.stdout:(34/196): python3-ceph-argparse-19.0.0-1992.g1f 605 kB/s | 45 kB 00:00 2024-04-01T22:26:45.594 INFO:teuthology.orchestra.run.smithi181.stdout:(35/196): python3-ceph-common-19.0.0-1992.g1f94 1.9 MB/s | 131 kB 00:00 2024-04-01T22:26:45.702 INFO:teuthology.orchestra.run.smithi181.stdout:(36/196): python3-cephfs-19.0.0-1992.g1f941761. 1.5 MB/s | 162 kB 00:00 2024-04-01T22:26:45.894 INFO:teuthology.orchestra.run.smithi181.stdout:(37/196): python3-cephfs-debuginfo-19.0.0-1992. 3.1 MB/s | 615 kB 00:00 2024-04-01T22:26:46.011 INFO:teuthology.orchestra.run.smithi181.stdout:(38/196): python3-rados-19.0.0-1992.g1f941761.e 2.7 MB/s | 321 kB 00:00 2024-04-01T22:26:46.236 INFO:teuthology.orchestra.run.smithi181.stdout:(39/196): python3-rados-debuginfo-19.0.0-1992.g 3.3 MB/s | 769 kB 00:00 2024-04-01T22:26:46.353 INFO:teuthology.orchestra.run.smithi181.stdout:(40/196): python3-rbd-19.0.0-1992.g1f941761.el9 2.5 MB/s | 299 kB 00:00 2024-04-01T22:26:46.695 INFO:teuthology.orchestra.run.smithi181.stdout:(41/196): python3-rbd-debuginfo-19.0.0-1992.g1f 3.3 MB/s | 1.1 MB 00:00 2024-04-01T22:26:46.762 INFO:teuthology.orchestra.run.smithi181.stdout:(42/196): python3-rgw-19.0.0-1992.g1f941761.el9 1.5 MB/s | 99 kB 00:00 2024-04-01T22:26:46.904 INFO:teuthology.orchestra.run.smithi181.stdout:(43/196): python3-rgw-debuginfo-19.0.0-1992.g1f 2.3 MB/s | 337 kB 00:00 2024-04-01T22:26:46.971 INFO:teuthology.orchestra.run.smithi181.stdout:(44/196): rbd-fuse-19.0.0-1992.g1f941761.el9.x8 1.3 MB/s | 85 kB 00:00 2024-04-01T22:26:47.163 INFO:teuthology.orchestra.run.smithi181.stdout:(45/196): rbd-fuse-debuginfo-19.0.0-1992.g1f941 2.6 MB/s | 516 kB 00:00 2024-04-01T22:26:47.947 INFO:teuthology.orchestra.run.smithi181.stdout:(46/196): rbd-mirror-19.0.0-1992.g1f941761.el9. 3.9 MB/s | 3.1 MB 00:00 2024-04-01T22:26:49.580 INFO:teuthology.orchestra.run.smithi181.stdout:(47/196): librbd1-debuginfo-19.0.0-1992.g1f9417 5.4 MB/s | 52 MB 00:09 2024-04-01T22:26:49.689 INFO:teuthology.orchestra.run.smithi181.stdout:(48/196): rbd-nbd-19.0.0-1992.g1f941761.el9.x86 1.5 MB/s | 170 kB 00:00 2024-04-01T22:26:49.931 INFO:teuthology.orchestra.run.smithi181.stdout:(49/196): rbd-nbd-debuginfo-19.0.0-1992.g1f9417 5.3 MB/s | 1.3 MB 00:00 2024-04-01T22:26:50.006 INFO:teuthology.orchestra.run.smithi181.stdout:(50/196): ceph-grafana-dashboards-19.0.0-1992.g 420 kB/s | 31 kB 00:00 2024-04-01T22:26:50.073 INFO:teuthology.orchestra.run.smithi181.stdout:(51/196): ceph-mgr-cephadm-19.0.0-1992.g1f94176 2.0 MB/s | 139 kB 00:00 2024-04-01T22:26:50.632 INFO:teuthology.orchestra.run.smithi181.stdout:(52/196): ceph-mgr-dashboard-19.0.0-1992.g1f941 6.3 MB/s | 3.5 MB 00:00 2024-04-01T22:26:52.024 INFO:teuthology.orchestra.run.smithi181.stdout:(53/196): ceph-mgr-diskprediction-local-19.0.0- 5.3 MB/s | 7.4 MB 00:01 2024-04-01T22:26:52.132 INFO:teuthology.orchestra.run.smithi181.stdout:(54/196): ceph-mgr-modules-core-19.0.0-1992.g1f 2.2 MB/s | 248 kB 00:00 2024-04-01T22:26:52.199 INFO:teuthology.orchestra.run.smithi181.stdout:(55/196): ceph-mgr-rook-19.0.0-1992.g1f941761.e 741 kB/s | 49 kB 00:00 2024-04-01T22:26:52.258 INFO:teuthology.orchestra.run.smithi181.stdout:(56/196): ceph-prometheus-alerts-19.0.0-1992.g1 262 kB/s | 15 kB 00:00 2024-04-01T22:26:52.366 INFO:teuthology.orchestra.run.smithi181.stdout:(57/196): ceph-volume-19.0.0-1992.g1f941761.el9 2.4 MB/s | 264 kB 00:00 2024-04-01T22:26:52.525 INFO:teuthology.orchestra.run.smithi181.stdout:(58/196): cephadm-19.0.0-1992.g1f941761.el9.noa 4.6 MB/s | 749 kB 00:00 2024-04-01T22:26:52.642 INFO:teuthology.orchestra.run.smithi181.stdout:(59/196): cephfs-top-19.0.0-1992.g1f941761.el9. 156 kB/s | 18 kB 00:00 2024-04-01T22:26:52.809 INFO:teuthology.orchestra.run.smithi181.stdout:(60/196): automake-1.16.2-8.el9.noarch.rpm 3.9 MB/s | 662 kB 00:00 2024-04-01T22:26:52.859 INFO:teuthology.orchestra.run.smithi181.stdout:(61/196): bison-3.7.4-5.el9.x86_64.rpm 18 MB/s | 920 kB 00:00 2024-04-01T22:26:52.893 INFO:teuthology.orchestra.run.smithi181.stdout:(62/196): boost-program-options-1.75.0-8.el9.x8 3.1 MB/s | 106 kB 00:00 2024-04-01T22:26:52.961 INFO:teuthology.orchestra.run.smithi181.stdout:(63/196): flex-2.6.4-9.el9.x86_64.rpm 4.4 MB/s | 307 kB 00:00 2024-04-01T22:26:52.994 INFO:teuthology.orchestra.run.smithi181.stdout:(64/196): flexiblas-3.0.4-8.el9.x86_64.rpm 988 kB/s | 32 kB 00:00 2024-04-01T22:26:53.086 INFO:teuthology.orchestra.run.smithi181.stdout:(65/196): flexiblas-netlib-3.0.4-8.el9.x86_64.r 33 MB/s | 3.0 MB 00:00 2024-04-01T22:26:53.111 INFO:teuthology.orchestra.run.smithi181.stdout:(66/196): flexiblas-openblas-openmp-3.0.4-8.el9 688 kB/s | 17 kB 00:00 2024-04-01T22:26:53.136 INFO:teuthology.orchestra.run.smithi181.stdout:(67/196): libaio-devel-0.3.111-13.el9.x86_64.rp 400 kB/s | 10 kB 00:00 2024-04-01T22:26:53.178 INFO:teuthology.orchestra.run.smithi181.stdout:(68/196): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 159 kB 00:00 2024-04-01T22:26:53.220 INFO:teuthology.orchestra.run.smithi181.stdout:(69/196): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2024-04-01T22:26:53.279 INFO:teuthology.orchestra.run.smithi181.stdout:(70/196): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2024-04-01T22:26:53.321 INFO:teuthology.orchestra.run.smithi181.stdout:(71/196): libtool-2.4.6-45.el9.x86_64.rpm 14 MB/s | 578 kB 00:00 2024-04-01T22:26:53.354 INFO:teuthology.orchestra.run.smithi181.stdout:(72/196): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 46 kB 00:00 2024-04-01T22:26:53.405 INFO:teuthology.orchestra.run.smithi181.stdout:(73/196): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2024-04-01T22:26:53.438 INFO:teuthology.orchestra.run.smithi181.stdout:(74/196): lua-5.4.4-4.el9.x86_64.rpm 5.4 MB/s | 187 kB 00:00 2024-04-01T22:26:53.489 INFO:teuthology.orchestra.run.smithi181.stdout:(75/196): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.2 MB/s | 217 kB 00:00 2024-04-01T22:26:53.523 INFO:teuthology.orchestra.run.smithi181.stdout:(76/196): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2024-04-01T22:26:53.648 INFO:teuthology.orchestra.run.smithi181.stdout:(77/196): openblas-openmp-0.3.21-2.el9.x86_64.r 38 MB/s | 4.7 MB 00:00 2024-04-01T22:26:53.715 INFO:teuthology.orchestra.run.smithi181.stdout:(78/196): postgresql-13.14-1.el9.x86_64.rpm 23 MB/s | 1.5 MB 00:00 2024-04-01T22:26:53.774 INFO:teuthology.orchestra.run.smithi181.stdout:(79/196): postgresql-contrib-13.14-1.el9.x86_64 14 MB/s | 817 kB 00:00 2024-04-01T22:26:53.816 INFO:teuthology.orchestra.run.smithi181.stdout:(80/196): postgresql-private-libs-13.14-1.el9.x 3.1 MB/s | 132 kB 00:00 2024-04-01T22:26:53.958 INFO:teuthology.orchestra.run.smithi181.stdout:(81/196): postgresql-server-13.14-1.el9.x86_64. 40 MB/s | 5.7 MB 00:00 2024-04-01T22:26:54.016 INFO:teuthology.orchestra.run.smithi181.stdout:(82/196): protobuf-3.14.0-13.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2024-04-01T22:26:54.050 INFO:teuthology.orchestra.run.smithi181.stdout:(83/196): python3-attrs-20.3.0-7.el9.noarch.rpm 2.3 MB/s | 78 kB 00:00 2024-04-01T22:26:54.184 INFO:teuthology.orchestra.run.smithi181.stdout:(84/196): python3-babel-2.9.1-2.el9.noarch.rpm 43 MB/s | 5.8 MB 00:00 2024-04-01T22:26:54.209 INFO:teuthology.orchestra.run.smithi181.stdout:(85/196): python3-jsonpatch-1.21-16.el9.noarch. 987 kB/s | 24 kB 00:00 2024-04-01T22:26:54.234 INFO:teuthology.orchestra.run.smithi181.stdout:(86/196): python3-jsonpointer-2.0-4.el9.noarch. 720 kB/s | 18 kB 00:00 2024-04-01T22:26:54.276 INFO:teuthology.orchestra.run.smithi181.stdout:(87/196): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 144 kB 00:00 2024-04-01T22:26:54.302 INFO:teuthology.orchestra.run.smithi181.stdout:(88/196): python3-markupsafe-1.1.1-12.el9.x86_6 1.2 MB/s | 32 kB 00:00 2024-04-01T22:26:54.419 INFO:teuthology.orchestra.run.smithi181.stdout:(89/196): python3-numpy-1.20.1-5.el9.x86_64.rpm 41 MB/s | 4.8 MB 00:00 2024-04-01T22:26:54.469 INFO:teuthology.orchestra.run.smithi181.stdout:(90/196): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.3 MB/s | 217 kB 00:00 2024-04-01T22:26:54.502 INFO:teuthology.orchestra.run.smithi181.stdout:(91/196): python3-oauthlib-3.1.1-5.el9.noarch.r 5.2 MB/s | 174 kB 00:00 2024-04-01T22:26:54.536 INFO:teuthology.orchestra.run.smithi181.stdout:(92/196): python3-packaging-20.9-5.el9.noarch.r 2.0 MB/s | 69 kB 00:00 2024-04-01T22:26:54.561 INFO:teuthology.orchestra.run.smithi181.stdout:(93/196): python3-prettytable-0.7.2-27.el9.noar 1.6 MB/s | 41 kB 00:00 2024-04-01T22:26:54.612 INFO:teuthology.orchestra.run.smithi181.stdout:(94/196): python3-protobuf-3.14.0-13.el9.noarch 4.6 MB/s | 238 kB 00:00 2024-04-01T22:26:54.645 INFO:teuthology.orchestra.run.smithi181.stdout:(95/196): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.9 MB/s | 132 kB 00:00 2024-04-01T22:26:54.679 INFO:teuthology.orchestra.run.smithi181.stdout:(96/196): python3-pyasn1-modules-0.4.8-6.el9.no 6.1 MB/s | 211 kB 00:00 2024-04-01T22:26:54.713 INFO:teuthology.orchestra.run.smithi181.stdout:(97/196): python3-pytz-2021.1-5.el9.noarch.rpm 1.4 MB/s | 47 kB 00:00 2024-04-01T22:26:54.746 INFO:teuthology.orchestra.run.smithi181.stdout:(98/196): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 43 kB 00:00 2024-04-01T22:26:55.063 INFO:teuthology.orchestra.run.smithi181.stdout:(99/196): python3-scipy-1.6.2-8.el9.x86_64.rpm 49 MB/s | 16 MB 00:00 2024-04-01T22:26:55.097 INFO:teuthology.orchestra.run.smithi181.stdout:(100/196): python3-toml-0.10.2-6.el9.noarch.rpm 1.1 MB/s | 39 kB 00:00 2024-04-01T22:26:55.131 INFO:teuthology.orchestra.run.smithi181.stdout:(101/196): python3-wcwidth-0.2.5-8.el9.noarch.r 1.2 MB/s | 41 kB 00:00 2024-04-01T22:26:55.173 INFO:teuthology.orchestra.run.smithi181.stdout:(102/196): qatlib-24.02.0-1.el9.x86_64.rpm 5.1 MB/s | 220 kB 00:00 2024-04-01T22:26:55.206 INFO:teuthology.orchestra.run.smithi181.stdout:(103/196): qatlib-service-24.02.0-1.el9.x86_64. 1.0 MB/s | 35 kB 00:00 2024-04-01T22:26:55.240 INFO:teuthology.orchestra.run.smithi181.stdout:(104/196): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 46 kB 00:00 2024-04-01T22:26:55.282 INFO:teuthology.orchestra.run.smithi181.stdout:(105/196): socat-1.7.4.1-5.el9.x86_64.rpm 7.1 MB/s | 300 kB 00:00 2024-04-01T22:26:55.316 INFO:teuthology.orchestra.run.smithi181.stdout:(106/196): uuid-1.6.2-55.el9.x86_64.rpm 1.6 MB/s | 56 kB 00:00 2024-04-01T22:26:55.349 INFO:teuthology.orchestra.run.smithi181.stdout:(107/196): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 63 kB 00:00 2024-04-01T22:26:55.391 INFO:teuthology.orchestra.run.smithi181.stdout:(108/196): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2024-04-01T22:26:55.425 INFO:teuthology.orchestra.run.smithi181.stdout:(109/196): fuse-2.9.9-15.el9.x86_64.rpm 2.3 MB/s | 79 kB 00:00 2024-04-01T22:26:55.467 INFO:teuthology.orchestra.run.smithi181.stdout:(110/196): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.7 MB/s | 241 kB 00:00 2024-04-01T22:26:55.526 INFO:teuthology.orchestra.run.smithi181.stdout:(111/196): python3-cryptography-36.0.1-4.el9.x8 20 MB/s | 1.1 MB 00:00 2024-04-01T22:26:55.559 INFO:teuthology.orchestra.run.smithi181.stdout:(112/196): python3-ply-3.11-14.el9.noarch.rpm 3.0 MB/s | 103 kB 00:00 2024-04-01T22:26:55.601 INFO:teuthology.orchestra.run.smithi181.stdout:(113/196): python3-pycparser-2.20-6.el9.noarch. 2.9 MB/s | 124 kB 00:00 2024-04-01T22:26:55.635 INFO:teuthology.orchestra.run.smithi181.stdout:(114/196): python3-urllib3-1.26.5-5.el9.noarch. 5.5 MB/s | 187 kB 00:00 2024-04-01T22:26:56.469 INFO:teuthology.orchestra.run.smithi181.stdout:(115/196): jq-1.6-16.el9.x86_64.rpm 225 kB/s | 187 kB 00:00 2024-04-01T22:26:58.519 INFO:teuthology.orchestra.run.smithi181.stdout:(116/196): rbd-mirror-debuginfo-19.0.0-1992.g1f 4.9 MB/s | 52 MB 00:10 2024-04-01T22:26:58.561 INFO:teuthology.orchestra.run.smithi181.stdout:(117/196): libgfortran-11.4.1-3.el9.x86_64.rpm 384 kB/s | 803 kB 00:02 2024-04-01T22:26:59.319 INFO:teuthology.orchestra.run.smithi181.stdout:(118/196): python3-requests-2.25.1-8.el9.noarch 165 kB/s | 125 kB 00:00 2024-04-01T22:26:59.370 INFO:teuthology.orchestra.run.smithi181.stdout:(119/196): libquadmath-11.4.1-3.el9.x86_64.rpm 230 kB/s | 195 kB 00:00 2024-04-01T22:26:59.420 INFO:teuthology.orchestra.run.smithi181.stdout:(120/196): elfutils-libelf-devel-0.190-2.el9.x8 215 kB/s | 21 kB 00:00 2024-04-01T22:26:59.437 INFO:teuthology.orchestra.run.smithi181.stdout:(121/196): libuuid-devel-2.37.4-18.el9.x86_64.r 381 kB/s | 25 kB 00:00 2024-04-01T22:26:59.537 INFO:teuthology.orchestra.run.smithi181.stdout:(122/196): python3-devel-3.9.17-2.el9.x86_64.rp 2.4 MB/s | 245 kB 00:00 2024-04-01T22:26:59.588 INFO:teuthology.orchestra.run.smithi181.stdout:(123/196): python3-jinja2-2.11.3-5.el9.noarch.r 4.8 MB/s | 248 kB 00:00 2024-04-01T22:26:59.655 INFO:teuthology.orchestra.run.smithi181.stdout:(124/196): openssl-devel-3.0.7-27.el9.x86_64.rp 18 MB/s | 4.1 MB 00:00 2024-04-01T22:26:59.680 INFO:teuthology.orchestra.run.smithi181.stdout:(125/196): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.0 MB/s | 94 kB 00:00 2024-04-01T22:27:00.222 INFO:teuthology.orchestra.run.smithi181.stdout:(126/196): lua-devel-5.4.4-4.el9.x86_64.rpm 39 kB/s | 22 kB 00:00 2024-04-01T22:27:00.397 INFO:teuthology.orchestra.run.smithi181.stdout:(127/196): abseil-cpp-20211102.0-3.el9.x86_64.r 3.1 MB/s | 548 kB 00:00 2024-04-01T22:27:00.464 INFO:teuthology.orchestra.run.smithi181.stdout:(128/196): gperftools-libs-2.9.1-2.el9.x86_64.r 4.5 MB/s | 309 kB 00:00 2024-04-01T22:27:00.506 INFO:teuthology.orchestra.run.smithi181.stdout:(129/196): grpc-data-1.46.7-10.el9.noarch.rpm 468 kB/s | 19 kB 00:00 2024-04-01T22:27:00.840 INFO:teuthology.orchestra.run.smithi181.stdout:(130/196): libarrow-9.0.0-10.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-04-01T22:27:00.881 INFO:teuthology.orchestra.run.smithi181.stdout:(131/196): libarrow-doc-9.0.0-10.el9.noarch.rpm 625 kB/s | 26 kB 00:00 2024-04-01T22:27:00.924 INFO:teuthology.orchestra.run.smithi181.stdout:(132/196): liboath-2.6.7-2.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2024-04-01T22:27:00.965 INFO:teuthology.orchestra.run.smithi181.stdout:(133/196): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-04-01T22:27:01.007 INFO:teuthology.orchestra.run.smithi181.stdout:(134/196): luarocks-3.9.2-1.el9.noarch.rpm 3.5 MB/s | 151 kB 00:00 2024-04-01T22:27:01.075 INFO:teuthology.orchestra.run.smithi181.stdout:(135/196): parquet-libs-9.0.0-10.el9.x86_64.rpm 12 MB/s | 838 kB 00:00 2024-04-01T22:27:01.141 INFO:teuthology.orchestra.run.smithi181.stdout:(136/196): python3-asyncssh-2.13.2-5.el9.noarch 8.0 MB/s | 548 kB 00:00 2024-04-01T22:27:01.183 INFO:teuthology.orchestra.run.smithi181.stdout:(137/196): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.0 MB/s | 43 kB 00:00 2024-04-01T22:27:01.225 INFO:teuthology.orchestra.run.smithi181.stdout:(138/196): python3-cachetools-4.2.4-1.el9.noarc 770 kB/s | 32 kB 00:00 2024-04-01T22:27:01.267 INFO:teuthology.orchestra.run.smithi181.stdout:(139/196): python3-certifi-2021.10.8-2.el9.noar 360 kB/s | 15 kB 00:00 2024-04-01T22:27:01.318 INFO:teuthology.orchestra.run.smithi181.stdout:(140/196): protobuf-compiler-3.14.0-13.el9.x86_ 527 kB/s | 863 kB 00:01 2024-04-01T22:27:01.351 INFO:teuthology.orchestra.run.smithi181.stdout:(141/196): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-04-01T22:27:01.402 INFO:teuthology.orchestra.run.smithi181.stdout:(142/196): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-04-01T22:27:01.443 INFO:teuthology.orchestra.run.smithi181.stdout:(143/196): python3-colorama-0.4.4-12.el9.noarch 851 kB/s | 35 kB 00:00 2024-04-01T22:27:01.485 INFO:teuthology.orchestra.run.smithi181.stdout:(144/196): python3-google-auth-2.28.2-1.el9.noa 4.7 MB/s | 203 kB 00:00 2024-04-01T22:27:01.544 INFO:teuthology.orchestra.run.smithi181.stdout:(145/196): python3-cherrypy-18.6.1-2.el9.noarch 1.6 MB/s | 358 kB 00:00 2024-04-01T22:27:01.595 INFO:teuthology.orchestra.run.smithi181.stdout:(146/196): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-04-01T22:27:01.636 INFO:teuthology.orchestra.run.smithi181.stdout:(147/196): python3-jaraco-8.2.1-3.el9.noarch.rp 258 kB/s | 11 kB 00:00 2024-04-01T22:27:01.695 INFO:teuthology.orchestra.run.smithi181.stdout:(148/196): python3-grpcio-1.46.7-10.el9.x86_64. 9.7 MB/s | 2.0 MB 00:00 2024-04-01T22:27:01.720 INFO:teuthology.orchestra.run.smithi181.stdout:(149/196): python3-jaraco-classes-3.2.1-5.el9.n 211 kB/s | 18 kB 00:00 2024-04-01T22:27:01.746 INFO:teuthology.orchestra.run.smithi181.stdout:(150/196): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-04-01T22:27:01.771 INFO:teuthology.orchestra.run.smithi181.stdout:(151/196): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-04-01T22:27:01.796 INFO:teuthology.orchestra.run.smithi181.stdout:(152/196): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-04-01T22:27:01.839 INFO:teuthology.orchestra.run.smithi181.stdout:(153/196): python3-logutils-0.3.5-21.el9.noarch 1.1 MB/s | 46 kB 00:00 2024-04-01T22:27:01.881 INFO:teuthology.orchestra.run.smithi181.stdout:(154/196): python3-more-itertools-8.12.0-2.el9. 1.8 MB/s | 79 kB 00:00 2024-04-01T22:27:01.914 INFO:teuthology.orchestra.run.smithi181.stdout:(155/196): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-04-01T22:27:01.931 INFO:teuthology.orchestra.run.smithi181.stdout:(156/196): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-04-01T22:27:01.965 INFO:teuthology.orchestra.run.smithi181.stdout:(157/196): python3-portend-3.1.0-2.el9.noarch.r 490 kB/s | 16 kB 00:00 2024-04-01T22:27:01.990 INFO:teuthology.orchestra.run.smithi181.stdout:(158/196): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-04-01T22:27:02.016 INFO:teuthology.orchestra.run.smithi181.stdout:(159/196): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-04-01T22:27:02.041 INFO:teuthology.orchestra.run.smithi181.stdout:(160/196): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-04-01T22:27:02.066 INFO:teuthology.orchestra.run.smithi181.stdout:(161/196): python3-repoze-lru-0.7-16.el9.noarch 615 kB/s | 31 kB 00:00 2024-04-01T22:27:02.091 INFO:teuthology.orchestra.run.smithi181.stdout:(162/196): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-04-01T22:27:02.125 INFO:teuthology.orchestra.run.smithi181.stdout:(163/196): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-04-01T22:27:02.150 INFO:teuthology.orchestra.run.smithi181.stdout:(164/196): python3-tempora-5.0.0-2.el9.noarch.r 613 kB/s | 36 kB 00:00 2024-04-01T22:27:02.176 INFO:teuthology.orchestra.run.smithi181.stdout:(165/196): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-04-01T22:27:02.232 INFO:teuthology.orchestra.run.smithi181.stdout:(166/196): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-04-01T22:27:02.260 INFO:teuthology.orchestra.run.smithi181.stdout:(167/196): python3-websocket-client-1.2.3-2.el9 1.0 MB/s | 90 kB 00:00 2024-04-01T22:27:02.310 INFO:teuthology.orchestra.run.smithi181.stdout:(168/196): python3-werkzeug-2.0.3-3.el9.1.noarc 5.4 MB/s | 427 kB 00:00 2024-04-01T22:27:02.361 INFO:teuthology.orchestra.run.smithi181.stdout:(169/196): python3-zc-lockfile-2.0-10.el9.noarc 199 kB/s | 20 kB 00:00 2024-04-01T22:27:02.386 INFO:teuthology.orchestra.run.smithi181.stdout:(170/196): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-04-01T22:27:02.636 INFO:teuthology.orchestra.run.smithi181.stdout:(171/196): thrift-0.15.0-2.el9.x86_64.rpm 5.7 MB/s | 1.6 MB 00:00 2024-04-01T22:27:03.045 INFO:teuthology.orchestra.run.smithi181.stdout:(172/196): librados2-19.0.0-1992.g1f941761.el9. 5.1 MB/s | 3.4 MB 00:00 2024-04-01T22:27:03.120 INFO:teuthology.orchestra.run.smithi181.stdout:(173/196): NetworkManager-1.47.2-1.el9.x86_64.r 31 MB/s | 2.3 MB 00:00 2024-04-01T22:27:03.195 INFO:teuthology.orchestra.run.smithi181.stdout:(174/196): NetworkManager-libnm-1.47.2-1.el9.x8 24 MB/s | 1.8 MB 00:00 2024-04-01T22:27:03.228 INFO:teuthology.orchestra.run.smithi181.stdout:(175/196): NetworkManager-team-1.47.2-1.el9.x86 1.2 MB/s | 41 kB 00:00 2024-04-01T22:27:03.271 INFO:teuthology.orchestra.run.smithi181.stdout:(176/196): NetworkManager-tui-1.47.2-1.el9.x86_ 5.8 MB/s | 247 kB 00:00 2024-04-01T22:27:03.313 INFO:teuthology.orchestra.run.smithi181.stdout:(177/196): xfsdump-3.1.12-4.el9.x86_64.rpm 7.6 MB/s | 321 kB 00:00 2024-04-01T22:27:03.522 INFO:teuthology.orchestra.run.smithi181.stdout:(178/196): librbd1-19.0.0-1992.g1f941761.el9.x8 3.5 MB/s | 3.1 MB 00:00 2024-04-01T22:27:03.615 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-04-01T22:27:03.996 INFO:teuthology.orchestra.run.smithi181.stdout:(179/196): acl-2.3.1-4.el9.x86_64.rpm 104 kB/s | 71 kB 00:00 2024-04-01T22:27:04.147 INFO:teuthology.orchestra.run.smithi181.stdout:(180/196): elfutils-debuginfod-client-0.190-2.e 58 kB/s | 36 kB 00:00 2024-04-01T22:27:04.847 INFO:teuthology.orchestra.run.smithi181.stdout:(181/196): elfutils-libelf-0.190-2.el9.x86_64.r 226 kB/s | 192 kB 00:00 2024-04-01T22:27:05.122 INFO:teuthology.orchestra.run.smithi181.stdout:(182/196): elfutils-libs-0.190-2.el9.x86_64.rpm 262 kB/s | 256 kB 00:00 2024-04-01T22:27:05.439 INFO:teuthology.orchestra.run.smithi181.stdout:(183/196): libacl-2.3.1-4.el9.x86_64.rpm 39 kB/s | 23 kB 00:00 2024-04-01T22:27:05.857 INFO:teuthology.orchestra.run.smithi181.stdout:(184/196): libblkid-2.37.4-18.el9.x86_64.rpm 148 kB/s | 108 kB 00:00 2024-04-01T22:27:06.248 INFO:teuthology.orchestra.run.smithi181.stdout:(185/196): libfdisk-2.37.4-18.el9.x86_64.rpm 192 kB/s | 155 kB 00:00 2024-04-01T22:27:06.345 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/220 2024-04-01T22:27:06.371 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_6 2/220 2024-04-01T22:27:06.423 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 3/220 2024-04-01T22:27:06.486 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 4/220 2024-04-01T22:27:06.494 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 4/220 2024-04-01T22:27:06.541 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/220 2024-04-01T22:27:06.601 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/220 2024-04-01T22:27:06.615 INFO:teuthology.orchestra.run.smithi181.stdout:(186/196): libmount-2.37.4-18.el9.x86_64.rpm 179 kB/s | 136 kB 00:00 2024-04-01T22:27:06.641 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : thrift-0.15.0-2.el9.x86_64 7/220 2024-04-01T22:27:06.675 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 8/220 2024-04-01T22:27:06.725 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/220 2024-04-01T22:27:06.907 INFO:teuthology.orchestra.run.smithi181.stdout:(187/196): libsmartcols-2.37.4-18.el9.x86_64.rp 97 kB/s | 64 kB 00:00 2024-04-01T22:27:07.061 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 10/220 2024-04-01T22:27:07.126 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : librados2-2:19.0.0-1992.g1f941761.el9.x86_64 11/220 2024-04-01T22:27:07.182 INFO:teuthology.orchestra.run.smithi181.stdout:(188/196): libuuid-2.37.4-18.el9.x86_64.rpm 51 kB/s | 29 kB 00:00 2024-04-01T22:27:07.249 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librados2-2:19.0.0-1992.g1f941761.el9.x86_64 11/220 2024-04-01T22:27:07.278 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephfs2-2:19.0.0-1992.g1f941761.el9.x86_64 12/220 2024-04-01T22:27:07.360 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libcephfs2-2:19.0.0-1992.g1f941761.el9.x86_64 12/220 2024-04-01T22:27:07.390 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rados-2:19.0.0-1992.g1f941761.el9.x86_64 13/220 2024-04-01T22:27:07.435 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 14/220 2024-04-01T22:27:07.627 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 15/220 2024-04-01T22:27:07.679 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : postgresql-13.14-1.el9.x86_64 16/220 2024-04-01T22:27:07.707 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephsqlite-2:19.0.0-1992.g1f941761.el9.x86_64 17/220 2024-04-01T22:27:07.812 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1992.g1f941761.el9.x86_64 17/220 2024-04-01T22:27:07.841 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libradosstriper1-2:19.0.0-1992.g1f941761.el9.x86 18/220 2024-04-01T22:27:07.906 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1992.g1f941761.el9.x86 18/220 2024-04-01T22:27:07.954 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 19/220 2024-04-01T22:27:07.976 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 20/220 2024-04-01T22:27:07.991 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 20/220 2024-04-01T22:27:08.160 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 21/220 2024-04-01T22:27:08.201 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 21/220 2024-04-01T22:27:08.230 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 22/220 2024-04-01T22:27:08.387 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 23/220 2024-04-01T22:27:08.508 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 24/220 2024-04-01T22:27:08.551 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 24/220 2024-04-01T22:27:08.650 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 25/220 2024-04-01T22:27:08.694 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 25/220 2024-04-01T22:27:08.894 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 25/220 2024-04-01T22:27:09.002 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : re2-1:20211101-3.el9.x86_64 26/220 2024-04-01T22:27:09.007 INFO:teuthology.orchestra.run.smithi181.stdout:(189/196): openssl-3.0.7-27.el9.x86_64.rpm 590 kB/s | 1.2 MB 00:02 2024-04-01T22:27:09.100 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 27/220 2024-04-01T22:27:09.133 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 28/220 2024-04-01T22:27:09.160 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : liboath-2.6.7-2.el9.x86_64 29/220 2024-04-01T22:27:09.195 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/220 2024-04-01T22:27:09.272 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/220 2024-04-01T22:27:09.332 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 32/220 2024-04-01T22:27:09.370 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 33/220 2024-04-01T22:27:09.445 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 34/220 2024-04-01T22:27:09.486 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 35/220 2024-04-01T22:27:09.530 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 36/220 2024-04-01T22:27:09.562 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 37/220 2024-04-01T22:27:09.589 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lua-5.4.4-4.el9.x86_64 38/220 2024-04-01T22:27:09.661 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 39/220 2024-04-01T22:27:09.694 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ceph-common-2:19.0.0-1992.g1f941761.el9. 40/220 2024-04-01T22:27:09.730 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ceph-argparse-2:19.0.0-1992.g1f941761.el 41/220 2024-04-01T22:27:09.758 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cephfs-2:19.0.0-1992.g1f941761.el9.x86_6 42/220 2024-04-01T22:27:09.832 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 43/220 2024-04-01T22:27:09.881 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : luarocks-3.9.2-1.el9.noarch 44/220 2024-04-01T22:27:09.957 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 45/220 2024-04-01T22:27:10.094 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 46/220 2024-04-01T22:27:10.143 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 47/220 2024-04-01T22:27:10.483 INFO:teuthology.orchestra.run.smithi181.stdout:(190/196): openssl-libs-3.0.7-27.el9.x86_64.rpm 669 kB/s | 2.2 MB 00:03 2024-04-01T22:27:10.697 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rsa-4.9-2.el9.noarch 48/220 2024-04-01T22:27:10.781 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 49/220 2024-04-01T22:27:10.881 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 50/220 2024-04-01T22:27:10.948 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 51/220 2024-04-01T22:27:10.958 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 51/220 2024-04-01T22:27:10.990 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 52/220 2024-04-01T22:27:11.046 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 53/220 2024-04-01T22:27:11.084 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librados-devel-2:19.0.0-1992.g1f941761.el9.x86_6 54/220 2024-04-01T22:27:11.115 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 55/220 2024-04-01T22:27:11.413 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 56/220 2024-04-01T22:27:11.615 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 57/220 2024-04-01T22:27:11.717 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 58/220 2024-04-01T22:27:11.762 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 59/220 2024-04-01T22:27:11.905 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 60/220 2024-04-01T22:27:11.955 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 61/220 2024-04-01T22:27:12.012 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/220 2024-04-01T22:27:12.087 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 63/220 2024-04-01T22:27:12.123 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 64/220 2024-04-01T22:27:12.159 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 65/220 2024-04-01T22:27:12.207 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/220 2024-04-01T22:27:12.242 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/220 2024-04-01T22:27:12.294 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/220 2024-04-01T22:27:12.336 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/220 2024-04-01T22:27:12.476 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 70/220 2024-04-01T22:27:12.516 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 71/220 2024-04-01T22:27:12.546 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 72/220 2024-04-01T22:27:12.588 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 73/220 2024-04-01T22:27:12.687 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 74/220 2024-04-01T22:27:12.729 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 75/220 2024-04-01T22:27:12.769 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 76/220 2024-04-01T22:27:12.794 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 77/220 2024-04-01T22:27:12.819 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 78/220 2024-04-01T22:27:12.900 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 79/220 2024-04-01T22:27:13.025 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 80/220 2024-04-01T22:27:13.132 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 81/220 2024-04-01T22:27:13.170 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 82/220 2024-04-01T22:27:13.228 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ply-3.11-14.el9.noarch 83/220 2024-04-01T22:27:13.292 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 84/220 2024-04-01T22:27:13.487 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 85/220 2024-04-01T22:27:13.540 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 86/220 2024-04-01T22:27:13.697 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/220 2024-04-01T22:27:13.738 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 88/220 2024-04-01T22:27:13.770 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 89/220 2024-04-01T22:27:13.801 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : fuse-2.9.9-15.el9.x86_64 90/220 2024-04-01T22:27:13.839 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 91/220 2024-04-01T22:27:13.881 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 92/220 2024-04-01T22:27:13.920 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : uuid-1.6.2-55.el9.x86_64 93/220 2024-04-01T22:27:13.952 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 94/220 2024-04-01T22:27:13.982 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 95/220 2024-04-01T22:27:14.062 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 96/220 2024-04-01T22:27:14.109 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 97/220 2024-04-01T22:27:14.142 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 98/220 2024-04-01T22:27:14.184 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 99/220 2024-04-01T22:27:14.218 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 100/220 2024-04-01T22:27:14.311 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 101/220 2024-04-01T22:27:14.409 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 102/220 2024-04-01T22:27:14.458 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 103/220 2024-04-01T22:27:14.489 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 104/220 2024-04-01T22:27:14.537 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 105/220 2024-04-01T22:27:14.645 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-packaging-20.9-5.el9.noarch 106/220 2024-04-01T22:27:14.700 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 107/220 2024-04-01T22:27:15.467 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 108/220 2024-04-01T22:27:15.512 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 109/220 2024-04-01T22:27:15.546 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 110/220 2024-04-01T22:27:15.582 INFO:teuthology.orchestra.run.smithi181.stdout:(191/196): ceph-test-debuginfo-19.0.0-1992.g1f9 10 MB/s | 675 MB 01:05 2024-04-01T22:27:15.596 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 111/220 2024-04-01T22:27:15.685 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 112/220 2024-04-01T22:27:15.722 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 113/220 2024-04-01T22:27:15.906 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openblas-0.3.21-2.el9.x86_64 114/220 2024-04-01T22:27:15.936 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 115/220 2024-04-01T22:27:16.017 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 116/220 2024-04-01T22:27:16.216 INFO:teuthology.orchestra.run.smithi181.stdout:(192/196): util-linux-user-2.37.4-18.el9.x86_64 49 kB/s | 31 kB 00:00 2024-04-01T22:27:16.308 INFO:teuthology.orchestra.run.smithi181.stdout:(193/196): util-linux-2.37.4-18.el9.x86_64.rpm 320 kB/s | 2.3 MB 00:07 2024-04-01T22:27:16.400 INFO:teuthology.orchestra.run.smithi181.stdout:(194/196): libacl-devel-2.3.1-4.el9.x86_64.rpm 816 kB/s | 74 kB 00:00 2024-04-01T22:27:16.533 INFO:teuthology.orchestra.run.smithi181.stdout:(195/196): util-linux-core-2.37.4-18.el9.x86_64 77 kB/s | 465 kB 00:06 2024-04-01T22:27:16.704 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 117/220 2024-04-01T22:27:16.820 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 118/220 2024-04-01T22:27:18.112 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 119/220 2024-04-01T22:27:18.187 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 120/220 2024-04-01T22:27:18.218 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 121/220 2024-04-01T22:27:18.249 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : jq-1.6-16.el9.x86_64 122/220 2024-04-01T22:27:18.277 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 123/220 2024-04-01T22:27:18.302 INFO:teuthology.orchestra.run.smithi181.stdout:(196/196): xfsprogs-6.3.0-1.el9.x86_64.rpm 528 kB/s | 1.1 MB 00:02 2024-04-01T22:27:18.305 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-04-01T22:27:18.305 INFO:teuthology.orchestra.run.smithi181.stdout:Total 13 MB/s | 2.2 GB 02:50 2024-04-01T22:27:18.604 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 124/220 2024-04-01T22:27:18.632 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : librbd1-2:19.0.0-1992.g1f941761.el9.x86_64 125/220 2024-04-01T22:27:18.658 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-04-01T22:27:18.706 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librbd1-2:19.0.0-1992.g1f941761.el9.x86_64 125/220 2024-04-01T22:27:18.737 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rbd-2:19.0.0-1992.g1f941761.el9.x86_64 126/220 2024-04-01T22:27:18.773 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 127/220 2024-04-01T22:27:18.940 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-04-01T22:27:18.940 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-04-01T22:27:19.251 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 128/220 2024-04-01T22:27:19.276 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librgw2-2:19.0.0-1992.g1f941761.el9.x86_64 129/220 2024-04-01T22:27:19.347 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librgw2-2:19.0.0-1992.g1f941761.el9.x86_64 129/220 2024-04-01T22:27:19.378 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rgw-2:19.0.0-1992.g1f941761.el9.x86_64 130/220 2024-04-01T22:27:21.650 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-common-2:19.0.0-1992.g1f941761.el9.x86_64 131/220 2024-04-01T22:27:21.691 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-common-2:19.0.0-1992.g1f941761.el9.x86_64 131/220 2024-04-01T22:27:22.258 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-common-2:19.0.0-1992.g1f941761.el9.x86_64 131/220 2024-04-01T22:27:22.294 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-base-2:19.0.0-1992.g1f941761.el9.x86_64 132/220 2024-04-01T22:27:22.385 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-base-2:19.0.0-1992.g1f941761.el9.x86_64 132/220 2024-04-01T22:27:22.385 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-01T22:27:22.386 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-01T22:27:22.386 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:27:22.420 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-selinux-2:19.0.0-1992.g1f941761.el9.x86_64 133/220 2024-04-01T22:27:32.827 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-04-01T22:27:32.828 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-04-01T22:27:35.032 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1992.g1f941761.el9.x86_64 133/220 2024-04-01T22:27:35.033 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /sys 2024-04-01T22:27:35.033 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /proc 2024-04-01T22:27:35.033 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /mnt 2024-04-01T22:27:35.033 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /var/tmp 2024-04-01T22:27:35.033 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /home 2024-04-01T22:27:35.033 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /root 2024-04-01T22:27:35.033 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /tmp 2024-04-01T22:27:35.033 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:27:35.199 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-volume-2:19.0.0-1992.g1f941761.el9.noarch 134/220 2024-04-01T22:27:35.214 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-volume-2:19.0.0-1992.g1f941761.el9.noarch 134/220 2024-04-01T22:27:35.214 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T22:27:35.214 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-01T22:27:35.214 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:27:36.754 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-osd-2:19.0.0-1992.g1f941761.el9.x86_64 135/220 2024-04-01T22:27:36.778 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-osd-2:19.0.0-1992.g1f941761.el9.x86_64 135/220 2024-04-01T22:27:36.779 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T22:27:36.779 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-01T22:27:36.779 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-01T22:27:36.779 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-01T22:27:36.779 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:27:37.013 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mds-2:19.0.0-1992.g1f941761.el9.x86_64 136/220 2024-04-01T22:27:37.034 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mds-2:19.0.0-1992.g1f941761.el9.x86_64 136/220 2024-04-01T22:27:37.034 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T22:27:37.034 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-01T22:27:37.035 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-01T22:27:37.035 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-01T22:27:37.035 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:27:37.505 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mon-2:19.0.0-1992.g1f941761.el9.x86_64 137/220 2024-04-01T22:27:37.527 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mon-2:19.0.0-1992.g1f941761.el9.x86_64 137/220 2024-04-01T22:27:37.527 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T22:27:37.527 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-01T22:27:37.527 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-01T22:27:37.527 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-01T22:27:37.527 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:27:37.623 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : automake-1.16.2-8.el9.noarch 138/220 2024-04-01T22:27:38.019 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: cephadm-2:19.0.0-1992.g1f941761.el9.noarch 139/220 2024-04-01T22:27:38.040 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephadm-2:19.0.0-1992.g1f941761.el9.noarch 139/220 2024-04-01T22:27:38.072 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1992.g1f941761.e 140/220 2024-04-01T22:27:38.135 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1992.g1f941761. 141/220 2024-04-01T22:27:38.163 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1992.g1f941761.el9.noa 142/220 2024-04-01T22:27:39.248 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1992.g1f941761.el9.noa 142/220 2024-04-01T22:27:39.282 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1992.g1f941761.el9.n 143/220 2024-04-01T22:27:40.295 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1992.g1f941761.el9.n 143/220 2024-04-01T22:27:40.324 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1992.g1f9 144/220 2024-04-01T22:27:40.429 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1992.g1f9 144/220 2024-04-01T22:27:40.595 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1992.g1f941761.el 145/220 2024-04-01T22:27:40.626 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-2:19.0.0-1992.g1f941761.el9.x86_64 146/220 2024-04-01T22:27:40.649 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1992.g1f941761.el9.x86_64 146/220 2024-04-01T22:27:40.649 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T22:27:40.649 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-01T22:27:40.649 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-01T22:27:40.649 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-01T22:27:40.649 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:27:40.694 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-rook-2:19.0.0-1992.g1f941761.el9.noarch 147/220 2024-04-01T22:27:40.704 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1992.g1f941761.el9.noarch 147/220 2024-04-01T22:27:40.755 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-2:19.0.0-1992.g1f941761.el9.x86_64 148/220 2024-04-01T22:27:41.654 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libtool-2.4.6-45.el9.x86_64 149/220 2024-04-01T22:27:41.687 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-radosgw-2:19.0.0-1992.g1f941761.el9.x86_64 150/220 2024-04-01T22:27:41.709 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1992.g1f941761.el9.x86_64 150/220 2024-04-01T22:27:41.709 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T22:27:41.709 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-01T22:27:41.709 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-01T22:27:41.709 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-01T22:27:41.709 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:27:41.755 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1992.g1f941 151/220 2024-04-01T22:27:41.776 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1992.g1f941 151/220 2024-04-01T22:27:41.776 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T22:27:41.776 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-01T22:27:41.776 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:27:41.822 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephfs-mirror-2:19.0.0-1992.g1f941761.el9.x86_64 152/220 2024-04-01T22:27:41.843 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1992.g1f941761.el9.x86_64 152/220 2024-04-01T22:27:41.844 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T22:27:41.844 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-01T22:27:41.844 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-01T22:27:41.844 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-01T22:27:41.844 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:27:42.156 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-mirror-2:19.0.0-1992.g1f941761.el9.x86_64 153/220 2024-04-01T22:27:42.177 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1992.g1f941761.el9.x86_64 153/220 2024-04-01T22:27:42.178 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T22:27:42.178 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-01T22:27:42.178 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-01T22:27:42.178 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-01T22:27:42.178 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:27:46.877 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-test-2:19.0.0-1992.g1f941761.el9.x86_64 154/220 2024-04-01T22:27:46.919 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-fuse-2:19.0.0-1992.g1f941761.el9.x86_64 155/220 2024-04-01T22:27:46.949 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-nbd-2:19.0.0-1992.g1f941761.el9.x86_64 156/220 2024-04-01T22:27:46.976 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 157/220 2024-04-01T22:27:47.175 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephfs-shell-2:19.0.0-1992.g1f941761.el9.x86_64 158/220 2024-04-01T22:27:47.296 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 159/220 2024-04-01T22:27:47.342 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-fuse-2:19.0.0-1992.g1f941761.el9.x86_64 160/220 2024-04-01T22:27:47.396 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 161/220 2024-04-01T22:27:47.449 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 162/220 2024-04-01T22:27:47.484 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 163/220 2024-04-01T22:27:47.509 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephfs-devel-2:19.0.0-1992.g1f941761.el9.x86_ 164/220 2024-04-01T22:27:47.540 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/220 2024-04-01T22:27:47.570 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 166/220 2024-04-01T22:27:47.631 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 167/220 2024-04-01T22:27:47.716 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 168/220 2024-04-01T22:27:47.743 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 169/220 2024-04-01T22:27:48.268 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 170/220 2024-04-01T22:27:48.308 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 170/220 2024-04-01T22:27:48.327 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 170/220 2024-04-01T22:27:52.076 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-04-01T22:27:54.647 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/220 2024-04-01T22:27:54.684 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_6 2/220 2024-04-01T22:27:54.719 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 3/220 2024-04-01T22:27:54.757 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 4/220 2024-04-01T22:27:54.767 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 4/220 2024-04-01T22:27:54.809 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/220 2024-04-01T22:27:54.863 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/220 2024-04-01T22:27:54.896 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : thrift-0.15.0-2.el9.x86_64 7/220 2024-04-01T22:27:54.922 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 8/220 2024-04-01T22:27:54.970 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/220 2024-04-01T22:27:55.291 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 10/220 2024-04-01T22:27:55.357 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : librados2-2:19.0.0-1992.g1f941761.el9.x86_64 11/220 2024-04-01T22:27:55.461 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librados2-2:19.0.0-1992.g1f941761.el9.x86_64 11/220 2024-04-01T22:27:55.491 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephfs2-2:19.0.0-1992.g1f941761.el9.x86_64 12/220 2024-04-01T22:27:55.591 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libcephfs2-2:19.0.0-1992.g1f941761.el9.x86_64 12/220 2024-04-01T22:27:55.620 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rados-2:19.0.0-1992.g1f941761.el9.x86_64 13/220 2024-04-01T22:27:55.662 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 14/220 2024-04-01T22:27:55.839 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephfs-top-2:19.0.0-1992.g1f941761.el9.noarch 171/220 2024-04-01T22:27:55.846 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 15/220 2024-04-01T22:27:55.887 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-13.14-1.el9.x86_64 16/220 2024-04-01T22:27:55.915 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephsqlite-2:19.0.0-1992.g1f941761.el9.x86_64 17/220 2024-04-01T22:27:56.002 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1992.g1f941761.el9.x86_64 17/220 2024-04-01T22:27:56.025 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libradosstriper1-2:19.0.0-1992.g1f941761.el9.x86 18/220 2024-04-01T22:27:56.073 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1992.g1f941761.el9.x86 18/220 2024-04-01T22:27:56.112 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 19/220 2024-04-01T22:27:56.134 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 20/220 2024-04-01T22:27:56.149 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 20/220 2024-04-01T22:27:56.335 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 21/220 2024-04-01T22:27:56.375 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 21/220 2024-04-01T22:27:56.405 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 22/220 2024-04-01T22:27:56.624 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 23/220 2024-04-01T22:27:56.716 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 24/220 2024-04-01T22:27:56.785 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 24/220 2024-04-01T22:27:56.874 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 25/220 2024-04-01T22:27:56.936 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 25/220 2024-04-01T22:27:57.144 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 25/220 2024-04-01T22:27:57.253 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : re2-1:20211101-3.el9.x86_64 26/220 2024-04-01T22:27:57.345 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 27/220 2024-04-01T22:27:57.383 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 28/220 2024-04-01T22:27:57.410 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : liboath-2.6.7-2.el9.x86_64 29/220 2024-04-01T22:27:57.445 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/220 2024-04-01T22:27:57.519 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/220 2024-04-01T22:27:57.573 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 32/220 2024-04-01T22:27:57.611 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 33/220 2024-04-01T22:27:57.675 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 34/220 2024-04-01T22:27:57.711 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 35/220 2024-04-01T22:27:57.754 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 36/220 2024-04-01T22:27:57.787 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 37/220 2024-04-01T22:27:57.814 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lua-5.4.4-4.el9.x86_64 38/220 2024-04-01T22:27:57.883 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 39/220 2024-04-01T22:27:57.919 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ceph-common-2:19.0.0-1992.g1f941761.el9. 40/220 2024-04-01T22:27:57.963 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ceph-argparse-2:19.0.0-1992.g1f941761.el 41/220 2024-04-01T22:27:58.000 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cephfs-2:19.0.0-1992.g1f941761.el9.x86_6 42/220 2024-04-01T22:27:58.068 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 43/220 2024-04-01T22:27:58.114 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : luarocks-3.9.2-1.el9.noarch 44/220 2024-04-01T22:27:58.215 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 45/220 2024-04-01T22:27:58.353 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 46/220 2024-04-01T22:27:58.408 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 47/220 2024-04-01T22:27:58.920 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rsa-4.9-2.el9.noarch 48/220 2024-04-01T22:27:59.004 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 49/220 2024-04-01T22:27:59.109 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 50/220 2024-04-01T22:27:59.157 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 51/220 2024-04-01T22:27:59.166 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 51/220 2024-04-01T22:27:59.198 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 52/220 2024-04-01T22:27:59.237 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 53/220 2024-04-01T22:27:59.276 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librados-devel-2:19.0.0-1992.g1f941761.el9.x86_6 54/220 2024-04-01T22:27:59.306 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 55/220 2024-04-01T22:27:59.587 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 56/220 2024-04-01T22:27:59.787 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 57/220 2024-04-01T22:27:59.858 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 58/220 2024-04-01T22:27:59.902 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 59/220 2024-04-01T22:28:00.053 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 60/220 2024-04-01T22:28:00.105 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 61/220 2024-04-01T22:28:00.160 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/220 2024-04-01T22:28:00.231 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 63/220 2024-04-01T22:28:00.264 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 64/220 2024-04-01T22:28:00.300 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 65/220 2024-04-01T22:28:00.339 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/220 2024-04-01T22:28:00.374 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/220 2024-04-01T22:28:00.417 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/220 2024-04-01T22:28:00.460 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/220 2024-04-01T22:28:00.593 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 70/220 2024-04-01T22:28:00.640 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 71/220 2024-04-01T22:28:00.671 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 72/220 2024-04-01T22:28:00.712 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 73/220 2024-04-01T22:28:00.806 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 74/220 2024-04-01T22:28:00.845 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 75/220 2024-04-01T22:28:00.888 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 76/220 2024-04-01T22:28:00.919 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 77/220 2024-04-01T22:28:00.944 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 78/220 2024-04-01T22:28:01.022 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 79/220 2024-04-01T22:28:01.143 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 80/220 2024-04-01T22:28:01.245 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 81/220 2024-04-01T22:28:01.316 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 82/220 2024-04-01T22:28:01.376 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ply-3.11-14.el9.noarch 83/220 2024-04-01T22:28:01.432 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 84/220 2024-04-01T22:28:01.614 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 85/220 2024-04-01T22:28:01.657 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 86/220 2024-04-01T22:28:01.791 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/220 2024-04-01T22:28:01.830 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 88/220 2024-04-01T22:28:01.861 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 89/220 2024-04-01T22:28:01.902 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : fuse-2.9.9-15.el9.x86_64 90/220 2024-04-01T22:28:01.930 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 91/220 2024-04-01T22:28:01.965 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 92/220 2024-04-01T22:28:02.003 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : uuid-1.6.2-55.el9.x86_64 93/220 2024-04-01T22:28:02.035 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 94/220 2024-04-01T22:28:02.065 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 95/220 2024-04-01T22:28:02.141 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 96/220 2024-04-01T22:28:02.175 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 97/220 2024-04-01T22:28:02.209 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 98/220 2024-04-01T22:28:02.250 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 99/220 2024-04-01T22:28:02.284 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 100/220 2024-04-01T22:28:02.372 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 101/220 2024-04-01T22:28:02.463 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 102/220 2024-04-01T22:28:02.507 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 103/220 2024-04-01T22:28:02.538 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 104/220 2024-04-01T22:28:02.577 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 105/220 2024-04-01T22:28:02.673 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-packaging-20.9-5.el9.noarch 106/220 2024-04-01T22:28:02.723 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 107/220 2024-04-01T22:28:03.449 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 108/220 2024-04-01T22:28:03.495 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 109/220 2024-04-01T22:28:03.529 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 110/220 2024-04-01T22:28:03.569 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 111/220 2024-04-01T22:28:03.656 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 112/220 2024-04-01T22:28:03.697 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 113/220 2024-04-01T22:28:03.873 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openblas-0.3.21-2.el9.x86_64 114/220 2024-04-01T22:28:03.904 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 115/220 2024-04-01T22:28:03.985 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 116/220 2024-04-01T22:28:04.614 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 117/220 2024-04-01T22:28:04.733 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 118/220 2024-04-01T22:28:05.943 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 119/220 2024-04-01T22:28:06.036 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 120/220 2024-04-01T22:28:06.068 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 121/220 2024-04-01T22:28:06.099 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : jq-1.6-16.el9.x86_64 122/220 2024-04-01T22:28:06.127 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 123/220 2024-04-01T22:28:06.442 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 124/220 2024-04-01T22:28:06.465 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : librbd1-2:19.0.0-1992.g1f941761.el9.x86_64 125/220 2024-04-01T22:28:06.539 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librbd1-2:19.0.0-1992.g1f941761.el9.x86_64 125/220 2024-04-01T22:28:06.570 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rbd-2:19.0.0-1992.g1f941761.el9.x86_64 126/220 2024-04-01T22:28:06.605 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 127/220 2024-04-01T22:28:07.050 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 128/220 2024-04-01T22:28:07.076 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librgw2-2:19.0.0-1992.g1f941761.el9.x86_64 129/220 2024-04-01T22:28:07.147 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librgw2-2:19.0.0-1992.g1f941761.el9.x86_64 129/220 2024-04-01T22:28:07.170 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rgw-2:19.0.0-1992.g1f941761.el9.x86_64 130/220 2024-04-01T22:28:09.446 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-common-2:19.0.0-1992.g1f941761.el9.x86_64 131/220 2024-04-01T22:28:09.482 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-common-2:19.0.0-1992.g1f941761.el9.x86_64 131/220 2024-04-01T22:28:10.019 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-common-2:19.0.0-1992.g1f941761.el9.x86_64 131/220 2024-04-01T22:28:10.069 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-base-2:19.0.0-1992.g1f941761.el9.x86_64 132/220 2024-04-01T22:28:10.162 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-base-2:19.0.0-1992.g1f941761.el9.x86_64 132/220 2024-04-01T22:28:10.163 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-01T22:28:10.163 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-01T22:28:10.163 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:28:10.195 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-selinux-2:19.0.0-1992.g1f941761.el9.x86_64 133/220 2024-04-01T22:28:22.734 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1992.g1f941761.el9.x86_64 133/220 2024-04-01T22:28:22.734 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /sys 2024-04-01T22:28:22.734 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /proc 2024-04-01T22:28:22.734 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /mnt 2024-04-01T22:28:22.735 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /var/tmp 2024-04-01T22:28:22.735 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /home 2024-04-01T22:28:22.735 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /root 2024-04-01T22:28:22.735 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /tmp 2024-04-01T22:28:22.735 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:28:22.900 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-volume-2:19.0.0-1992.g1f941761.el9.noarch 134/220 2024-04-01T22:28:22.914 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-volume-2:19.0.0-1992.g1f941761.el9.noarch 134/220 2024-04-01T22:28:22.915 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T22:28:22.915 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-01T22:28:22.915 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:28:24.411 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-osd-2:19.0.0-1992.g1f941761.el9.x86_64 135/220 2024-04-01T22:28:24.437 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-osd-2:19.0.0-1992.g1f941761.el9.x86_64 135/220 2024-04-01T22:28:24.437 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T22:28:24.437 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-01T22:28:24.437 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-01T22:28:24.437 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-01T22:28:24.437 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:28:24.654 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mds-2:19.0.0-1992.g1f941761.el9.x86_64 136/220 2024-04-01T22:28:24.683 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mds-2:19.0.0-1992.g1f941761.el9.x86_64 136/220 2024-04-01T22:28:24.683 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T22:28:24.683 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-01T22:28:24.683 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-01T22:28:24.683 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-01T22:28:24.683 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:28:25.121 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mon-2:19.0.0-1992.g1f941761.el9.x86_64 137/220 2024-04-01T22:28:25.145 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mon-2:19.0.0-1992.g1f941761.el9.x86_64 137/220 2024-04-01T22:28:25.145 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T22:28:25.145 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-01T22:28:25.145 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-01T22:28:25.145 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-01T22:28:25.145 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:28:25.231 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : automake-1.16.2-8.el9.noarch 138/220 2024-04-01T22:28:25.574 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: cephadm-2:19.0.0-1992.g1f941761.el9.noarch 139/220 2024-04-01T22:28:25.609 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephadm-2:19.0.0-1992.g1f941761.el9.noarch 139/220 2024-04-01T22:28:25.619 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1992.g1f941761.e 140/220 2024-04-01T22:28:25.672 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1992.g1f941761. 141/220 2024-04-01T22:28:25.703 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1992.g1f941761.el9.noa 142/220 2024-04-01T22:28:26.738 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1992.g1f941761.el9.noa 142/220 2024-04-01T22:28:26.771 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1992.g1f941761.el9.n 143/220 2024-04-01T22:28:27.729 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1992.g1f941761.el9.n 143/220 2024-04-01T22:28:27.763 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1992.g1f9 144/220 2024-04-01T22:28:27.862 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1992.g1f9 144/220 2024-04-01T22:28:28.017 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1992.g1f941761.el 145/220 2024-04-01T22:28:28.040 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-2:19.0.0-1992.g1f941761.el9.x86_64 146/220 2024-04-01T22:28:28.063 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1992.g1f941761.el9.x86_64 146/220 2024-04-01T22:28:28.063 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T22:28:28.063 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-01T22:28:28.064 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-01T22:28:28.064 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-01T22:28:28.064 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:28:28.108 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-rook-2:19.0.0-1992.g1f941761.el9.noarch 147/220 2024-04-01T22:28:28.118 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1992.g1f941761.el9.noarch 147/220 2024-04-01T22:28:28.158 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-2:19.0.0-1992.g1f941761.el9.x86_64 148/220 2024-04-01T22:28:29.023 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libtool-2.4.6-45.el9.x86_64 149/220 2024-04-01T22:28:29.053 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-radosgw-2:19.0.0-1992.g1f941761.el9.x86_64 150/220 2024-04-01T22:28:29.073 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1992.g1f941761.el9.x86_64 150/220 2024-04-01T22:28:29.074 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T22:28:29.074 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-01T22:28:29.074 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-01T22:28:29.074 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-01T22:28:29.074 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:28:29.135 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1992.g1f941 151/220 2024-04-01T22:28:29.157 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1992.g1f941 151/220 2024-04-01T22:28:29.157 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T22:28:29.157 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-01T22:28:29.157 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:28:29.211 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephfs-mirror-2:19.0.0-1992.g1f941761.el9.x86_64 152/220 2024-04-01T22:28:29.233 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1992.g1f941761.el9.x86_64 152/220 2024-04-01T22:28:29.233 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T22:28:29.233 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-01T22:28:29.234 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-01T22:28:29.234 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-01T22:28:29.234 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:28:29.537 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-mirror-2:19.0.0-1992.g1f941761.el9.x86_64 153/220 2024-04-01T22:28:29.559 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1992.g1f941761.el9.x86_64 153/220 2024-04-01T22:28:29.559 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-01T22:28:29.559 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-01T22:28:29.560 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-01T22:28:29.560 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-01T22:28:29.560 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:28:33.991 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-test-2:19.0.0-1992.g1f941761.el9.x86_64 154/220 2024-04-01T22:28:34.032 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-fuse-2:19.0.0-1992.g1f941761.el9.x86_64 155/220 2024-04-01T22:28:34.062 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-nbd-2:19.0.0-1992.g1f941761.el9.x86_64 156/220 2024-04-01T22:28:34.090 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 157/220 2024-04-01T22:28:34.272 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephfs-shell-2:19.0.0-1992.g1f941761.el9.x86_64 158/220 2024-04-01T22:28:34.380 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 159/220 2024-04-01T22:28:34.421 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-fuse-2:19.0.0-1992.g1f941761.el9.x86_64 160/220 2024-04-01T22:28:34.469 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 161/220 2024-04-01T22:28:34.529 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 162/220 2024-04-01T22:28:34.564 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 163/220 2024-04-01T22:28:34.589 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephfs-devel-2:19.0.0-1992.g1f941761.el9.x86_ 164/220 2024-04-01T22:28:34.629 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/220 2024-04-01T22:28:34.658 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 166/220 2024-04-01T22:28:34.714 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 167/220 2024-04-01T22:28:34.782 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 168/220 2024-04-01T22:28:34.817 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 169/220 2024-04-01T22:28:35.370 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 170/220 2024-04-01T22:28:35.424 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 170/220 2024-04-01T22:28:35.443 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 170/220 2024-04-01T22:28:40.324 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-base-debuginfo-2:19.0.0-1992.g1f941761.el9. 172/220 2024-04-01T22:28:40.984 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-common-debuginfo-2:19.0.0-1992.g1f941761.el 173/220 2024-04-01T22:28:41.158 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-fuse-debuginfo-2:19.0.0-1992.g1f941761.el9. 174/220 2024-04-01T22:28:42.541 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephfs-top-2:19.0.0-1992.g1f941761.el9.noarch 171/220 2024-04-01T22:28:46.345 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.0.0-1 175/220 2024-04-01T22:28:48.786 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mds-debuginfo-2:19.0.0-1992.g1f941761.el9.x 176/220 2024-04-01T22:28:58.996 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-debuginfo-2:19.0.0-1992.g1f941761.el9.x 177/220 2024-04-01T22:29:24.458 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-base-debuginfo-2:19.0.0-1992.g1f941761.el9. 172/220 2024-04-01T22:29:25.280 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-common-debuginfo-2:19.0.0-1992.g1f941761.el 173/220 2024-04-01T22:29:25.448 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-fuse-debuginfo-2:19.0.0-1992.g1f941761.el9. 174/220 2024-04-01T22:29:28.642 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mon-debuginfo-2:19.0.0-1992.g1f941761.el9.x 178/220 2024-04-01T22:29:30.335 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.0.0-1 175/220 2024-04-01T22:29:32.644 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mds-debuginfo-2:19.0.0-1992.g1f941761.el9.x 176/220 2024-04-01T22:29:42.284 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-debuginfo-2:19.0.0-1992.g1f941761.el9.x 177/220 2024-04-01T22:29:46.640 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-osd-debuginfo-2:19.0.0-1992.g1f941761.el9.x 179/220 2024-04-01T22:30:10.154 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mon-debuginfo-2:19.0.0-1992.g1f941761.el9.x 178/220 2024-04-01T22:30:27.164 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-osd-debuginfo-2:19.0.0-1992.g1f941761.el9.x 179/220 2024-04-01T22:30:57.940 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-radosgw-debuginfo-2:19.0.0-1992.g1f941761.e 180/220 2024-04-01T22:30:58.545 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-test-debuginfo-2:19.0.0-1992.g1f941761.el9. 181/220 2024-04-01T22:30:58.589 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephfs2-debuginfo-2:19.0.0-1992.g1f941761.el9 182/220 2024-04-01T22:31:03.637 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librados-devel-debuginfo-2:19.0.0-1992.g1f941761 183/220 2024-04-01T22:31:09.579 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librados2-debuginfo-2:19.0.0-1992.g1f941761.el9. 184/220 2024-04-01T22:31:09.671 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librbd1-debuginfo-2:19.0.0-1992.g1f941761.el9.x8 185/220 2024-04-01T22:31:09.770 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cephfs-debuginfo-2:19.0.0-1992.g1f941761 186/220 2024-04-01T22:31:09.907 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rados-debuginfo-2:19.0.0-1992.g1f941761. 187/220 2024-04-01T22:31:09.969 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rbd-debuginfo-2:19.0.0-1992.g1f941761.el 188/220 2024-04-01T22:31:10.052 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rgw-debuginfo-2:19.0.0-1992.g1f941761.el 189/220 2024-04-01T22:31:15.898 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-fuse-debuginfo-2:19.0.0-1992.g1f941761.el9.x 190/220 2024-04-01T22:31:16.299 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-mirror-debuginfo-2:19.0.0-1992.g1f941761.el9 191/220 2024-04-01T22:31:17.393 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-nbd-debuginfo-2:19.0.0-1992.g1f941761.el9.x8 192/220 2024-04-01T22:31:17.476 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 193/220 2024-04-01T22:31:17.524 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 194/220 2024-04-01T22:31:17.612 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flex-2.6.4-9.el9.x86_64 195/220 2024-04-01T22:31:17.646 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : bison-3.7.4-5.el9.x86_64 196/220 2024-04-01T22:31:17.671 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 197/220 2024-04-01T22:31:17.697 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 198/220 2024-04-01T22:31:17.723 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 199/220 2024-04-01T22:31:17.723 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 200/220 2024-04-01T22:31:17.812 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 200/220 2024-04-01T22:31:17.841 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 201/220 2024-04-01T22:31:17.841 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 202/220 2024-04-01T22:31:17.925 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 202/220 2024-04-01T22:31:17.952 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 203/220 2024-04-01T22:31:17.993 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 204/220 2024-04-01T22:31:18.020 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 205/220 2024-04-01T22:31:18.044 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 206/220 2024-04-01T22:31:18.088 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 207/220 2024-04-01T22:31:18.128 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 208/220 2024-04-01T22:31:18.174 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 209/220 2024-04-01T22:31:18.207 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 210/220 2024-04-01T22:31:18.232 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 211/220 2024-04-01T22:31:18.258 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 212/220 2024-04-01T22:31:18.283 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 213/220 2024-04-01T22:31:18.293 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 214/220 2024-04-01T22:31:18.293 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 214/220 2024-04-01T22:31:18.477 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 214/220 2024-04-01T22:31:18.478 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 215/220 2024-04-01T22:31:18.569 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 215/220 2024-04-01T22:31:18.601 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 216/220 2024-04-01T22:31:18.627 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 217/220 2024-04-01T22:31:18.653 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 218/220 2024-04-01T22:31:18.687 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 219/220 2024-04-01T22:31:18.756 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 220/220 2024-04-01T22:31:28.042 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 220/220 2024-04-01T22:31:28.042 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-2:19.0.0-1992.g1f941761.el9.x86_64 1/220 2024-04-01T22:31:28.042 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-base-2:19.0.0-1992.g1f941761.el9.x86_64 2/220 2024-04-01T22:31:28.042 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-base-debuginfo-2:19.0.0-1992.g1f941761.el9. 3/220 2024-04-01T22:31:28.042 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-common-2:19.0.0-1992.g1f941761.el9.x86_64 4/220 2024-04-01T22:31:28.042 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-common-debuginfo-2:19.0.0-1992.g1f941761.el 5/220 2024-04-01T22:31:28.042 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_6 6/220 2024-04-01T22:31:28.042 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-fuse-2:19.0.0-1992.g1f941761.el9.x86_64 7/220 2024-04-01T22:31:28.042 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-fuse-debuginfo-2:19.0.0-1992.g1f941761.el9. 8/220 2024-04-01T22:31:28.042 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1992.g1f941 9/220 2024-04-01T22:31:28.045 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.0.0-1 10/220 2024-04-01T22:31:28.045 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mds-2:19.0.0-1992.g1f941761.el9.x86_64 11/220 2024-04-01T22:31:28.045 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mds-debuginfo-2:19.0.0-1992.g1f941761.el9.x 12/220 2024-04-01T22:31:28.045 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-2:19.0.0-1992.g1f941761.el9.x86_64 13/220 2024-04-01T22:31:28.045 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-debuginfo-2:19.0.0-1992.g1f941761.el9.x 14/220 2024-04-01T22:31:28.045 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mon-2:19.0.0-1992.g1f941761.el9.x86_64 15/220 2024-04-01T22:31:28.045 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mon-debuginfo-2:19.0.0-1992.g1f941761.el9.x 16/220 2024-04-01T22:31:28.046 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-osd-2:19.0.0-1992.g1f941761.el9.x86_64 17/220 2024-04-01T22:31:28.046 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-osd-debuginfo-2:19.0.0-1992.g1f941761.el9.x 18/220 2024-04-01T22:31:28.046 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-radosgw-2:19.0.0-1992.g1f941761.el9.x86_64 19/220 2024-04-01T22:31:28.046 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-radosgw-debuginfo-2:19.0.0-1992.g1f941761.e 20/220 2024-04-01T22:31:28.046 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-selinux-2:19.0.0-1992.g1f941761.el9.x86_64 21/220 2024-04-01T22:31:28.046 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-test-2:19.0.0-1992.g1f941761.el9.x86_64 22/220 2024-04-01T22:31:28.046 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-test-debuginfo-2:19.0.0-1992.g1f941761.el9. 23/220 2024-04-01T22:31:28.046 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephfs-mirror-2:19.0.0-1992.g1f941761.el9.x86_64 24/220 2024-04-01T22:31:28.046 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephfs-shell-2:19.0.0-1992.g1f941761.el9.x86_64 25/220 2024-04-01T22:31:28.046 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephfs-devel-2:19.0.0-1992.g1f941761.el9.x86_ 26/220 2024-04-01T22:31:28.046 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephfs2-2:19.0.0-1992.g1f941761.el9.x86_64 27/220 2024-04-01T22:31:28.065 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephfs2-debuginfo-2:19.0.0-1992.g1f941761.el9 28/220 2024-04-01T22:31:28.065 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephsqlite-2:19.0.0-1992.g1f941761.el9.x86_64 29/220 2024-04-01T22:31:28.065 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados-devel-2:19.0.0-1992.g1f941761.el9.x86_6 30/220 2024-04-01T22:31:28.065 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados-devel-debuginfo-2:19.0.0-1992.g1f941761 31/220 2024-04-01T22:31:28.065 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados2-debuginfo-2:19.0.0-1992.g1f941761.el9. 32/220 2024-04-01T22:31:28.066 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libradosstriper1-2:19.0.0-1992.g1f941761.el9.x86 33/220 2024-04-01T22:31:28.066 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librbd1-debuginfo-2:19.0.0-1992.g1f941761.el9.x8 34/220 2024-04-01T22:31:28.066 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librgw2-2:19.0.0-1992.g1f941761.el9.x86_64 35/220 2024-04-01T22:31:28.066 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1992.g1f941761.el 36/220 2024-04-01T22:31:28.066 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ceph-common-2:19.0.0-1992.g1f941761.el9. 37/220 2024-04-01T22:31:28.066 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cephfs-2:19.0.0-1992.g1f941761.el9.x86_6 38/220 2024-04-01T22:31:28.066 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cephfs-debuginfo-2:19.0.0-1992.g1f941761 39/220 2024-04-01T22:31:28.066 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rados-2:19.0.0-1992.g1f941761.el9.x86_64 40/220 2024-04-01T22:31:28.066 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rados-debuginfo-2:19.0.0-1992.g1f941761. 41/220 2024-04-01T22:31:28.066 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rbd-2:19.0.0-1992.g1f941761.el9.x86_64 42/220 2024-04-01T22:31:28.066 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rbd-debuginfo-2:19.0.0-1992.g1f941761.el 43/220 2024-04-01T22:31:28.066 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rgw-2:19.0.0-1992.g1f941761.el9.x86_64 44/220 2024-04-01T22:31:28.067 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rgw-debuginfo-2:19.0.0-1992.g1f941761.el 45/220 2024-04-01T22:31:28.067 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-fuse-2:19.0.0-1992.g1f941761.el9.x86_64 46/220 2024-04-01T22:31:28.067 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-fuse-debuginfo-2:19.0.0-1992.g1f941761.el9.x 47/220 2024-04-01T22:31:28.067 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-mirror-2:19.0.0-1992.g1f941761.el9.x86_64 48/220 2024-04-01T22:31:28.067 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-mirror-debuginfo-2:19.0.0-1992.g1f941761.el9 49/220 2024-04-01T22:31:28.067 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-nbd-2:19.0.0-1992.g1f941761.el9.x86_64 50/220 2024-04-01T22:31:28.067 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-nbd-debuginfo-2:19.0.0-1992.g1f941761.el9.x8 51/220 2024-04-01T22:31:28.067 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1992.g1f941761. 52/220 2024-04-01T22:31:28.067 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1992.g1f941761.el9.noa 53/220 2024-04-01T22:31:28.067 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1992.g1f941761.el9.n 54/220 2024-04-01T22:31:28.067 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1992.g1f9 55/220 2024-04-01T22:31:28.067 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1992.g1f941761.el 56/220 2024-04-01T22:31:28.067 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1992.g1f941761.el9.noarch 57/220 2024-04-01T22:31:28.068 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1992.g1f941761.e 58/220 2024-04-01T22:31:28.068 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-volume-2:19.0.0-1992.g1f941761.el9.noarch 59/220 2024-04-01T22:31:28.068 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephadm-2:19.0.0-1992.g1f941761.el9.noarch 60/220 2024-04-01T22:31:28.068 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephfs-top-2:19.0.0-1992.g1f941761.el9.noarch 61/220 2024-04-01T22:31:28.068 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : automake-1.16.2-8.el9.noarch 62/220 2024-04-01T22:31:28.068 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : bison-3.7.4-5.el9.x86_64 63/220 2024-04-01T22:31:28.068 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/220 2024-04-01T22:31:28.068 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flex-2.6.4-9.el9.x86_64 65/220 2024-04-01T22:31:28.068 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 66/220 2024-04-01T22:31:28.068 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 67/220 2024-04-01T22:31:28.068 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 68/220 2024-04-01T22:31:28.068 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 69/220 2024-04-01T22:31:28.068 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 70/220 2024-04-01T22:31:28.068 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 71/220 2024-04-01T22:31:28.069 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 72/220 2024-04-01T22:31:28.069 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 73/220 2024-04-01T22:31:28.069 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 74/220 2024-04-01T22:31:28.069 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 75/220 2024-04-01T22:31:28.069 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lua-5.4.4-4.el9.x86_64 76/220 2024-04-01T22:31:28.069 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 77/220 2024-04-01T22:31:28.069 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 78/220 2024-04-01T22:31:28.069 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 79/220 2024-04-01T22:31:28.069 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : postgresql-13.14-1.el9.x86_64 80/220 2024-04-01T22:31:28.069 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 81/220 2024-04-01T22:31:28.069 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 82/220 2024-04-01T22:31:28.069 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 83/220 2024-04-01T22:31:28.069 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 84/220 2024-04-01T22:31:28.069 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 85/220 2024-04-01T22:31:28.069 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 86/220 2024-04-01T22:31:28.070 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 87/220 2024-04-01T22:31:28.070 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 88/220 2024-04-01T22:31:28.070 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 89/220 2024-04-01T22:31:28.070 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 90/220 2024-04-01T22:31:28.070 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 91/220 2024-04-01T22:31:28.070 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/220 2024-04-01T22:31:28.070 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 93/220 2024-04-01T22:31:28.070 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 94/220 2024-04-01T22:31:28.070 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 95/220 2024-04-01T22:31:28.070 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 96/220 2024-04-01T22:31:28.070 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 97/220 2024-04-01T22:31:28.070 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 98/220 2024-04-01T22:31:28.070 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 99/220 2024-04-01T22:31:28.071 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 100/220 2024-04-01T22:31:28.071 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 101/220 2024-04-01T22:31:28.071 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 102/220 2024-04-01T22:31:28.071 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 103/220 2024-04-01T22:31:28.071 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 104/220 2024-04-01T22:31:28.071 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 105/220 2024-04-01T22:31:28.071 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 106/220 2024-04-01T22:31:28.071 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 107/220 2024-04-01T22:31:28.071 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 108/220 2024-04-01T22:31:28.071 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 109/220 2024-04-01T22:31:28.071 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 110/220 2024-04-01T22:31:28.071 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 111/220 2024-04-01T22:31:28.071 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 112/220 2024-04-01T22:31:28.071 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 113/220 2024-04-01T22:31:28.072 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ply-3.11-14.el9.noarch 114/220 2024-04-01T22:31:28.072 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 115/220 2024-04-01T22:31:28.072 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 116/220 2024-04-01T22:31:28.072 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : jq-1.6-16.el9.x86_64 117/220 2024-04-01T22:31:28.072 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 118/220 2024-04-01T22:31:28.072 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 119/220 2024-04-01T22:31:28.072 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 120/220 2024-04-01T22:31:28.072 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 121/220 2024-04-01T22:31:28.072 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 122/220 2024-04-01T22:31:28.072 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 123/220 2024-04-01T22:31:28.072 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 124/220 2024-04-01T22:31:28.072 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 125/220 2024-04-01T22:31:28.072 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 126/220 2024-04-01T22:31:28.073 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 127/220 2024-04-01T22:31:28.073 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 128/220 2024-04-01T22:31:28.073 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 129/220 2024-04-01T22:31:28.073 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 130/220 2024-04-01T22:31:28.073 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 131/220 2024-04-01T22:31:28.073 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 132/220 2024-04-01T22:31:28.073 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 133/220 2024-04-01T22:31:28.073 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 134/220 2024-04-01T22:31:28.073 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 135/220 2024-04-01T22:31:28.073 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 136/220 2024-04-01T22:31:28.073 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 137/220 2024-04-01T22:31:28.073 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 138/220 2024-04-01T22:31:28.073 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 139/220 2024-04-01T22:31:28.074 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 140/220 2024-04-01T22:31:28.074 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 141/220 2024-04-01T22:31:28.074 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 142/220 2024-04-01T22:31:28.074 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 143/220 2024-04-01T22:31:28.074 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 144/220 2024-04-01T22:31:28.074 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 145/220 2024-04-01T22:31:28.074 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 146/220 2024-04-01T22:31:28.074 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 147/220 2024-04-01T22:31:28.074 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 148/220 2024-04-01T22:31:28.074 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 149/220 2024-04-01T22:31:28.074 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 150/220 2024-04-01T22:31:28.074 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 151/220 2024-04-01T22:31:28.074 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 152/220 2024-04-01T22:31:28.074 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 153/220 2024-04-01T22:31:28.075 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 154/220 2024-04-01T22:31:28.075 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 155/220 2024-04-01T22:31:28.075 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 156/220 2024-04-01T22:31:28.075 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 157/220 2024-04-01T22:31:28.075 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 158/220 2024-04-01T22:31:28.075 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 159/220 2024-04-01T22:31:28.075 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 160/220 2024-04-01T22:31:28.075 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 161/220 2024-04-01T22:31:28.075 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 162/220 2024-04-01T22:31:28.075 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 163/220 2024-04-01T22:31:28.075 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 164/220 2024-04-01T22:31:28.075 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 165/220 2024-04-01T22:31:28.075 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 166/220 2024-04-01T22:31:28.076 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 167/220 2024-04-01T22:31:28.076 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 168/220 2024-04-01T22:31:28.076 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 169/220 2024-04-01T22:31:28.076 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 170/220 2024-04-01T22:31:28.076 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : re2-1:20211101-3.el9.x86_64 171/220 2024-04-01T22:31:28.076 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 172/220 2024-04-01T22:31:28.076 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados2-2:19.0.0-1992.g1f941761.el9.x86_64 173/220 2024-04-01T22:31:28.076 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 174/220 2024-04-01T22:31:28.076 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librbd1-2:19.0.0-1992.g1f941761.el9.x86_64 175/220 2024-04-01T22:31:28.076 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 176/220 2024-04-01T22:31:28.076 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 177/220 2024-04-01T22:31:28.076 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 178/220 2024-04-01T22:31:28.076 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 179/220 2024-04-01T22:31:28.076 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 180/220 2024-04-01T22:31:28.076 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 181/220 2024-04-01T22:31:28.077 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 182/220 2024-04-01T22:31:28.077 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 183/220 2024-04-01T22:31:28.077 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 184/220 2024-04-01T22:31:28.077 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 185/220 2024-04-01T22:31:28.077 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 186/220 2024-04-01T22:31:28.077 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : acl-2.3.1-4.el9.x86_64 187/220 2024-04-01T22:31:28.077 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : acl-2.3.1-3.el9.x86_64 188/220 2024-04-01T22:31:28.077 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 189/220 2024-04-01T22:31:28.077 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 190/220 2024-04-01T22:31:28.077 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 191/220 2024-04-01T22:31:28.077 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 192/220 2024-04-01T22:31:28.077 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 193/220 2024-04-01T22:31:28.077 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 194/220 2024-04-01T22:31:28.078 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 195/220 2024-04-01T22:31:28.078 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 196/220 2024-04-01T22:31:28.078 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 197/220 2024-04-01T22:31:28.078 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 198/220 2024-04-01T22:31:28.078 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 199/220 2024-04-01T22:31:28.078 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 200/220 2024-04-01T22:31:28.078 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 201/220 2024-04-01T22:31:28.078 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 202/220 2024-04-01T22:31:28.078 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 203/220 2024-04-01T22:31:28.078 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 204/220 2024-04-01T22:31:28.078 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 205/220 2024-04-01T22:31:28.078 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 206/220 2024-04-01T22:31:28.078 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 207/220 2024-04-01T22:31:28.078 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 208/220 2024-04-01T22:31:28.079 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 209/220 2024-04-01T22:31:28.079 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 210/220 2024-04-01T22:31:28.079 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 211/220 2024-04-01T22:31:28.079 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 212/220 2024-04-01T22:31:28.079 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 213/220 2024-04-01T22:31:28.079 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 214/220 2024-04-01T22:31:28.079 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 215/220 2024-04-01T22:31:28.079 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 216/220 2024-04-01T22:31:28.079 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 217/220 2024-04-01T22:31:28.079 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 218/220 2024-04-01T22:31:28.079 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 219/220 2024-04-01T22:31:30.988 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 220/220 2024-04-01T22:31:30.988 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:31:30.988 INFO:teuthology.orchestra.run.smithi047.stdout:Upgraded: 2024-04-01T22:31:30.988 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-04-01T22:31:30.988 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-04-01T22:31:30.988 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-04-01T22:31:30.988 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-04-01T22:31:30.988 INFO:teuthology.orchestra.run.smithi047.stdout: acl-2.3.1-4.el9.x86_64 2024-04-01T22:31:30.989 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-04-01T22:31:30.989 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-04-01T22:31:30.989 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-04-01T22:31:30.989 INFO:teuthology.orchestra.run.smithi047.stdout: libacl-2.3.1-4.el9.x86_64 2024-04-01T22:31:30.989 INFO:teuthology.orchestra.run.smithi047.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-04-01T22:31:30.989 INFO:teuthology.orchestra.run.smithi047.stdout: libblkid-2.37.4-18.el9.x86_64 2024-04-01T22:31:30.989 INFO:teuthology.orchestra.run.smithi047.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-04-01T22:31:30.989 INFO:teuthology.orchestra.run.smithi047.stdout: libmount-2.37.4-18.el9.x86_64 2024-04-01T22:31:30.989 INFO:teuthology.orchestra.run.smithi047.stdout: librados2-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:30.989 INFO:teuthology.orchestra.run.smithi047.stdout: librbd1-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:30.989 INFO:teuthology.orchestra.run.smithi047.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-04-01T22:31:30.989 INFO:teuthology.orchestra.run.smithi047.stdout: libuuid-2.37.4-18.el9.x86_64 2024-04-01T22:31:30.989 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-04-01T22:31:30.989 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-04-01T22:31:30.990 INFO:teuthology.orchestra.run.smithi047.stdout: util-linux-2.37.4-18.el9.x86_64 2024-04-01T22:31:30.990 INFO:teuthology.orchestra.run.smithi047.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-04-01T22:31:30.990 INFO:teuthology.orchestra.run.smithi047.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-04-01T22:31:30.990 INFO:teuthology.orchestra.run.smithi047.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-04-01T22:31:30.990 INFO:teuthology.orchestra.run.smithi047.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-04-01T22:31:30.990 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-04-01T22:31:30.990 INFO:teuthology.orchestra.run.smithi047.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-01T22:31:30.990 INFO:teuthology.orchestra.run.smithi047.stdout: automake-1.16.2-8.el9.noarch 2024-04-01T22:31:30.990 INFO:teuthology.orchestra.run.smithi047.stdout: bison-3.7.4-5.el9.x86_64 2024-04-01T22:31:30.990 INFO:teuthology.orchestra.run.smithi047.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-01T22:31:30.990 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:30.990 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-base-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:30.991 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-base-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:30.991 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-common-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:30.991 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-common-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:30.991 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:30.991 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-fuse-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:30.991 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-fuse-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:30.991 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-grafana-dashboards-2:19.0.0-1992.g1f941761.el9.noarch 2024-04-01T22:31:30.991 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-immutable-object-cache-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:30.991 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-immutable-object-cache-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:30.991 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mds-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:30.991 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mds-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:30.991 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:30.991 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-cephadm-2:19.0.0-1992.g1f941761.el9.noarch 2024-04-01T22:31:30.991 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-dashboard-2:19.0.0-1992.g1f941761.el9.noarch 2024-04-01T22:31:30.992 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:30.992 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1992.g1f941761.el9.noarch 2024-04-01T22:31:30.992 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-modules-core-2:19.0.0-1992.g1f941761.el9.noarch 2024-04-01T22:31:30.992 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-rook-2:19.0.0-1992.g1f941761.el9.noarch 2024-04-01T22:31:30.992 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mon-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:30.992 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mon-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:30.992 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-osd-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:30.992 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-osd-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:30.992 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-prometheus-alerts-2:19.0.0-1992.g1f941761.el9.noarch 2024-04-01T22:31:30.992 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-radosgw-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:30.992 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-radosgw-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:30.992 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-selinux-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:30.992 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-test-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:30.993 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-test-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:30.993 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-volume-2:19.0.0-1992.g1f941761.el9.noarch 2024-04-01T22:31:30.993 INFO:teuthology.orchestra.run.smithi047.stdout: cephadm-2:19.0.0-1992.g1f941761.el9.noarch 2024-04-01T22:31:30.993 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-mirror-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:30.993 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-shell-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:30.993 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-top-2:19.0.0-1992.g1f941761.el9.noarch 2024-04-01T22:31:30.993 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-01T22:31:30.993 INFO:teuthology.orchestra.run.smithi047.stdout: flex-2.6.4-9.el9.x86_64 2024-04-01T22:31:30.993 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-01T22:31:30.993 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-01T22:31:30.993 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-01T22:31:30.993 INFO:teuthology.orchestra.run.smithi047.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-01T22:31:30.993 INFO:teuthology.orchestra.run.smithi047.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-01T22:31:30.993 INFO:teuthology.orchestra.run.smithi047.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-01T22:31:30.993 INFO:teuthology.orchestra.run.smithi047.stdout: jq-1.6-16.el9.x86_64 2024-04-01T22:31:30.993 INFO:teuthology.orchestra.run.smithi047.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-01T22:31:30.994 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-01T22:31:30.994 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-01T22:31:30.994 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs-devel-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:30.994 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs2-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:30.994 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs2-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:30.994 INFO:teuthology.orchestra.run.smithi047.stdout: libcephsqlite-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:30.994 INFO:teuthology.orchestra.run.smithi047.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-01T22:31:30.994 INFO:teuthology.orchestra.run.smithi047.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-01T22:31:30.994 INFO:teuthology.orchestra.run.smithi047.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-01T22:31:30.994 INFO:teuthology.orchestra.run.smithi047.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-01T22:31:30.994 INFO:teuthology.orchestra.run.smithi047.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-01T22:31:30.994 INFO:teuthology.orchestra.run.smithi047.stdout: librados-devel-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:30.995 INFO:teuthology.orchestra.run.smithi047.stdout: librados-devel-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:30.995 INFO:teuthology.orchestra.run.smithi047.stdout: librados2-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:30.995 INFO:teuthology.orchestra.run.smithi047.stdout: libradosstriper1-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:30.995 INFO:teuthology.orchestra.run.smithi047.stdout: librbd1-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:30.995 INFO:teuthology.orchestra.run.smithi047.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-01T22:31:30.995 INFO:teuthology.orchestra.run.smithi047.stdout: librgw2-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:30.995 INFO:teuthology.orchestra.run.smithi047.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-01T22:31:30.995 INFO:teuthology.orchestra.run.smithi047.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-01T22:31:30.995 INFO:teuthology.orchestra.run.smithi047.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-01T22:31:30.995 INFO:teuthology.orchestra.run.smithi047.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-01T22:31:30.995 INFO:teuthology.orchestra.run.smithi047.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-01T22:31:30.995 INFO:teuthology.orchestra.run.smithi047.stdout: lua-5.4.4-4.el9.x86_64 2024-04-01T22:31:30.995 INFO:teuthology.orchestra.run.smithi047.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-01T22:31:30.996 INFO:teuthology.orchestra.run.smithi047.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-01T22:31:30.996 INFO:teuthology.orchestra.run.smithi047.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-01T22:31:30.996 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-01T22:31:30.996 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-01T22:31:30.996 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-01T22:31:30.996 INFO:teuthology.orchestra.run.smithi047.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-01T22:31:30.996 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-13.14-1.el9.x86_64 2024-04-01T22:31:30.996 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-01T22:31:30.996 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-01T22:31:30.996 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-01T22:31:30.996 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-01T22:31:30.996 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-01T22:31:30.996 INFO:teuthology.orchestra.run.smithi047.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-01T22:31:30.997 INFO:teuthology.orchestra.run.smithi047.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-01T22:31:30.997 INFO:teuthology.orchestra.run.smithi047.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-01T22:31:30.997 INFO:teuthology.orchestra.run.smithi047.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-01T22:31:30.997 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-01T22:31:30.997 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-argparse-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:30.997 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-common-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:30.997 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cephfs-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:30.997 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cephfs-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:30.997 INFO:teuthology.orchestra.run.smithi047.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-01T22:31:30.997 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-01T22:31:30.997 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-01T22:31:30.997 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-01T22:31:30.997 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-01T22:31:30.998 INFO:teuthology.orchestra.run.smithi047.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-01T22:31:30.998 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-01T22:31:30.998 INFO:teuthology.orchestra.run.smithi047.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-01T22:31:30.998 INFO:teuthology.orchestra.run.smithi047.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-01T22:31:30.998 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-01T22:31:30.998 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-01T22:31:30.998 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-01T22:31:30.998 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-01T22:31:30.998 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-01T22:31:30.998 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-01T22:31:30.998 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-01T22:31:30.998 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-01T22:31:30.999 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-01T22:31:30.999 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-01T22:31:30.999 INFO:teuthology.orchestra.run.smithi047.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-01T22:31:30.999 INFO:teuthology.orchestra.run.smithi047.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-01T22:31:30.999 INFO:teuthology.orchestra.run.smithi047.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-01T22:31:30.999 INFO:teuthology.orchestra.run.smithi047.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-01T22:31:30.999 INFO:teuthology.orchestra.run.smithi047.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-01T22:31:30.999 INFO:teuthology.orchestra.run.smithi047.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-01T22:31:30.999 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-01T22:31:30.999 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-01T22:31:30.999 INFO:teuthology.orchestra.run.smithi047.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-01T22:31:30.999 INFO:teuthology.orchestra.run.smithi047.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-01T22:31:30.999 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-01T22:31:30.999 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ply-3.11-14.el9.noarch 2024-04-01T22:31:30.999 INFO:teuthology.orchestra.run.smithi047.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-01T22:31:31.000 INFO:teuthology.orchestra.run.smithi047.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-01T22:31:31.000 INFO:teuthology.orchestra.run.smithi047.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-01T22:31:31.000 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-01T22:31:31.000 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-01T22:31:31.000 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-01T22:31:31.000 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-01T22:31:31.000 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-01T22:31:31.000 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-01T22:31:31.000 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rados-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:31.000 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rados-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:31.000 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rbd-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:31.000 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rbd-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:31.000 INFO:teuthology.orchestra.run.smithi047.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-01T22:31:31.000 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-01T22:31:31.000 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-01T22:31:31.001 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rgw-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:31.001 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rgw-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:31.001 INFO:teuthology.orchestra.run.smithi047.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-01T22:31:31.001 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-01T22:31:31.001 INFO:teuthology.orchestra.run.smithi047.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-01T22:31:31.001 INFO:teuthology.orchestra.run.smithi047.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-01T22:31:31.001 INFO:teuthology.orchestra.run.smithi047.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-01T22:31:31.002 INFO:teuthology.orchestra.run.smithi047.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-01T22:31:31.002 INFO:teuthology.orchestra.run.smithi047.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-01T22:31:31.002 INFO:teuthology.orchestra.run.smithi047.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-01T22:31:31.002 INFO:teuthology.orchestra.run.smithi047.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-01T22:31:31.002 INFO:teuthology.orchestra.run.smithi047.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-01T22:31:31.002 INFO:teuthology.orchestra.run.smithi047.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-01T22:31:31.002 INFO:teuthology.orchestra.run.smithi047.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-01T22:31:31.002 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-01T22:31:31.002 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-01T22:31:31.002 INFO:teuthology.orchestra.run.smithi047.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-01T22:31:31.002 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-fuse-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:31.002 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-fuse-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:31.002 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-mirror-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:31.002 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-mirror-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:31.003 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-nbd-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:31.003 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-nbd-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:31:31.003 INFO:teuthology.orchestra.run.smithi047.stdout: re2-1:20211101-3.el9.x86_64 2024-04-01T22:31:31.003 INFO:teuthology.orchestra.run.smithi047.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-01T22:31:31.003 INFO:teuthology.orchestra.run.smithi047.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-01T22:31:31.003 INFO:teuthology.orchestra.run.smithi047.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-01T22:31:31.003 INFO:teuthology.orchestra.run.smithi047.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-01T22:31:31.003 INFO:teuthology.orchestra.run.smithi047.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-01T22:31:31.004 INFO:teuthology.orchestra.run.smithi047.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-04-01T22:31:31.004 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:31:31.004 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-04-01T22:31:31.651 DEBUG:teuthology.parallel:result is None 2024-04-01T22:31:34.306 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-radosgw-debuginfo-2:19.0.0-1992.g1f941761.e 180/220 2024-04-01T22:31:34.873 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-test-debuginfo-2:19.0.0-1992.g1f941761.el9. 181/220 2024-04-01T22:31:34.916 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephfs2-debuginfo-2:19.0.0-1992.g1f941761.el9 182/220 2024-04-01T22:31:39.677 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librados-devel-debuginfo-2:19.0.0-1992.g1f941761 183/220 2024-04-01T22:31:45.485 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librados2-debuginfo-2:19.0.0-1992.g1f941761.el9. 184/220 2024-04-01T22:31:45.863 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librbd1-debuginfo-2:19.0.0-1992.g1f941761.el9.x8 185/220 2024-04-01T22:31:46.203 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cephfs-debuginfo-2:19.0.0-1992.g1f941761 186/220 2024-04-01T22:31:46.564 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rados-debuginfo-2:19.0.0-1992.g1f941761. 187/220 2024-04-01T22:31:46.897 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rbd-debuginfo-2:19.0.0-1992.g1f941761.el 188/220 2024-04-01T22:31:47.220 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rgw-debuginfo-2:19.0.0-1992.g1f941761.el 189/220 2024-04-01T22:31:52.980 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-fuse-debuginfo-2:19.0.0-1992.g1f941761.el9.x 190/220 2024-04-01T22:31:53.353 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-mirror-debuginfo-2:19.0.0-1992.g1f941761.el9 191/220 2024-04-01T22:31:54.438 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-nbd-debuginfo-2:19.0.0-1992.g1f941761.el9.x8 192/220 2024-04-01T22:31:54.804 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 193/220 2024-04-01T22:31:55.283 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 194/220 2024-04-01T22:31:55.387 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flex-2.6.4-9.el9.x86_64 195/220 2024-04-01T22:31:55.424 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : bison-3.7.4-5.el9.x86_64 196/220 2024-04-01T22:31:55.449 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 197/220 2024-04-01T22:31:55.475 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 198/220 2024-04-01T22:31:55.501 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 199/220 2024-04-01T22:31:55.501 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 200/220 2024-04-01T22:31:55.589 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 200/220 2024-04-01T22:31:55.627 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 201/220 2024-04-01T22:31:55.627 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 202/220 2024-04-01T22:31:55.712 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 202/220 2024-04-01T22:31:55.738 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 203/220 2024-04-01T22:31:55.771 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 204/220 2024-04-01T22:31:55.796 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 205/220 2024-04-01T22:31:55.830 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 206/220 2024-04-01T22:31:55.884 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 207/220 2024-04-01T22:31:55.930 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 208/220 2024-04-01T22:31:55.968 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 209/220 2024-04-01T22:31:55.993 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 210/220 2024-04-01T22:31:56.019 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 211/220 2024-04-01T22:31:56.044 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 212/220 2024-04-01T22:31:56.070 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 213/220 2024-04-01T22:31:56.086 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 214/220 2024-04-01T22:31:56.087 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 214/220 2024-04-01T22:31:56.280 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 214/220 2024-04-01T22:31:56.280 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 215/220 2024-04-01T22:31:56.363 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 215/220 2024-04-01T22:31:56.395 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 216/220 2024-04-01T22:31:56.430 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 217/220 2024-04-01T22:31:56.456 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 218/220 2024-04-01T22:31:56.481 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 219/220 2024-04-01T22:31:56.549 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 220/220 2024-04-01T22:32:05.979 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 220/220 2024-04-01T22:32:05.979 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-2:19.0.0-1992.g1f941761.el9.x86_64 1/220 2024-04-01T22:32:05.979 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-base-2:19.0.0-1992.g1f941761.el9.x86_64 2/220 2024-04-01T22:32:05.979 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-base-debuginfo-2:19.0.0-1992.g1f941761.el9. 3/220 2024-04-01T22:32:05.979 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-common-2:19.0.0-1992.g1f941761.el9.x86_64 4/220 2024-04-01T22:32:05.979 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-common-debuginfo-2:19.0.0-1992.g1f941761.el 5/220 2024-04-01T22:32:05.979 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_6 6/220 2024-04-01T22:32:05.980 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-fuse-2:19.0.0-1992.g1f941761.el9.x86_64 7/220 2024-04-01T22:32:05.980 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-fuse-debuginfo-2:19.0.0-1992.g1f941761.el9. 8/220 2024-04-01T22:32:05.980 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1992.g1f941 9/220 2024-04-01T22:32:05.980 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.0.0-1 10/220 2024-04-01T22:32:05.980 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mds-2:19.0.0-1992.g1f941761.el9.x86_64 11/220 2024-04-01T22:32:05.980 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mds-debuginfo-2:19.0.0-1992.g1f941761.el9.x 12/220 2024-04-01T22:32:05.980 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-2:19.0.0-1992.g1f941761.el9.x86_64 13/220 2024-04-01T22:32:05.980 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-debuginfo-2:19.0.0-1992.g1f941761.el9.x 14/220 2024-04-01T22:32:05.980 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mon-2:19.0.0-1992.g1f941761.el9.x86_64 15/220 2024-04-01T22:32:05.980 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mon-debuginfo-2:19.0.0-1992.g1f941761.el9.x 16/220 2024-04-01T22:32:05.980 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-osd-2:19.0.0-1992.g1f941761.el9.x86_64 17/220 2024-04-01T22:32:05.980 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-osd-debuginfo-2:19.0.0-1992.g1f941761.el9.x 18/220 2024-04-01T22:32:05.980 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-radosgw-2:19.0.0-1992.g1f941761.el9.x86_64 19/220 2024-04-01T22:32:05.981 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-radosgw-debuginfo-2:19.0.0-1992.g1f941761.e 20/220 2024-04-01T22:32:05.981 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-selinux-2:19.0.0-1992.g1f941761.el9.x86_64 21/220 2024-04-01T22:32:05.981 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-test-2:19.0.0-1992.g1f941761.el9.x86_64 22/220 2024-04-01T22:32:05.981 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-test-debuginfo-2:19.0.0-1992.g1f941761.el9. 23/220 2024-04-01T22:32:05.981 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephfs-mirror-2:19.0.0-1992.g1f941761.el9.x86_64 24/220 2024-04-01T22:32:05.981 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephfs-shell-2:19.0.0-1992.g1f941761.el9.x86_64 25/220 2024-04-01T22:32:05.981 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephfs-devel-2:19.0.0-1992.g1f941761.el9.x86_ 26/220 2024-04-01T22:32:05.981 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephfs2-2:19.0.0-1992.g1f941761.el9.x86_64 27/220 2024-04-01T22:32:05.981 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephfs2-debuginfo-2:19.0.0-1992.g1f941761.el9 28/220 2024-04-01T22:32:05.981 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephsqlite-2:19.0.0-1992.g1f941761.el9.x86_64 29/220 2024-04-01T22:32:05.981 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados-devel-2:19.0.0-1992.g1f941761.el9.x86_6 30/220 2024-04-01T22:32:05.981 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados-devel-debuginfo-2:19.0.0-1992.g1f941761 31/220 2024-04-01T22:32:05.981 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados2-debuginfo-2:19.0.0-1992.g1f941761.el9. 32/220 2024-04-01T22:32:05.981 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libradosstriper1-2:19.0.0-1992.g1f941761.el9.x86 33/220 2024-04-01T22:32:05.982 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librbd1-debuginfo-2:19.0.0-1992.g1f941761.el9.x8 34/220 2024-04-01T22:32:05.982 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librgw2-2:19.0.0-1992.g1f941761.el9.x86_64 35/220 2024-04-01T22:32:05.982 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1992.g1f941761.el 36/220 2024-04-01T22:32:05.982 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ceph-common-2:19.0.0-1992.g1f941761.el9. 37/220 2024-04-01T22:32:05.982 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cephfs-2:19.0.0-1992.g1f941761.el9.x86_6 38/220 2024-04-01T22:32:05.982 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cephfs-debuginfo-2:19.0.0-1992.g1f941761 39/220 2024-04-01T22:32:05.982 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rados-2:19.0.0-1992.g1f941761.el9.x86_64 40/220 2024-04-01T22:32:05.982 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rados-debuginfo-2:19.0.0-1992.g1f941761. 41/220 2024-04-01T22:32:05.982 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rbd-2:19.0.0-1992.g1f941761.el9.x86_64 42/220 2024-04-01T22:32:05.982 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rbd-debuginfo-2:19.0.0-1992.g1f941761.el 43/220 2024-04-01T22:32:05.982 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rgw-2:19.0.0-1992.g1f941761.el9.x86_64 44/220 2024-04-01T22:32:05.982 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rgw-debuginfo-2:19.0.0-1992.g1f941761.el 45/220 2024-04-01T22:32:05.983 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-fuse-2:19.0.0-1992.g1f941761.el9.x86_64 46/220 2024-04-01T22:32:05.983 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-fuse-debuginfo-2:19.0.0-1992.g1f941761.el9.x 47/220 2024-04-01T22:32:05.983 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-mirror-2:19.0.0-1992.g1f941761.el9.x86_64 48/220 2024-04-01T22:32:05.983 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-mirror-debuginfo-2:19.0.0-1992.g1f941761.el9 49/220 2024-04-01T22:32:05.983 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-nbd-2:19.0.0-1992.g1f941761.el9.x86_64 50/220 2024-04-01T22:32:05.983 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-nbd-debuginfo-2:19.0.0-1992.g1f941761.el9.x8 51/220 2024-04-01T22:32:05.983 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1992.g1f941761. 52/220 2024-04-01T22:32:05.983 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1992.g1f941761.el9.noa 53/220 2024-04-01T22:32:05.983 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1992.g1f941761.el9.n 54/220 2024-04-01T22:32:05.983 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1992.g1f9 55/220 2024-04-01T22:32:05.983 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1992.g1f941761.el 56/220 2024-04-01T22:32:05.983 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1992.g1f941761.el9.noarch 57/220 2024-04-01T22:32:05.983 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1992.g1f941761.e 58/220 2024-04-01T22:32:05.983 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-volume-2:19.0.0-1992.g1f941761.el9.noarch 59/220 2024-04-01T22:32:05.984 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephadm-2:19.0.0-1992.g1f941761.el9.noarch 60/220 2024-04-01T22:32:05.984 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephfs-top-2:19.0.0-1992.g1f941761.el9.noarch 61/220 2024-04-01T22:32:05.984 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : automake-1.16.2-8.el9.noarch 62/220 2024-04-01T22:32:05.984 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : bison-3.7.4-5.el9.x86_64 63/220 2024-04-01T22:32:05.984 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/220 2024-04-01T22:32:05.984 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flex-2.6.4-9.el9.x86_64 65/220 2024-04-01T22:32:05.984 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 66/220 2024-04-01T22:32:05.984 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 67/220 2024-04-01T22:32:05.984 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 68/220 2024-04-01T22:32:05.984 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 69/220 2024-04-01T22:32:05.984 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 70/220 2024-04-01T22:32:05.984 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 71/220 2024-04-01T22:32:05.984 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 72/220 2024-04-01T22:32:05.984 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 73/220 2024-04-01T22:32:05.985 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 74/220 2024-04-01T22:32:05.985 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 75/220 2024-04-01T22:32:05.985 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lua-5.4.4-4.el9.x86_64 76/220 2024-04-01T22:32:05.985 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 77/220 2024-04-01T22:32:05.985 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 78/220 2024-04-01T22:32:05.985 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 79/220 2024-04-01T22:32:05.985 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-13.14-1.el9.x86_64 80/220 2024-04-01T22:32:05.985 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 81/220 2024-04-01T22:32:05.985 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 82/220 2024-04-01T22:32:05.985 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 83/220 2024-04-01T22:32:05.985 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 84/220 2024-04-01T22:32:05.985 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 85/220 2024-04-01T22:32:05.985 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 86/220 2024-04-01T22:32:05.985 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 87/220 2024-04-01T22:32:05.985 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 88/220 2024-04-01T22:32:05.986 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 89/220 2024-04-01T22:32:05.986 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 90/220 2024-04-01T22:32:05.986 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 91/220 2024-04-01T22:32:05.986 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/220 2024-04-01T22:32:05.986 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 93/220 2024-04-01T22:32:05.986 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 94/220 2024-04-01T22:32:05.986 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 95/220 2024-04-01T22:32:05.986 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 96/220 2024-04-01T22:32:05.986 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 97/220 2024-04-01T22:32:05.986 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 98/220 2024-04-01T22:32:05.986 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 99/220 2024-04-01T22:32:05.986 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 100/220 2024-04-01T22:32:05.986 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 101/220 2024-04-01T22:32:05.986 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 102/220 2024-04-01T22:32:05.987 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 103/220 2024-04-01T22:32:05.987 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 104/220 2024-04-01T22:32:05.987 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 105/220 2024-04-01T22:32:05.987 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 106/220 2024-04-01T22:32:05.987 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 107/220 2024-04-01T22:32:05.987 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 108/220 2024-04-01T22:32:05.987 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 109/220 2024-04-01T22:32:05.987 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 110/220 2024-04-01T22:32:05.987 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 111/220 2024-04-01T22:32:05.987 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 112/220 2024-04-01T22:32:05.987 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 113/220 2024-04-01T22:32:05.987 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ply-3.11-14.el9.noarch 114/220 2024-04-01T22:32:05.987 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 115/220 2024-04-01T22:32:05.987 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 116/220 2024-04-01T22:32:05.988 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : jq-1.6-16.el9.x86_64 117/220 2024-04-01T22:32:05.988 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 118/220 2024-04-01T22:32:05.988 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 119/220 2024-04-01T22:32:05.988 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 120/220 2024-04-01T22:32:05.988 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 121/220 2024-04-01T22:32:05.988 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 122/220 2024-04-01T22:32:05.988 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 123/220 2024-04-01T22:32:05.988 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 124/220 2024-04-01T22:32:05.988 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 125/220 2024-04-01T22:32:05.988 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 126/220 2024-04-01T22:32:05.988 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 127/220 2024-04-01T22:32:05.988 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 128/220 2024-04-01T22:32:05.988 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 129/220 2024-04-01T22:32:05.988 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 130/220 2024-04-01T22:32:05.988 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 131/220 2024-04-01T22:32:05.989 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 132/220 2024-04-01T22:32:05.989 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 133/220 2024-04-01T22:32:05.989 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 134/220 2024-04-01T22:32:05.989 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 135/220 2024-04-01T22:32:05.989 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 136/220 2024-04-01T22:32:05.989 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 137/220 2024-04-01T22:32:05.989 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 138/220 2024-04-01T22:32:05.989 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 139/220 2024-04-01T22:32:05.989 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 140/220 2024-04-01T22:32:05.989 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 141/220 2024-04-01T22:32:05.989 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 142/220 2024-04-01T22:32:05.989 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 143/220 2024-04-01T22:32:05.989 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 144/220 2024-04-01T22:32:05.989 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 145/220 2024-04-01T22:32:05.990 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 146/220 2024-04-01T22:32:05.990 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 147/220 2024-04-01T22:32:05.990 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 148/220 2024-04-01T22:32:05.990 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 149/220 2024-04-01T22:32:05.990 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 150/220 2024-04-01T22:32:05.990 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 151/220 2024-04-01T22:32:05.990 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 152/220 2024-04-01T22:32:05.990 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 153/220 2024-04-01T22:32:05.990 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 154/220 2024-04-01T22:32:05.990 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 155/220 2024-04-01T22:32:05.990 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 156/220 2024-04-01T22:32:05.990 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 157/220 2024-04-01T22:32:05.990 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 158/220 2024-04-01T22:32:05.991 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 159/220 2024-04-01T22:32:05.991 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 160/220 2024-04-01T22:32:05.991 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 161/220 2024-04-01T22:32:05.991 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 162/220 2024-04-01T22:32:05.991 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 163/220 2024-04-01T22:32:05.991 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 164/220 2024-04-01T22:32:05.991 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 165/220 2024-04-01T22:32:05.991 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 166/220 2024-04-01T22:32:05.991 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 167/220 2024-04-01T22:32:05.991 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 168/220 2024-04-01T22:32:05.991 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 169/220 2024-04-01T22:32:05.991 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 170/220 2024-04-01T22:32:05.991 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : re2-1:20211101-3.el9.x86_64 171/220 2024-04-01T22:32:05.991 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 172/220 2024-04-01T22:32:05.991 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados2-2:19.0.0-1992.g1f941761.el9.x86_64 173/220 2024-04-01T22:32:05.991 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 174/220 2024-04-01T22:32:05.992 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librbd1-2:19.0.0-1992.g1f941761.el9.x86_64 175/220 2024-04-01T22:32:05.992 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 176/220 2024-04-01T22:32:05.992 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 177/220 2024-04-01T22:32:05.992 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 178/220 2024-04-01T22:32:05.992 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 179/220 2024-04-01T22:32:05.992 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 180/220 2024-04-01T22:32:05.992 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 181/220 2024-04-01T22:32:05.992 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 182/220 2024-04-01T22:32:05.992 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 183/220 2024-04-01T22:32:05.992 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 184/220 2024-04-01T22:32:05.992 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 185/220 2024-04-01T22:32:05.992 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 186/220 2024-04-01T22:32:05.992 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : acl-2.3.1-4.el9.x86_64 187/220 2024-04-01T22:32:05.992 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : acl-2.3.1-3.el9.x86_64 188/220 2024-04-01T22:32:05.993 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 189/220 2024-04-01T22:32:05.993 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 190/220 2024-04-01T22:32:05.993 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 191/220 2024-04-01T22:32:05.993 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 192/220 2024-04-01T22:32:05.993 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 193/220 2024-04-01T22:32:05.993 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 194/220 2024-04-01T22:32:05.993 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 195/220 2024-04-01T22:32:05.993 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 196/220 2024-04-01T22:32:05.993 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 197/220 2024-04-01T22:32:05.993 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 198/220 2024-04-01T22:32:05.993 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 199/220 2024-04-01T22:32:05.993 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 200/220 2024-04-01T22:32:05.993 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 201/220 2024-04-01T22:32:05.993 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 202/220 2024-04-01T22:32:05.994 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 203/220 2024-04-01T22:32:05.994 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 204/220 2024-04-01T22:32:05.994 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 205/220 2024-04-01T22:32:05.994 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 206/220 2024-04-01T22:32:05.994 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 207/220 2024-04-01T22:32:05.994 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 208/220 2024-04-01T22:32:05.994 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 209/220 2024-04-01T22:32:05.994 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 210/220 2024-04-01T22:32:05.994 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 211/220 2024-04-01T22:32:05.994 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 212/220 2024-04-01T22:32:05.994 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 213/220 2024-04-01T22:32:05.994 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 214/220 2024-04-01T22:32:05.994 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 215/220 2024-04-01T22:32:05.994 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 216/220 2024-04-01T22:32:05.995 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 217/220 2024-04-01T22:32:05.995 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 218/220 2024-04-01T22:32:05.995 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 219/220 2024-04-01T22:32:08.831 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 220/220 2024-04-01T22:32:08.831 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:32:08.831 INFO:teuthology.orchestra.run.smithi181.stdout:Upgraded: 2024-04-01T22:32:08.831 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-04-01T22:32:08.831 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-04-01T22:32:08.831 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-04-01T22:32:08.831 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-04-01T22:32:08.831 INFO:teuthology.orchestra.run.smithi181.stdout: acl-2.3.1-4.el9.x86_64 2024-04-01T22:32:08.832 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-04-01T22:32:08.832 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-04-01T22:32:08.832 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-04-01T22:32:08.832 INFO:teuthology.orchestra.run.smithi181.stdout: libacl-2.3.1-4.el9.x86_64 2024-04-01T22:32:08.832 INFO:teuthology.orchestra.run.smithi181.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-04-01T22:32:08.832 INFO:teuthology.orchestra.run.smithi181.stdout: libblkid-2.37.4-18.el9.x86_64 2024-04-01T22:32:08.832 INFO:teuthology.orchestra.run.smithi181.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-04-01T22:32:08.832 INFO:teuthology.orchestra.run.smithi181.stdout: libmount-2.37.4-18.el9.x86_64 2024-04-01T22:32:08.832 INFO:teuthology.orchestra.run.smithi181.stdout: librados2-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.832 INFO:teuthology.orchestra.run.smithi181.stdout: librbd1-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.832 INFO:teuthology.orchestra.run.smithi181.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-04-01T22:32:08.832 INFO:teuthology.orchestra.run.smithi181.stdout: libuuid-2.37.4-18.el9.x86_64 2024-04-01T22:32:08.832 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-04-01T22:32:08.833 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-04-01T22:32:08.833 INFO:teuthology.orchestra.run.smithi181.stdout: util-linux-2.37.4-18.el9.x86_64 2024-04-01T22:32:08.833 INFO:teuthology.orchestra.run.smithi181.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-04-01T22:32:08.833 INFO:teuthology.orchestra.run.smithi181.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-04-01T22:32:08.833 INFO:teuthology.orchestra.run.smithi181.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-04-01T22:32:08.833 INFO:teuthology.orchestra.run.smithi181.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-04-01T22:32:08.833 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-04-01T22:32:08.833 INFO:teuthology.orchestra.run.smithi181.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-01T22:32:08.833 INFO:teuthology.orchestra.run.smithi181.stdout: automake-1.16.2-8.el9.noarch 2024-04-01T22:32:08.833 INFO:teuthology.orchestra.run.smithi181.stdout: bison-3.7.4-5.el9.x86_64 2024-04-01T22:32:08.833 INFO:teuthology.orchestra.run.smithi181.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-01T22:32:08.833 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.833 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-base-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.833 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-base-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.834 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-common-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.834 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-common-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.834 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.834 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-fuse-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.834 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-fuse-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.834 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-grafana-dashboards-2:19.0.0-1992.g1f941761.el9.noarch 2024-04-01T22:32:08.834 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-immutable-object-cache-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.834 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-immutable-object-cache-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.834 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mds-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.834 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mds-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.834 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.834 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-cephadm-2:19.0.0-1992.g1f941761.el9.noarch 2024-04-01T22:32:08.834 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-dashboard-2:19.0.0-1992.g1f941761.el9.noarch 2024-04-01T22:32:08.835 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.835 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1992.g1f941761.el9.noarch 2024-04-01T22:32:08.835 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-modules-core-2:19.0.0-1992.g1f941761.el9.noarch 2024-04-01T22:32:08.835 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-rook-2:19.0.0-1992.g1f941761.el9.noarch 2024-04-01T22:32:08.835 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mon-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.835 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mon-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.835 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-osd-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.835 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-osd-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.835 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-prometheus-alerts-2:19.0.0-1992.g1f941761.el9.noarch 2024-04-01T22:32:08.835 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-radosgw-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.835 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-radosgw-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.835 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-selinux-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.835 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-test-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.835 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-test-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.836 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-volume-2:19.0.0-1992.g1f941761.el9.noarch 2024-04-01T22:32:08.836 INFO:teuthology.orchestra.run.smithi181.stdout: cephadm-2:19.0.0-1992.g1f941761.el9.noarch 2024-04-01T22:32:08.836 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-mirror-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.836 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-shell-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.836 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-top-2:19.0.0-1992.g1f941761.el9.noarch 2024-04-01T22:32:08.836 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-01T22:32:08.836 INFO:teuthology.orchestra.run.smithi181.stdout: flex-2.6.4-9.el9.x86_64 2024-04-01T22:32:08.836 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-01T22:32:08.836 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-01T22:32:08.836 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-01T22:32:08.836 INFO:teuthology.orchestra.run.smithi181.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-01T22:32:08.836 INFO:teuthology.orchestra.run.smithi181.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-01T22:32:08.836 INFO:teuthology.orchestra.run.smithi181.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-01T22:32:08.836 INFO:teuthology.orchestra.run.smithi181.stdout: jq-1.6-16.el9.x86_64 2024-04-01T22:32:08.836 INFO:teuthology.orchestra.run.smithi181.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-01T22:32:08.836 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-01T22:32:08.837 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-01T22:32:08.837 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs-devel-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.837 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs2-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.837 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs2-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.837 INFO:teuthology.orchestra.run.smithi181.stdout: libcephsqlite-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.837 INFO:teuthology.orchestra.run.smithi181.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-01T22:32:08.837 INFO:teuthology.orchestra.run.smithi181.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-01T22:32:08.837 INFO:teuthology.orchestra.run.smithi181.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-01T22:32:08.837 INFO:teuthology.orchestra.run.smithi181.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-01T22:32:08.837 INFO:teuthology.orchestra.run.smithi181.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-01T22:32:08.837 INFO:teuthology.orchestra.run.smithi181.stdout: librados-devel-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.837 INFO:teuthology.orchestra.run.smithi181.stdout: librados-devel-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.837 INFO:teuthology.orchestra.run.smithi181.stdout: librados2-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.837 INFO:teuthology.orchestra.run.smithi181.stdout: libradosstriper1-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.838 INFO:teuthology.orchestra.run.smithi181.stdout: librbd1-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.838 INFO:teuthology.orchestra.run.smithi181.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-01T22:32:08.838 INFO:teuthology.orchestra.run.smithi181.stdout: librgw2-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.838 INFO:teuthology.orchestra.run.smithi181.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-01T22:32:08.838 INFO:teuthology.orchestra.run.smithi181.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-01T22:32:08.838 INFO:teuthology.orchestra.run.smithi181.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-01T22:32:08.838 INFO:teuthology.orchestra.run.smithi181.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-01T22:32:08.838 INFO:teuthology.orchestra.run.smithi181.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-01T22:32:08.838 INFO:teuthology.orchestra.run.smithi181.stdout: lua-5.4.4-4.el9.x86_64 2024-04-01T22:32:08.838 INFO:teuthology.orchestra.run.smithi181.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-01T22:32:08.838 INFO:teuthology.orchestra.run.smithi181.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-01T22:32:08.838 INFO:teuthology.orchestra.run.smithi181.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-01T22:32:08.838 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-01T22:32:08.838 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-01T22:32:08.839 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-01T22:32:08.839 INFO:teuthology.orchestra.run.smithi181.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-01T22:32:08.839 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-13.14-1.el9.x86_64 2024-04-01T22:32:08.839 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-01T22:32:08.839 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-01T22:32:08.839 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-01T22:32:08.839 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-01T22:32:08.839 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-01T22:32:08.839 INFO:teuthology.orchestra.run.smithi181.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-01T22:32:08.839 INFO:teuthology.orchestra.run.smithi181.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-01T22:32:08.839 INFO:teuthology.orchestra.run.smithi181.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-01T22:32:08.839 INFO:teuthology.orchestra.run.smithi181.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-01T22:32:08.839 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-01T22:32:08.839 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-argparse-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.839 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-common-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.839 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cephfs-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.840 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cephfs-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.840 INFO:teuthology.orchestra.run.smithi181.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-01T22:32:08.840 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-01T22:32:08.840 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-01T22:32:08.840 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-01T22:32:08.840 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-01T22:32:08.840 INFO:teuthology.orchestra.run.smithi181.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-01T22:32:08.840 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-01T22:32:08.840 INFO:teuthology.orchestra.run.smithi181.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-01T22:32:08.840 INFO:teuthology.orchestra.run.smithi181.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-01T22:32:08.840 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-01T22:32:08.840 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-01T22:32:08.840 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-01T22:32:08.840 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-01T22:32:08.840 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-01T22:32:08.841 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-01T22:32:08.841 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-01T22:32:08.841 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-01T22:32:08.841 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-01T22:32:08.841 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-01T22:32:08.841 INFO:teuthology.orchestra.run.smithi181.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-01T22:32:08.841 INFO:teuthology.orchestra.run.smithi181.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-01T22:32:08.841 INFO:teuthology.orchestra.run.smithi181.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-01T22:32:08.841 INFO:teuthology.orchestra.run.smithi181.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-01T22:32:08.841 INFO:teuthology.orchestra.run.smithi181.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-01T22:32:08.841 INFO:teuthology.orchestra.run.smithi181.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-01T22:32:08.841 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-01T22:32:08.841 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-01T22:32:08.841 INFO:teuthology.orchestra.run.smithi181.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-01T22:32:08.842 INFO:teuthology.orchestra.run.smithi181.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-01T22:32:08.842 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-01T22:32:08.842 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ply-3.11-14.el9.noarch 2024-04-01T22:32:08.842 INFO:teuthology.orchestra.run.smithi181.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-01T22:32:08.842 INFO:teuthology.orchestra.run.smithi181.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-01T22:32:08.842 INFO:teuthology.orchestra.run.smithi181.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-01T22:32:08.842 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-01T22:32:08.842 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-01T22:32:08.842 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-01T22:32:08.842 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-01T22:32:08.842 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-01T22:32:08.842 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-01T22:32:08.842 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rados-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.842 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rados-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.843 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rbd-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.843 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rbd-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.843 INFO:teuthology.orchestra.run.smithi181.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-01T22:32:08.843 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-01T22:32:08.843 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-01T22:32:08.843 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rgw-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.843 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rgw-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.843 INFO:teuthology.orchestra.run.smithi181.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-01T22:32:08.843 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-01T22:32:08.843 INFO:teuthology.orchestra.run.smithi181.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-01T22:32:08.843 INFO:teuthology.orchestra.run.smithi181.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-01T22:32:08.843 INFO:teuthology.orchestra.run.smithi181.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-01T22:32:08.843 INFO:teuthology.orchestra.run.smithi181.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-01T22:32:08.843 INFO:teuthology.orchestra.run.smithi181.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-01T22:32:08.843 INFO:teuthology.orchestra.run.smithi181.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-01T22:32:08.844 INFO:teuthology.orchestra.run.smithi181.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-01T22:32:08.844 INFO:teuthology.orchestra.run.smithi181.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-01T22:32:08.844 INFO:teuthology.orchestra.run.smithi181.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-01T22:32:08.844 INFO:teuthology.orchestra.run.smithi181.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-01T22:32:08.844 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-01T22:32:08.844 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-01T22:32:08.844 INFO:teuthology.orchestra.run.smithi181.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-01T22:32:08.844 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-fuse-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.844 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-fuse-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.844 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-mirror-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.844 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-mirror-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.844 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-nbd-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.844 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-nbd-debuginfo-2:19.0.0-1992.g1f941761.el9.x86_64 2024-04-01T22:32:08.844 INFO:teuthology.orchestra.run.smithi181.stdout: re2-1:20211101-3.el9.x86_64 2024-04-01T22:32:08.844 INFO:teuthology.orchestra.run.smithi181.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-01T22:32:08.845 INFO:teuthology.orchestra.run.smithi181.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-01T22:32:08.845 INFO:teuthology.orchestra.run.smithi181.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-01T22:32:08.845 INFO:teuthology.orchestra.run.smithi181.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-01T22:32:08.845 INFO:teuthology.orchestra.run.smithi181.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-01T22:32:08.845 INFO:teuthology.orchestra.run.smithi181.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-04-01T22:32:08.845 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:32:08.845 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-04-01T22:32:09.510 DEBUG:teuthology.parallel:result is None 2024-04-01T22:32:09.511 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1f941761d08add4455f209f0f2e36f8151f834a0 2024-04-01T22:32:09.837 DEBUG:teuthology.orchestra.run.smithi047:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-01T22:32:09.863 INFO:teuthology.orchestra.run.smithi047.stdout:19.0.0-1992.g1f941761.el9 2024-04-01T22:32:09.864 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1992.g1f941761.el9 2024-04-01T22:32:09.864 INFO:teuthology.task.install:The correct ceph version 19.0.0-1992.g1f941761 is installed. 2024-04-01T22:32:09.866 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1f941761d08add4455f209f0f2e36f8151f834a0 2024-04-01T22:32:10.015 DEBUG:teuthology.orchestra.run.smithi181:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-01T22:32:10.038 INFO:teuthology.orchestra.run.smithi181.stdout:19.0.0-1992.g1f941761.el9 2024-04-01T22:32:10.038 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1992.g1f941761.el9 2024-04-01T22:32:10.038 INFO:teuthology.task.install:The correct ceph version 19.0.0-1992.g1f941761 is installed. 2024-04-01T22:32:10.040 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-01T22:32:10.040 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-01T22:32:10.040 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-01T22:32:10.075 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-04-01T22:32:10.075 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-01T22:32:10.109 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-01T22:32:10.109 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-01T22:32:10.109 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/daemon-helper 2024-04-01T22:32:10.147 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-01T22:32:10.217 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-04-01T22:32:10.217 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/daemon-helper 2024-04-01T22:32:10.245 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-01T22:32:10.312 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-01T22:32:10.313 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-01T22:32:10.313 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-01T22:32:10.343 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-01T22:32:10.412 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-04-01T22:32:10.412 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-01T22:32:10.439 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-01T22:32:10.506 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-01T22:32:10.506 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-01T22:32:10.507 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/stdin-killer 2024-04-01T22:32:10.533 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-01T22:32:10.600 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-04-01T22:32:10.600 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/stdin-killer 2024-04-01T22:32:10.627 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-01T22:32:10.694 INFO:teuthology.run_tasks:Running task ceph... 2024-04-01T22:32:10.777 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-01T22:32:10.777 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 777 /var/log/ceph 2024-04-01T22:32:10.779 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 777 /var/log/ceph 2024-04-01T22:32:10.807 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-01T22:32:10.807 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-01T22:32:10.850 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-01T22:32:10.876 INFO:tasks.ceph:Creating extra log directories... 2024-04-01T22:32:10.877 DEBUG:teuthology.orchestra.run.smithi047:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-01T22:32:10.918 DEBUG:teuthology.orchestra.run.smithi181:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-01T22:32:10.979 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-01T22:32:10.979 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-01T22:32:10.979 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-01T22:32:10.979 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-01T22:32:10.979 DEBUG:teuthology.orchestra.run.smithi047:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-01T22:32:10.997 DEBUG:teuthology.orchestra.run.smithi047:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-01T22:32:11.123 DEBUG:teuthology.orchestra.run.smithi047:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-01T22:32:11.149 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-04-01T22:32:11.150 DEBUG:teuthology.orchestra.run.smithi181:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-01T22:32:11.165 DEBUG:teuthology.orchestra.run.smithi181:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-01T22:32:11.296 DEBUG:teuthology.orchestra.run.smithi181:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-01T22:32:11.328 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-01T22:32:11.328 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-01T22:32:11.328 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2024-04-01_20:57:46-fs-wip-yuri3-testing-2024-04-01-0837-squid-distro-default-smithi/7634387', 'branch': 'wip-yuri3-testing-2024-04-01-0837-squid', 'description': 'fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/valgrind}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7634387', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'yuriw-2024-04-01_20:57:46-fs-wip-yuri3-testing-2024-04-01-0837-squid-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri3-testing-2024-04-01-0837-squid'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': '1f941761d08add4455f209f0f2e36f8151f834a0', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'ceph-fuse': {'client.0': {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '1f941761d08add4455f209f0f2e36f8151f834a0'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri3-testing-2024-04-01-0837-squid', 'sha1': '1f941761d08add4455f209f0f2e36f8151f834a0'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 99, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 500, 'sha1': '1f941761d08add4455f209f0f2e36f8151f834a0', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'fs', 'suite_branch': 'wip-yuri3-testing-2024-04-01-0837-squid', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_1f941761d08add4455f209f0f2e36f8151f834a0/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '1f941761d08add4455f209f0f2e36f8151f834a0', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi047.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMxDHLlPWlYJaO3zRBr2g98N5YqYQMbgWhje3WTb7zhJ1jwfSQ19t+zHVsIEorEGvl1YNmYD4PcvL6Og9xk4x1E=', 'smithi181.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEJ+vIOtDQ5Sgj8BzKFhXhOLFFDHXs31EIsIGEmbUwBhHr8eCoC2dLps6SpnG/3V91z6oSd2b4qjoqB+QvrJJrM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': '1f941761d08add4455f209f0f2e36f8151f834a0'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': '1f941761d08add4455f209f0f2e36f8151f834a0', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}, 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/dbench.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-04-01_20:57:46', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-01T22:32:11.329 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-01T22:32:11.331 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-01T22:32:11.377 DEBUG:teuthology.orchestra.run.smithi047:> sudo install -d -m0777 -- /var/run/ceph 2024-04-01T22:32:11.385 DEBUG:teuthology.orchestra.run.smithi181:> sudo install -d -m0777 -- /var/run/ceph 2024-04-01T22:32:11.443 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-01T22:32:11.443 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/scratch_devs of=/dev/stdout 2024-04-01T22:32:11.465 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-01T22:32:11.465 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_1 2024-04-01T22:32:11.519 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-01T22:32:11.520 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T22:32:11.520 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-04-01T22:32:11.520 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T22:32:11.520 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T22:32:11.520 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-04-01 22:31:19.087246896 +0000 2024-04-01T22:32:11.520 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-04-01 22:22:20.846813814 +0000 2024-04-01T22:32:11.520 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-04-01 22:22:20.846813814 +0000 2024-04-01T22:32:11.520 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-04-01 22:22:20.846813814 +0000 2024-04-01T22:32:11.520 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-01T22:32:11.584 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-01T22:32:11.584 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-01T22:32:11.584 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 8.9533e-05 s, 5.7 MB/s 2024-04-01T22:32:11.586 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-01T22:32:11.641 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_2 2024-04-01T22:32:11.696 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-01T22:32:11.696 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T22:32:11.696 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-04-01T22:32:11.696 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T22:32:11.696 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T22:32:11.696 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-04-01 22:31:19.088246875 +0000 2024-04-01T22:32:11.696 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-04-01 22:22:21.187806634 +0000 2024-04-01T22:32:11.696 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-04-01 22:22:21.187806634 +0000 2024-04-01T22:32:11.696 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-04-01 22:22:21.187806634 +0000 2024-04-01T22:32:11.696 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-01T22:32:11.761 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-01T22:32:11.761 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-01T22:32:11.762 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 8.012e-05 s, 6.4 MB/s 2024-04-01T22:32:11.763 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-01T22:32:11.817 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_3 2024-04-01T22:32:11.871 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-01T22:32:11.871 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T22:32:11.872 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-01T22:32:11.872 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T22:32:11.872 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T22:32:11.872 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-04-01 22:31:19.088246875 +0000 2024-04-01T22:32:11.872 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-04-01 22:22:21.521799601 +0000 2024-04-01T22:32:11.872 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-04-01 22:22:21.521799601 +0000 2024-04-01T22:32:11.872 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-04-01 22:22:21.521799601 +0000 2024-04-01T22:32:11.872 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-01T22:32:11.936 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-01T22:32:11.936 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-01T22:32:11.936 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 9.3604e-05 s, 5.5 MB/s 2024-04-01T22:32:11.937 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-01T22:32:11.992 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_4 2024-04-01T22:32:12.046 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-01T22:32:12.047 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T22:32:12.047 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-04-01T22:32:12.047 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T22:32:12.047 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T22:32:12.047 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-04-01 22:31:19.089246854 +0000 2024-04-01T22:32:12.047 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-04-01 22:22:21.856792547 +0000 2024-04-01T22:32:12.047 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-04-01 22:22:21.856792547 +0000 2024-04-01T22:32:12.047 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-04-01 22:22:21.856792547 +0000 2024-04-01T22:32:12.047 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-01T22:32:12.111 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-01T22:32:12.111 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-01T22:32:12.111 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000106625 s, 4.8 MB/s 2024-04-01T22:32:12.112 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-01T22:32:12.167 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-01T22:32:12.167 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-04-01T22:32:12.167 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/scratch_devs of=/dev/stdout 2024-04-01T22:32:12.185 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-01T22:32:12.186 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_1 2024-04-01T22:32:12.243 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-01T22:32:12.243 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T22:32:12.243 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-04-01T22:32:12.243 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T22:32:12.243 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T22:32:12.243 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-04-01 22:31:56.946354374 +0000 2024-04-01T22:32:12.243 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-04-01 22:22:16.207875796 +0000 2024-04-01T22:32:12.243 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-04-01 22:22:16.207875796 +0000 2024-04-01T22:32:12.243 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-04-01 22:22:16.207875796 +0000 2024-04-01T22:32:12.244 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-01T22:32:12.311 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-04-01T22:32:12.311 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-04-01T22:32:12.311 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000228352 s, 2.2 MB/s 2024-04-01T22:32:12.313 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-01T22:32:12.371 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_2 2024-04-01T22:32:12.427 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-01T22:32:12.427 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T22:32:12.427 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-04-01T22:32:12.427 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T22:32:12.427 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T22:32:12.428 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-04-01 22:31:56.946354374 +0000 2024-04-01T22:32:12.428 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-04-01 22:22:16.557869540 +0000 2024-04-01T22:32:12.428 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-04-01 22:22:16.557869540 +0000 2024-04-01T22:32:12.428 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-04-01 22:22:16.557869540 +0000 2024-04-01T22:32:12.428 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-01T22:32:12.494 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-04-01T22:32:12.494 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-04-01T22:32:12.494 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000191056 s, 2.7 MB/s 2024-04-01T22:32:12.496 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-01T22:32:12.552 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_3 2024-04-01T22:32:12.608 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-01T22:32:12.608 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T22:32:12.609 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-04-01T22:32:12.609 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T22:32:12.609 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T22:32:12.609 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-04-01 22:31:56.946354374 +0000 2024-04-01T22:32:12.609 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-04-01 22:22:16.908863270 +0000 2024-04-01T22:32:12.609 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-04-01 22:22:16.908863270 +0000 2024-04-01T22:32:12.609 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-04-01 22:22:16.908863270 +0000 2024-04-01T22:32:12.609 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-01T22:32:12.675 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-04-01T22:32:12.675 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-04-01T22:32:12.675 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000179141 s, 2.9 MB/s 2024-04-01T22:32:12.677 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-01T22:32:12.732 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_4 2024-04-01T22:32:12.788 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-01T22:32:12.788 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T22:32:12.788 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-04-01T22:32:12.788 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T22:32:12.788 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T22:32:12.788 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-04-01 22:31:56.947354356 +0000 2024-04-01T22:32:12.788 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-04-01 22:22:17.434853884 +0000 2024-04-01T22:32:12.788 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-04-01 22:22:17.434853884 +0000 2024-04-01T22:32:12.788 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-04-01 22:22:17.434853884 +0000 2024-04-01T22:32:12.789 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-01T22:32:12.854 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-04-01T22:32:12.855 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-04-01T22:32:12.855 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000223891 s, 2.3 MB/s 2024-04-01T22:32:12.856 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-01T22:32:12.911 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-01T22:32:12.911 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi047.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi181.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-01T22:32:12.911 INFO:tasks.ceph:Generating config... 2024-04-01T22:32:12.913 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-01T22:32:12.913 INFO:tasks.ceph:[client] debug client = 20 2024-04-01T22:32:12.913 INFO:tasks.ceph:[client] debug ms = 1 2024-04-01T22:32:12.913 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-01T22:32:12.913 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-01T22:32:12.913 INFO:tasks.ceph:[global] mds beacon grace = 60 2024-04-01T22:32:12.913 INFO:tasks.ceph:[global] mds heartbeat grace = 60 2024-04-01T22:32:12.913 INFO:tasks.ceph:[global] osd heartbeat grace = 60 2024-04-01T22:32:12.913 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-01T22:32:12.913 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-01T22:32:12.913 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-01T22:32:12.913 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-01T22:32:12.913 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-01T22:32:12.913 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-01T22:32:12.914 INFO:tasks.ceph:[mds] mds valgrind exit = True 2024-04-01T22:32:12.914 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-01T22:32:12.914 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-01T22:32:12.914 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-01T22:32:12.914 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-01T22:32:12.914 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-01T22:32:12.914 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-01T22:32:12.914 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-01T22:32:12.914 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-01T22:32:12.914 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-01T22:32:12.914 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-01T22:32:12.914 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-01T22:32:12.914 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-01T22:32:12.914 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-04-01T22:32:12.915 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-01T22:32:12.915 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-04-01T22:32:12.915 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-01T22:32:12.915 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-01T22:32:12.915 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-01T22:32:12.915 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-01T22:32:12.915 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-01T22:32:12.915 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-01T22:32:12.915 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-01T22:32:12.915 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-01T22:32:12.915 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-01T22:32:12.915 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-01T22:32:12.915 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-04-01T22:32:12.915 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-01T22:32:12.915 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-01T22:32:12.916 INFO:tasks.ceph:Setting up mon.a... 2024-04-01T22:32:12.916 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-01T22:32:12.970 INFO:teuthology.orchestra.run.smithi047.stdout:creating /etc/ceph/ceph.keyring 2024-04-01T22:32:12.972 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-01T22:32:13.018 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-01T22:32:13.045 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.47'), ('mon.b', '172.21.15.181'), ('mon.c', '[v2:172.21.15.181:3301,v1:172.21.15.181:6790]')] 2024-04-01T22:32:13.046 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.47,172.21.15.181,[v2:172.21.15.181:3301,v1:172.21.15.181:6790]', 'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-01T22:32:13.047 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-01T22:32:13.047 DEBUG:teuthology.orchestra.run.smithi047:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-01T22:32:13.100 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.47 --add b 172.21.15.181 --addv c '[v2:172.21.15.181:3301,v1:172.21.15.181:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-01T22:32:13.187 INFO:teuthology.orchestra.run.smithi047.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-01T22:32:13.187 INFO:teuthology.orchestra.run.smithi047.stdout:monmaptool: generated fsid a6998a48-38bc-4e42-b0d9-04f2fb5c3c87 2024-04-01T22:32:13.187 INFO:teuthology.orchestra.run.smithi047.stdout:setting min_mon_release = quincy 2024-04-01T22:32:13.187 INFO:teuthology.orchestra.run.smithi047.stdout:epoch 0 2024-04-01T22:32:13.187 INFO:teuthology.orchestra.run.smithi047.stdout:fsid a6998a48-38bc-4e42-b0d9-04f2fb5c3c87 2024-04-01T22:32:13.187 INFO:teuthology.orchestra.run.smithi047.stdout:last_changed 2024-04-01T22:32:13.188582+0000 2024-04-01T22:32:13.187 INFO:teuthology.orchestra.run.smithi047.stdout:created 2024-04-01T22:32:13.188582+0000 2024-04-01T22:32:13.188 INFO:teuthology.orchestra.run.smithi047.stdout:min_mon_release 17 (quincy) 2024-04-01T22:32:13.188 INFO:teuthology.orchestra.run.smithi047.stdout:election_strategy: 1 2024-04-01T22:32:13.188 INFO:teuthology.orchestra.run.smithi047.stdout:0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-04-01T22:32:13.188 INFO:teuthology.orchestra.run.smithi047.stdout:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-04-01T22:32:13.188 INFO:teuthology.orchestra.run.smithi047.stdout:2: [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] mon.c 2024-04-01T22:32:13.188 INFO:teuthology.orchestra.run.smithi047.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-01T22:32:13.189 DEBUG:teuthology.orchestra.run.smithi047:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-01T22:32:13.205 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID a6998a48-38bc-4e42-b0d9-04f2fb5c3c87... 2024-04-01T22:32:13.206 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-01T22:32:13.247 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-01T22:32:13.295 INFO:teuthology.orchestra.run.smithi047.stdout:[global] 2024-04-01T22:32:13.295 INFO:teuthology.orchestra.run.smithi047.stdout: chdir = "" 2024-04-01T22:32:13.295 INFO:teuthology.orchestra.run.smithi047.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-01T22:32:13.295 INFO:teuthology.orchestra.run.smithi047.stdout: auth supported = cephx 2024-04-01T22:32:13.295 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:32:13.295 INFO:teuthology.orchestra.run.smithi047.stdout: filestore xattr use omap = true 2024-04-01T22:32:13.295 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:32:13.296 INFO:teuthology.orchestra.run.smithi047.stdout: mon clock drift allowed = 1.000 2024-04-01T22:32:13.296 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:32:13.296 INFO:teuthology.orchestra.run.smithi047.stdout: osd crush chooseleaf type = 0 2024-04-01T22:32:13.296 INFO:teuthology.orchestra.run.smithi047.stdout: auth debug = true 2024-04-01T22:32:13.296 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:32:13.296 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on old message = true 2024-04-01T22:32:13.296 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on bug = true 2024-04-01T22:32:13.296 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:32:13.296 INFO:teuthology.orchestra.run.smithi047.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-01T22:32:13.296 INFO:teuthology.orchestra.run.smithi047.stdout: mon pg warn max object skew = 0 2024-04-01T22:32:13.296 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:32:13.296 INFO:teuthology.orchestra.run.smithi047.stdout: # disable pg_autoscaler by default for new pools 2024-04-01T22:32:13.296 INFO:teuthology.orchestra.run.smithi047.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-01T22:32:13.296 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:32:13.296 INFO:teuthology.orchestra.run.smithi047.stdout: osd pool default size = 2 2024-04-01T22:32:13.296 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:32:13.297 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd allow primary affinity = true 2024-04-01T22:32:13.297 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd allow pg remap = true 2024-04-01T22:32:13.297 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on legacy crush tunables = false 2024-04-01T22:32:13.297 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on crush straw calc version zero = false 2024-04-01T22:32:13.297 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on no sortbitwise = false 2024-04-01T22:32:13.297 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on osd down out interval zero = false 2024-04-01T22:32:13.297 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on too few osds = false 2024-04-01T22:32:13.297 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-01T22:32:13.297 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-01T22:32:13.297 INFO:teuthology.orchestra.run.smithi047.stdout: mon_allow_pool_size_one = true 2024-04-01T22:32:13.297 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:32:13.297 INFO:teuthology.orchestra.run.smithi047.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-01T22:32:13.297 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:32:13.297 INFO:teuthology.orchestra.run.smithi047.stdout: osd default data pool replay window = 5 2024-04-01T22:32:13.297 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:32:13.298 INFO:teuthology.orchestra.run.smithi047.stdout: mon allow pool delete = true 2024-04-01T22:32:13.298 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:32:13.298 INFO:teuthology.orchestra.run.smithi047.stdout: mon cluster log file level = debug 2024-04-01T22:32:13.298 INFO:teuthology.orchestra.run.smithi047.stdout: debug asserts on shutdown = true 2024-04-01T22:32:13.298 INFO:teuthology.orchestra.run.smithi047.stdout: mon health detail to clog = false 2024-04-01T22:32:13.298 INFO:teuthology.orchestra.run.smithi047.stdout: mon host = "172.21.15.47,172.21.15.181,[v2:172.21.15.181:3301,v1:172.21.15.181:6790]" 2024-04-01T22:32:13.298 INFO:teuthology.orchestra.run.smithi047.stdout: mds beacon grace = 60 2024-04-01T22:32:13.298 INFO:teuthology.orchestra.run.smithi047.stdout: mds heartbeat grace = 60 2024-04-01T22:32:13.298 INFO:teuthology.orchestra.run.smithi047.stdout: osd heartbeat grace = 60 2024-04-01T22:32:13.298 INFO:teuthology.orchestra.run.smithi047.stdout: fsid = a6998a48-38bc-4e42-b0d9-04f2fb5c3c87 2024-04-01T22:32:13.298 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:32:13.298 INFO:teuthology.orchestra.run.smithi047.stdout:[osd] 2024-04-01T22:32:13.298 INFO:teuthology.orchestra.run.smithi047.stdout: osd journal size = 100 2024-04-01T22:32:13.298 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:32:13.298 INFO:teuthology.orchestra.run.smithi047.stdout: osd scrub load threshold = 5.0 2024-04-01T22:32:13.299 INFO:teuthology.orchestra.run.smithi047.stdout: osd scrub max interval = 600 2024-04-01T22:32:13.299 INFO:teuthology.orchestra.run.smithi047.stdout: osd mclock profile = high_recovery_ops 2024-04-01T22:32:13.299 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:32:13.299 INFO:teuthology.orchestra.run.smithi047.stdout: osd recover clone overlap = true 2024-04-01T22:32:13.299 INFO:teuthology.orchestra.run.smithi047.stdout: osd recovery max chunk = 1048576 2024-04-01T22:32:13.299 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:32:13.299 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug shutdown = true 2024-04-01T22:32:13.299 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug op order = true 2024-04-01T22:32:13.299 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug verify stray on activate = true 2024-04-01T22:32:13.299 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug trim objects = true 2024-04-01T22:32:13.299 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:32:13.299 INFO:teuthology.orchestra.run.smithi047.stdout: osd open classes on start = true 2024-04-01T22:32:13.299 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug pg log writeout = true 2024-04-01T22:32:13.299 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:32:13.300 INFO:teuthology.orchestra.run.smithi047.stdout: osd deep scrub update digest min age = 30 2024-04-01T22:32:13.300 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:32:13.300 INFO:teuthology.orchestra.run.smithi047.stdout: osd map max advance = 10 2024-04-01T22:32:13.300 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:32:13.300 INFO:teuthology.orchestra.run.smithi047.stdout: journal zero on create = true 2024-04-01T22:32:13.300 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:32:13.300 INFO:teuthology.orchestra.run.smithi047.stdout: filestore ondisk finisher threads = 3 2024-04-01T22:32:13.300 INFO:teuthology.orchestra.run.smithi047.stdout: filestore apply finisher threads = 3 2024-04-01T22:32:13.300 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:32:13.300 INFO:teuthology.orchestra.run.smithi047.stdout: bdev debug aio = true 2024-04-01T22:32:13.300 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug misdirected ops = true 2024-04-01T22:32:13.300 INFO:teuthology.orchestra.run.smithi047.stdout: bluestore block size = 96636764160 2024-04-01T22:32:13.300 INFO:teuthology.orchestra.run.smithi047.stdout: bluestore compression mode = aggressive 2024-04-01T22:32:13.300 INFO:teuthology.orchestra.run.smithi047.stdout: bluestore fsck on mount = True 2024-04-01T22:32:13.300 INFO:teuthology.orchestra.run.smithi047.stdout: debug bluefs = 20 2024-04-01T22:32:13.300 INFO:teuthology.orchestra.run.smithi047.stdout: debug bluestore = 20 2024-04-01T22:32:13.300 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-04-01T22:32:13.301 INFO:teuthology.orchestra.run.smithi047.stdout: debug osd = 20 2024-04-01T22:32:13.301 INFO:teuthology.orchestra.run.smithi047.stdout: debug rocksdb = 10 2024-04-01T22:32:13.301 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd backfillfull_ratio = 0.85 2024-04-01T22:32:13.301 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd full ratio = 0.9 2024-04-01T22:32:13.301 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd nearfull ratio = 0.8 2024-04-01T22:32:13.301 INFO:teuthology.orchestra.run.smithi047.stdout: osd failsafe full ratio = 0.95 2024-04-01T22:32:13.301 INFO:teuthology.orchestra.run.smithi047.stdout: osd fast shutdown = False 2024-04-01T22:32:13.301 INFO:teuthology.orchestra.run.smithi047.stdout: osd objectstore = bluestore 2024-04-01T22:32:13.301 INFO:teuthology.orchestra.run.smithi047.stdout: osd op complaint time = 180 2024-04-01T22:32:13.301 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:32:13.301 INFO:teuthology.orchestra.run.smithi047.stdout:[mgr] 2024-04-01T22:32:13.301 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-04-01T22:32:13.301 INFO:teuthology.orchestra.run.smithi047.stdout: debug mgr = 20 2024-04-01T22:32:13.301 INFO:teuthology.orchestra.run.smithi047.stdout: debug mon = 20 2024-04-01T22:32:13.301 INFO:teuthology.orchestra.run.smithi047.stdout: debug auth = 20 2024-04-01T22:32:13.301 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min pgs per osd = 4 2024-04-01T22:32:13.302 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min bytes per osd = 10 2024-04-01T22:32:13.302 INFO:teuthology.orchestra.run.smithi047.stdout: mgr/telemetry/nag = false 2024-04-01T22:32:13.302 INFO:teuthology.orchestra.run.smithi047.stdout: debug client = 20 2024-04-01T22:32:13.302 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:32:13.302 INFO:teuthology.orchestra.run.smithi047.stdout:[mon] 2024-04-01T22:32:13.302 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-04-01T22:32:13.302 INFO:teuthology.orchestra.run.smithi047.stdout: debug mon = 20 2024-04-01T22:32:13.302 INFO:teuthology.orchestra.run.smithi047.stdout: debug paxos = 20 2024-04-01T22:32:13.302 INFO:teuthology.orchestra.run.smithi047.stdout: debug auth = 20 2024-04-01T22:32:13.302 INFO:teuthology.orchestra.run.smithi047.stdout: mon data avail warn = 5 2024-04-01T22:32:13.302 INFO:teuthology.orchestra.run.smithi047.stdout: mon mgr mkfs grace = 240 2024-04-01T22:32:13.302 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min pgs per osd = 4 2024-04-01T22:32:13.302 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd reporter subtree level = osd 2024-04-01T22:32:13.302 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd prime pg temp = true 2024-04-01T22:32:13.302 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min bytes per osd = 10 2024-04-01T22:32:13.303 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:32:13.303 INFO:teuthology.orchestra.run.smithi047.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-01T22:32:13.303 INFO:teuthology.orchestra.run.smithi047.stdout: auth mon ticket ttl = 660 # 11m 2024-04-01T22:32:13.303 INFO:teuthology.orchestra.run.smithi047.stdout: auth service ticket ttl = 240 # 4m 2024-04-01T22:32:13.303 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:32:13.303 INFO:teuthology.orchestra.run.smithi047.stdout: # don't complain about insecure global_id in the test suite 2024-04-01T22:32:13.303 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-01T22:32:13.303 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-01T22:32:13.303 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:32:13.303 INFO:teuthology.orchestra.run.smithi047.stdout: # 1m isn't quite enough 2024-04-01T22:32:13.303 INFO:teuthology.orchestra.run.smithi047.stdout: mon_down_mkfs_grace = 2m 2024-04-01T22:32:13.303 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:32:13.303 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_filestore_osds = false 2024-04-01T22:32:13.303 INFO:teuthology.orchestra.run.smithi047.stdout: mon down mkfs grace = 300 2024-04-01T22:32:13.303 INFO:teuthology.orchestra.run.smithi047.stdout: mon op complaint time = 120 2024-04-01T22:32:13.304 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd crush smoke test = False 2024-04-01T22:32:13.304 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:32:13.304 INFO:teuthology.orchestra.run.smithi047.stdout:[client] 2024-04-01T22:32:13.304 INFO:teuthology.orchestra.run.smithi047.stdout: rgw cache enabled = true 2024-04-01T22:32:13.304 INFO:teuthology.orchestra.run.smithi047.stdout: rgw enable ops log = true 2024-04-01T22:32:13.304 INFO:teuthology.orchestra.run.smithi047.stdout: rgw enable usage log = true 2024-04-01T22:32:13.304 INFO:teuthology.orchestra.run.smithi047.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-01T22:32:13.304 INFO:teuthology.orchestra.run.smithi047.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-01T22:32:13.304 INFO:teuthology.orchestra.run.smithi047.stdout: client mount timeout = 600 2024-04-01T22:32:13.304 INFO:teuthology.orchestra.run.smithi047.stdout: debug client = 20 2024-04-01T22:32:13.304 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-04-01T22:32:13.304 INFO:teuthology.orchestra.run.smithi047.stdout: rados mon op timeout = 900 2024-04-01T22:32:13.304 INFO:teuthology.orchestra.run.smithi047.stdout: rados osd op timeout = 900 2024-04-01T22:32:13.304 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.a] 2024-04-01T22:32:13.304 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.b] 2024-04-01T22:32:13.304 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.c] 2024-04-01T22:32:13.305 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.a] 2024-04-01T22:32:13.305 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.c] 2024-04-01T22:32:13.305 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.e] 2024-04-01T22:32:13.305 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.b] 2024-04-01T22:32:13.305 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.d] 2024-04-01T22:32:13.305 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.f] 2024-04-01T22:32:13.305 INFO:teuthology.orchestra.run.smithi047.stdout:[mds] 2024-04-01T22:32:13.305 INFO:teuthology.orchestra.run.smithi047.stdout: debug mds = 20 2024-04-01T22:32:13.305 INFO:teuthology.orchestra.run.smithi047.stdout: debug mds balancer = 20 2024-04-01T22:32:13.305 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-04-01T22:32:13.305 INFO:teuthology.orchestra.run.smithi047.stdout: mds debug frag = True 2024-04-01T22:32:13.305 INFO:teuthology.orchestra.run.smithi047.stdout: mds debug scatterstat = True 2024-04-01T22:32:13.305 INFO:teuthology.orchestra.run.smithi047.stdout: mds op complaint time = 180 2024-04-01T22:32:13.305 INFO:teuthology.orchestra.run.smithi047.stdout: mds valgrind exit = True 2024-04-01T22:32:13.305 INFO:teuthology.orchestra.run.smithi047.stdout: mds verify scatter = True 2024-04-01T22:32:13.305 INFO:teuthology.orchestra.run.smithi047.stdout: osd op complaint time = 180 2024-04-01T22:32:13.306 INFO:teuthology.orchestra.run.smithi047.stdout: rados mon op timeout = 900 2024-04-01T22:32:13.306 INFO:teuthology.orchestra.run.smithi047.stdout: rados osd op timeout = 900 2024-04-01T22:32:13.306 INFO:teuthology.orchestra.run.smithi181.stdout:[global] 2024-04-01T22:32:13.306 INFO:teuthology.orchestra.run.smithi181.stdout: chdir = "" 2024-04-01T22:32:13.306 INFO:teuthology.orchestra.run.smithi181.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-01T22:32:13.306 INFO:teuthology.orchestra.run.smithi181.stdout: auth supported = cephx 2024-04-01T22:32:13.306 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:32:13.306 INFO:teuthology.orchestra.run.smithi181.stdout: filestore xattr use omap = true 2024-04-01T22:32:13.306 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:32:13.306 INFO:teuthology.orchestra.run.smithi181.stdout: mon clock drift allowed = 1.000 2024-04-01T22:32:13.307 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:32:13.307 INFO:teuthology.orchestra.run.smithi181.stdout: osd crush chooseleaf type = 0 2024-04-01T22:32:13.307 INFO:teuthology.orchestra.run.smithi181.stdout: auth debug = true 2024-04-01T22:32:13.307 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:32:13.307 INFO:teuthology.orchestra.run.smithi181.stdout: ms die on old message = true 2024-04-01T22:32:13.307 INFO:teuthology.orchestra.run.smithi181.stdout: ms die on bug = true 2024-04-01T22:32:13.307 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:32:13.307 INFO:teuthology.orchestra.run.smithi181.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-01T22:32:13.307 INFO:teuthology.orchestra.run.smithi181.stdout: mon pg warn max object skew = 0 2024-04-01T22:32:13.307 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:32:13.307 INFO:teuthology.orchestra.run.smithi181.stdout: # disable pg_autoscaler by default for new pools 2024-04-01T22:32:13.307 INFO:teuthology.orchestra.run.smithi181.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-01T22:32:13.307 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:32:13.307 INFO:teuthology.orchestra.run.smithi181.stdout: osd pool default size = 2 2024-04-01T22:32:13.308 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:32:13.308 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd allow primary affinity = true 2024-04-01T22:32:13.308 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd allow pg remap = true 2024-04-01T22:32:13.308 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on legacy crush tunables = false 2024-04-01T22:32:13.308 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on crush straw calc version zero = false 2024-04-01T22:32:13.308 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on no sortbitwise = false 2024-04-01T22:32:13.308 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on osd down out interval zero = false 2024-04-01T22:32:13.308 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on too few osds = false 2024-04-01T22:32:13.308 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-01T22:32:13.308 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-01T22:32:13.308 INFO:teuthology.orchestra.run.smithi181.stdout: mon_allow_pool_size_one = true 2024-04-01T22:32:13.308 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:32:13.308 INFO:teuthology.orchestra.run.smithi181.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-01T22:32:13.308 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:32:13.308 INFO:teuthology.orchestra.run.smithi181.stdout: osd default data pool replay window = 5 2024-04-01T22:32:13.308 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:32:13.309 INFO:teuthology.orchestra.run.smithi181.stdout: mon allow pool delete = true 2024-04-01T22:32:13.309 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:32:13.309 INFO:teuthology.orchestra.run.smithi181.stdout: mon cluster log file level = debug 2024-04-01T22:32:13.309 INFO:teuthology.orchestra.run.smithi181.stdout: debug asserts on shutdown = true 2024-04-01T22:32:13.309 INFO:teuthology.orchestra.run.smithi181.stdout: mon health detail to clog = false 2024-04-01T22:32:13.309 INFO:teuthology.orchestra.run.smithi181.stdout: mon host = "172.21.15.47,172.21.15.181,[v2:172.21.15.181:3301,v1:172.21.15.181:6790]" 2024-04-01T22:32:13.309 INFO:teuthology.orchestra.run.smithi181.stdout: mds beacon grace = 60 2024-04-01T22:32:13.309 INFO:teuthology.orchestra.run.smithi181.stdout: mds heartbeat grace = 60 2024-04-01T22:32:13.309 INFO:teuthology.orchestra.run.smithi181.stdout: osd heartbeat grace = 60 2024-04-01T22:32:13.309 INFO:teuthology.orchestra.run.smithi181.stdout: fsid = a6998a48-38bc-4e42-b0d9-04f2fb5c3c87 2024-04-01T22:32:13.309 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:32:13.309 INFO:teuthology.orchestra.run.smithi181.stdout:[osd] 2024-04-01T22:32:13.309 INFO:teuthology.orchestra.run.smithi181.stdout: osd journal size = 100 2024-04-01T22:32:13.309 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:32:13.310 INFO:teuthology.orchestra.run.smithi181.stdout: osd scrub load threshold = 5.0 2024-04-01T22:32:13.310 INFO:teuthology.orchestra.run.smithi181.stdout: osd scrub max interval = 600 2024-04-01T22:32:13.310 INFO:teuthology.orchestra.run.smithi181.stdout: osd mclock profile = high_recovery_ops 2024-04-01T22:32:13.310 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:32:13.310 INFO:teuthology.orchestra.run.smithi181.stdout: osd recover clone overlap = true 2024-04-01T22:32:13.310 INFO:teuthology.orchestra.run.smithi181.stdout: osd recovery max chunk = 1048576 2024-04-01T22:32:13.310 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:32:13.310 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug shutdown = true 2024-04-01T22:32:13.310 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug op order = true 2024-04-01T22:32:13.310 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug verify stray on activate = true 2024-04-01T22:32:13.310 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug trim objects = true 2024-04-01T22:32:13.310 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:32:13.310 INFO:teuthology.orchestra.run.smithi181.stdout: osd open classes on start = true 2024-04-01T22:32:13.310 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug pg log writeout = true 2024-04-01T22:32:13.311 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:32:13.311 INFO:teuthology.orchestra.run.smithi181.stdout: osd deep scrub update digest min age = 30 2024-04-01T22:32:13.311 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:32:13.311 INFO:teuthology.orchestra.run.smithi181.stdout: osd map max advance = 10 2024-04-01T22:32:13.311 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:32:13.311 INFO:teuthology.orchestra.run.smithi181.stdout: journal zero on create = true 2024-04-01T22:32:13.311 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:32:13.311 INFO:teuthology.orchestra.run.smithi181.stdout: filestore ondisk finisher threads = 3 2024-04-01T22:32:13.311 INFO:teuthology.orchestra.run.smithi181.stdout: filestore apply finisher threads = 3 2024-04-01T22:32:13.311 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:32:13.311 INFO:teuthology.orchestra.run.smithi181.stdout: bdev debug aio = true 2024-04-01T22:32:13.311 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug misdirected ops = true 2024-04-01T22:32:13.311 INFO:teuthology.orchestra.run.smithi181.stdout: bluestore block size = 96636764160 2024-04-01T22:32:13.311 INFO:teuthology.orchestra.run.smithi181.stdout: bluestore compression mode = aggressive 2024-04-01T22:32:13.311 INFO:teuthology.orchestra.run.smithi181.stdout: bluestore fsck on mount = True 2024-04-01T22:32:13.311 INFO:teuthology.orchestra.run.smithi181.stdout: debug bluefs = 20 2024-04-01T22:32:13.312 INFO:teuthology.orchestra.run.smithi181.stdout: debug bluestore = 20 2024-04-01T22:32:13.312 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-04-01T22:32:13.312 INFO:teuthology.orchestra.run.smithi181.stdout: debug osd = 20 2024-04-01T22:32:13.312 INFO:teuthology.orchestra.run.smithi181.stdout: debug rocksdb = 10 2024-04-01T22:32:13.312 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd backfillfull_ratio = 0.85 2024-04-01T22:32:13.312 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd full ratio = 0.9 2024-04-01T22:32:13.312 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd nearfull ratio = 0.8 2024-04-01T22:32:13.312 INFO:teuthology.orchestra.run.smithi181.stdout: osd failsafe full ratio = 0.95 2024-04-01T22:32:13.312 INFO:teuthology.orchestra.run.smithi181.stdout: osd fast shutdown = False 2024-04-01T22:32:13.312 INFO:teuthology.orchestra.run.smithi181.stdout: osd objectstore = bluestore 2024-04-01T22:32:13.312 INFO:teuthology.orchestra.run.smithi181.stdout: osd op complaint time = 180 2024-04-01T22:32:13.312 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:32:13.312 INFO:teuthology.orchestra.run.smithi181.stdout:[mgr] 2024-04-01T22:32:13.312 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-04-01T22:32:13.312 INFO:teuthology.orchestra.run.smithi181.stdout: debug mgr = 20 2024-04-01T22:32:13.313 INFO:teuthology.orchestra.run.smithi181.stdout: debug mon = 20 2024-04-01T22:32:13.313 INFO:teuthology.orchestra.run.smithi181.stdout: debug auth = 20 2024-04-01T22:32:13.313 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min pgs per osd = 4 2024-04-01T22:32:13.313 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min bytes per osd = 10 2024-04-01T22:32:13.313 INFO:teuthology.orchestra.run.smithi181.stdout: mgr/telemetry/nag = false 2024-04-01T22:32:13.313 INFO:teuthology.orchestra.run.smithi181.stdout: debug client = 20 2024-04-01T22:32:13.313 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:32:13.313 INFO:teuthology.orchestra.run.smithi181.stdout:[mon] 2024-04-01T22:32:13.313 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-04-01T22:32:13.313 INFO:teuthology.orchestra.run.smithi181.stdout: debug mon = 20 2024-04-01T22:32:13.313 INFO:teuthology.orchestra.run.smithi181.stdout: debug paxos = 20 2024-04-01T22:32:13.313 INFO:teuthology.orchestra.run.smithi181.stdout: debug auth = 20 2024-04-01T22:32:13.313 INFO:teuthology.orchestra.run.smithi181.stdout: mon data avail warn = 5 2024-04-01T22:32:13.313 INFO:teuthology.orchestra.run.smithi181.stdout: mon mgr mkfs grace = 240 2024-04-01T22:32:13.313 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min pgs per osd = 4 2024-04-01T22:32:13.314 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd reporter subtree level = osd 2024-04-01T22:32:13.314 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd prime pg temp = true 2024-04-01T22:32:13.314 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min bytes per osd = 10 2024-04-01T22:32:13.314 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:32:13.314 INFO:teuthology.orchestra.run.smithi181.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-01T22:32:13.314 INFO:teuthology.orchestra.run.smithi181.stdout: auth mon ticket ttl = 660 # 11m 2024-04-01T22:32:13.314 INFO:teuthology.orchestra.run.smithi181.stdout: auth service ticket ttl = 240 # 4m 2024-04-01T22:32:13.314 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:32:13.314 INFO:teuthology.orchestra.run.smithi181.stdout: # don't complain about insecure global_id in the test suite 2024-04-01T22:32:13.314 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-01T22:32:13.314 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-01T22:32:13.314 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:32:13.314 INFO:teuthology.orchestra.run.smithi181.stdout: # 1m isn't quite enough 2024-04-01T22:32:13.314 INFO:teuthology.orchestra.run.smithi181.stdout: mon_down_mkfs_grace = 2m 2024-04-01T22:32:13.314 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:32:13.315 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_filestore_osds = false 2024-04-01T22:32:13.315 INFO:teuthology.orchestra.run.smithi181.stdout: mon down mkfs grace = 300 2024-04-01T22:32:13.315 INFO:teuthology.orchestra.run.smithi181.stdout: mon op complaint time = 120 2024-04-01T22:32:13.315 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd crush smoke test = False 2024-04-01T22:32:13.315 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-04-01T22:32:13.315 INFO:teuthology.orchestra.run.smithi181.stdout:[client] 2024-04-01T22:32:13.315 INFO:teuthology.orchestra.run.smithi181.stdout: rgw cache enabled = true 2024-04-01T22:32:13.315 INFO:teuthology.orchestra.run.smithi181.stdout: rgw enable ops log = true 2024-04-01T22:32:13.315 INFO:teuthology.orchestra.run.smithi181.stdout: rgw enable usage log = true 2024-04-01T22:32:13.315 INFO:teuthology.orchestra.run.smithi181.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-01T22:32:13.315 INFO:teuthology.orchestra.run.smithi181.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-01T22:32:13.315 INFO:teuthology.orchestra.run.smithi181.stdout: client mount timeout = 600 2024-04-01T22:32:13.315 INFO:teuthology.orchestra.run.smithi181.stdout: debug client = 20 2024-04-01T22:32:13.315 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-04-01T22:32:13.315 INFO:teuthology.orchestra.run.smithi181.stdout: rados mon op timeout = 900 2024-04-01T22:32:13.315 INFO:teuthology.orchestra.run.smithi181.stdout: rados osd op timeout = 900 2024-04-01T22:32:13.316 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.a] 2024-04-01T22:32:13.316 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.b] 2024-04-01T22:32:13.316 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.c] 2024-04-01T22:32:13.316 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.a] 2024-04-01T22:32:13.316 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.c] 2024-04-01T22:32:13.316 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.e] 2024-04-01T22:32:13.316 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.b] 2024-04-01T22:32:13.316 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.d] 2024-04-01T22:32:13.316 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.f] 2024-04-01T22:32:13.316 INFO:teuthology.orchestra.run.smithi181.stdout:[mds] 2024-04-01T22:32:13.316 INFO:teuthology.orchestra.run.smithi181.stdout: debug mds = 20 2024-04-01T22:32:13.316 INFO:teuthology.orchestra.run.smithi181.stdout: debug mds balancer = 20 2024-04-01T22:32:13.316 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-04-01T22:32:13.316 INFO:teuthology.orchestra.run.smithi181.stdout: mds debug frag = True 2024-04-01T22:32:13.316 INFO:teuthology.orchestra.run.smithi181.stdout: mds debug scatterstat = True 2024-04-01T22:32:13.316 INFO:teuthology.orchestra.run.smithi181.stdout: mds op complaint time = 180 2024-04-01T22:32:13.317 INFO:teuthology.orchestra.run.smithi181.stdout: mds valgrind exit = True 2024-04-01T22:32:13.317 INFO:teuthology.orchestra.run.smithi181.stdout: mds verify scatter = True 2024-04-01T22:32:13.317 INFO:teuthology.orchestra.run.smithi181.stdout: osd op complaint time = 180 2024-04-01T22:32:13.317 INFO:teuthology.orchestra.run.smithi181.stdout: rados mon op timeout = 900 2024-04-01T22:32:13.317 INFO:teuthology.orchestra.run.smithi181.stdout: rados osd op timeout = 900 2024-04-01T22:32:13.318 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-01T22:32:13.318 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-01T22:32:13.414 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-01T22:32:13.414 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-01T22:32:13.414 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-01T22:32:13.428 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-01T22:32:13.428 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-01T22:32:13.482 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi047.front.sepia.ceph.com 2024-04-01T22:32:13.483 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-01T22:32:13.483 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-01T22:32:13.483 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-01T22:32:13.561 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-01T22:32:13.561 DEBUG:teuthology.orchestra.run.smithi047:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-01T22:32:13.616 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi181.front.sepia.ceph.com 2024-04-01T22:32:13.616 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-04-01T22:32:13.616 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-01T22:32:13.616 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-01T22:32:13.656 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-04-01T22:32:13.656 DEBUG:teuthology.orchestra.run.smithi181:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-01T22:32:13.711 INFO:tasks.ceph:Setting up mon nodes... 2024-04-01T22:32:13.711 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-01T22:32:13.711 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-01T22:32:13.766 INFO:teuthology.orchestra.run.smithi047.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-01T22:32:13.769 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-01T22:32:13.831 INFO:teuthology.orchestra.run.smithi181.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-01T22:32:13.833 INFO:tasks.ceph:Setting up mds nodes... 2024-04-01T22:32:13.834 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-01T22:32:13.888 INFO:teuthology.orchestra.run.smithi047.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-01T22:32:13.890 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-01T22:32:13.917 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-01T22:32:14.011 INFO:teuthology.orchestra.run.smithi047.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-01T22:32:14.014 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-01T22:32:14.040 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-04-01T22:32:14.134 INFO:teuthology.orchestra.run.smithi047.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-04-01T22:32:14.137 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-04-01T22:32:14.163 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-01T22:32:14.219 INFO:teuthology.orchestra.run.smithi181.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-01T22:32:14.222 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-01T22:32:14.248 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-01T22:32:14.343 INFO:teuthology.orchestra.run.smithi181.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-01T22:32:14.346 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-01T22:32:14.372 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-04-01T22:32:14.467 INFO:teuthology.orchestra.run.smithi181.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-04-01T22:32:14.470 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-04-01T22:32:14.496 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-01T22:32:14.496 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-01T22:32:14.539 INFO:teuthology.orchestra.run.smithi047.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-01T22:32:14.555 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-01T22:32:14.555 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi047.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi181.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-01T22:32:14.555 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-01T22:32:14.582 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-01T22:32:14.582 INFO:tasks.ceph:role: osd.0 2024-04-01T22:32:14.582 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi047.front.sepia.ceph.com 2024-04-01T22:32:14.582 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-01T22:32:14.648 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-01T22:32:14.648 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-01T22:32:14.648 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-01T22:32:14.648 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-01T22:32:14.648 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-01T22:32:14.649 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-04-01T22:32:14.649 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-01T22:32:14.649 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-01T22:32:14.649 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-01T22:32:14.649 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-01T22:32:14.684 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-04-01T22:32:14.686 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-04-01T22:32:14.686 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-01T22:32:14.756 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-01T22:32:14.826 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-01T22:32:14.894 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-01T22:32:14.894 INFO:tasks.ceph:role: osd.1 2024-04-01T22:32:14.894 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi047.front.sepia.ceph.com 2024-04-01T22:32:14.894 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-01T22:32:14.960 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-01T22:32:14.960 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-01T22:32:14.960 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-01T22:32:14.960 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-01T22:32:14.960 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-01T22:32:14.960 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-04-01T22:32:14.960 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-01T22:32:14.960 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-01T22:32:14.960 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-01T22:32:14.960 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-01T22:32:14.996 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-04-01T22:32:14.997 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-04-01T22:32:14.998 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-01T22:32:15.067 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-01T22:32:15.137 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-01T22:32:15.204 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-01T22:32:15.204 INFO:tasks.ceph:role: osd.2 2024-04-01T22:32:15.204 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi047.front.sepia.ceph.com 2024-04-01T22:32:15.204 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-01T22:32:15.270 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-01T22:32:15.270 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-01T22:32:15.271 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-01T22:32:15.271 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-01T22:32:15.271 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-01T22:32:15.271 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-04-01T22:32:15.271 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-01T22:32:15.271 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-01T22:32:15.271 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-01T22:32:15.271 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-01T22:32:15.306 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-04-01T22:32:15.308 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-04-01T22:32:15.309 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-01T22:32:15.378 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-01T22:32:15.449 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-01T22:32:15.516 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-01T22:32:15.516 INFO:tasks.ceph:role: osd.3 2024-04-01T22:32:15.516 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi047.front.sepia.ceph.com 2024-04-01T22:32:15.516 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-01T22:32:15.582 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-01T22:32:15.582 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-01T22:32:15.582 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-01T22:32:15.582 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-01T22:32:15.582 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-01T22:32:15.582 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-04-01T22:32:15.582 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-01T22:32:15.583 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-01T22:32:15.583 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-01T22:32:15.583 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-01T22:32:15.618 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-04-01T22:32:15.620 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-04-01T22:32:15.620 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-01T22:32:15.695 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-01T22:32:15.766 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-01T22:32:15.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:15.857+0000 7f03b2224640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-01T22:32:15.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:15.857+0000 7f03b2224640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-01T22:32:15.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:15.857+0000 7f03b2224640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-01T22:32:15.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:15.857+0000 7f03b2224640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-01T22:32:15.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:15.857+0000 7f03b2224640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-01T22:32:15.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:15.857+0000 7f03b2224640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-01T22:32:18.702 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-01T22:32:18.733 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-01T22:32:18.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:18.823+0000 7fadada48640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-01T22:32:18.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:18.823+0000 7fadada48640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-01T22:32:18.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:18.823+0000 7fadada48640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-01T22:32:18.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:18.823+0000 7fadada48640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-01T22:32:18.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:18.823+0000 7fadada48640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-01T22:32:18.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:18.824+0000 7fadada48640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-01T22:32:21.667 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-01T22:32:21.695 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-01T22:32:21.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:21.784+0000 7fe4b500f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-01T22:32:21.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:21.784+0000 7fe4b500f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-01T22:32:21.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:21.784+0000 7fe4b500f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-01T22:32:21.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:21.784+0000 7fe4b500f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-01T22:32:21.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:21.784+0000 7fe4b500f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-01T22:32:21.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:21.784+0000 7fe4b500f640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-01T22:32:24.629 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-01T22:32:24.660 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-01T22:32:24.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:24.753+0000 7f96ab013640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-01T22:32:24.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:24.753+0000 7f96ab013640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-01T22:32:24.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:24.753+0000 7f96ab013640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-01T22:32:24.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:24.753+0000 7f96ab013640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-01T22:32:24.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:24.753+0000 7f96ab013640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-01T22:32:24.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:24.753+0000 7f96ab013640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-01T22:32:27.603 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-01T22:32:27.634 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-01T22:32:27.666 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-01T22:32:27.666 INFO:tasks.ceph:role: osd.4 2024-04-01T22:32:27.666 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi181.front.sepia.ceph.com 2024-04-01T22:32:27.666 DEBUG:teuthology.orchestra.run.smithi181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-01T22:32:27.744 INFO:teuthology.orchestra.run.smithi181.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-01T22:32:27.745 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-01T22:32:27.745 INFO:teuthology.orchestra.run.smithi181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-01T22:32:27.745 INFO:teuthology.orchestra.run.smithi181.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-01T22:32:27.745 INFO:teuthology.orchestra.run.smithi181.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-01T22:32:27.745 INFO:teuthology.orchestra.run.smithi181.stdout: = sunit=0 swidth=0 blks 2024-04-01T22:32:27.745 INFO:teuthology.orchestra.run.smithi181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-01T22:32:27.745 INFO:teuthology.orchestra.run.smithi181.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-01T22:32:27.745 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-01T22:32:27.745 INFO:teuthology.orchestra.run.smithi181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-01T22:32:28.244 INFO:teuthology.orchestra.run.smithi181.stdout:Discarding blocks...Done. 2024-04-01T22:32:28.246 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi181.front.sepia.ceph.com -o noatime 2024-04-01T22:32:28.246 DEBUG:teuthology.orchestra.run.smithi181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-01T22:32:28.370 DEBUG:teuthology.orchestra.run.smithi181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-01T22:32:28.407 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-01T22:32:28.475 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-01T22:32:28.475 INFO:tasks.ceph:role: osd.5 2024-04-01T22:32:28.475 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi181.front.sepia.ceph.com 2024-04-01T22:32:28.475 DEBUG:teuthology.orchestra.run.smithi181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-01T22:32:28.550 INFO:teuthology.orchestra.run.smithi181.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-01T22:32:28.550 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-01T22:32:28.550 INFO:teuthology.orchestra.run.smithi181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-01T22:32:28.550 INFO:teuthology.orchestra.run.smithi181.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-01T22:32:28.550 INFO:teuthology.orchestra.run.smithi181.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-01T22:32:28.550 INFO:teuthology.orchestra.run.smithi181.stdout: = sunit=0 swidth=0 blks 2024-04-01T22:32:28.550 INFO:teuthology.orchestra.run.smithi181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-01T22:32:28.550 INFO:teuthology.orchestra.run.smithi181.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-01T22:32:28.551 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-01T22:32:28.551 INFO:teuthology.orchestra.run.smithi181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-01T22:32:29.009 INFO:teuthology.orchestra.run.smithi181.stdout:Discarding blocks...Done. 2024-04-01T22:32:29.011 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi181.front.sepia.ceph.com -o noatime 2024-04-01T22:32:29.011 DEBUG:teuthology.orchestra.run.smithi181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-01T22:32:29.101 DEBUG:teuthology.orchestra.run.smithi181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-01T22:32:29.132 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-01T22:32:29.200 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-01T22:32:29.200 INFO:tasks.ceph:role: osd.6 2024-04-01T22:32:29.200 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi181.front.sepia.ceph.com 2024-04-01T22:32:29.200 DEBUG:teuthology.orchestra.run.smithi181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-01T22:32:29.275 INFO:teuthology.orchestra.run.smithi181.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-01T22:32:29.275 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-01T22:32:29.276 INFO:teuthology.orchestra.run.smithi181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-01T22:32:29.276 INFO:teuthology.orchestra.run.smithi181.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-01T22:32:29.276 INFO:teuthology.orchestra.run.smithi181.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-01T22:32:29.276 INFO:teuthology.orchestra.run.smithi181.stdout: = sunit=0 swidth=0 blks 2024-04-01T22:32:29.276 INFO:teuthology.orchestra.run.smithi181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-01T22:32:29.276 INFO:teuthology.orchestra.run.smithi181.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-01T22:32:29.276 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-01T22:32:29.276 INFO:teuthology.orchestra.run.smithi181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-01T22:32:29.765 INFO:teuthology.orchestra.run.smithi181.stdout:Discarding blocks...Done. 2024-04-01T22:32:29.767 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi181.front.sepia.ceph.com -o noatime 2024-04-01T22:32:29.767 DEBUG:teuthology.orchestra.run.smithi181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-01T22:32:29.905 DEBUG:teuthology.orchestra.run.smithi181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-01T22:32:29.938 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-01T22:32:30.005 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-01T22:32:30.005 INFO:tasks.ceph:role: osd.7 2024-04-01T22:32:30.006 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi181.front.sepia.ceph.com 2024-04-01T22:32:30.006 DEBUG:teuthology.orchestra.run.smithi181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-01T22:32:30.079 INFO:teuthology.orchestra.run.smithi181.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-01T22:32:30.080 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-01T22:32:30.080 INFO:teuthology.orchestra.run.smithi181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-01T22:32:30.080 INFO:teuthology.orchestra.run.smithi181.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-01T22:32:30.080 INFO:teuthology.orchestra.run.smithi181.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-01T22:32:30.080 INFO:teuthology.orchestra.run.smithi181.stdout: = sunit=0 swidth=0 blks 2024-04-01T22:32:30.080 INFO:teuthology.orchestra.run.smithi181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-01T22:32:30.080 INFO:teuthology.orchestra.run.smithi181.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-01T22:32:30.080 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-01T22:32:30.080 INFO:teuthology.orchestra.run.smithi181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-01T22:32:30.599 INFO:teuthology.orchestra.run.smithi181.stdout:Discarding blocks...Done. 2024-04-01T22:32:30.601 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi181.front.sepia.ceph.com -o noatime 2024-04-01T22:32:30.601 DEBUG:teuthology.orchestra.run.smithi181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-01T22:32:30.733 DEBUG:teuthology.orchestra.run.smithi181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-01T22:32:30.766 DEBUG:teuthology.orchestra.run.smithi181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-01T22:32:30.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:30.863+0000 7f61e4611640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-01T22:32:30.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:30.863+0000 7f61e4611640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-01T22:32:30.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:30.863+0000 7f61e4611640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-01T22:32:30.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:30.863+0000 7f61e4611640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-01T22:32:30.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:30.863+0000 7f61e4611640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-01T22:32:30.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:30.864+0000 7f61e4611640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-01T22:32:33.712 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-01T22:32:33.742 DEBUG:teuthology.orchestra.run.smithi181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-01T22:32:33.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:33.832+0000 7ffa8c521640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-01T22:32:33.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:33.832+0000 7ffa8c521640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-01T22:32:33.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:33.832+0000 7ffa8c521640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-01T22:32:33.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:33.832+0000 7ffa8c521640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-01T22:32:33.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:33.832+0000 7ffa8c521640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-01T22:32:33.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:33.833+0000 7ffa8c521640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-01T22:32:36.679 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-01T22:32:36.708 DEBUG:teuthology.orchestra.run.smithi181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-01T22:32:36.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:36.797+0000 7f58f579e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-01T22:32:36.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:36.797+0000 7f58f579e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-01T22:32:36.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:36.797+0000 7f58f579e640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-01T22:32:36.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:36.797+0000 7f58f579e640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-01T22:32:36.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:36.797+0000 7f58f579e640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-01T22:32:36.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:36.798+0000 7f58f579e640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-01T22:32:39.641 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-01T22:32:39.668 DEBUG:teuthology.orchestra.run.smithi181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-01T22:32:39.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:39.755+0000 7f30681e1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-01T22:32:39.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:39.756+0000 7f30681e1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-01T22:32:39.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:39.756+0000 7f30681e1640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-01T22:32:39.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:39.756+0000 7f30681e1640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-01T22:32:39.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:39.756+0000 7f30681e1640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-01T22:32:39.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:39.756+0000 7f30681e1640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-01T22:32:41.330 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:32:41.333 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:32:42.599 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-01T22:32:42.631 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-01T22:32:42.631 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-01T22:32:42.631 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-01T22:32:42.659 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-01T22:32:42.659 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-01T22:32:42.725 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-01T22:32:42.725 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-01T22:32:42.791 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-01T22:32:42.791 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-04-01T22:32:42.858 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-01T22:32:42.858 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-01T22:32:42.925 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-01T22:32:42.925 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-01T22:32:42.992 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-01T22:32:42.992 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-01T22:32:43.058 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-01T22:32:43.058 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-01T22:32:43.124 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-04-01T22:32:43.125 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-01T22:32:43.156 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-04-01T22:32:43.156 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-01T22:32:43.228 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-04-01T22:32:43.228 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-01T22:32:43.299 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-04-01T22:32:43.299 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-04-01T22:32:43.370 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-04-01T22:32:43.370 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-01T22:32:43.438 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-04-01T22:32:43.439 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-01T22:32:43.507 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-04-01T22:32:43.507 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-01T22:32:43.575 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-04-01T22:32:43.575 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-01T22:32:43.643 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-01T22:32:43.643 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-01T22:32:43.659 INFO:tasks.ceph:Adding keys to all mons... 2024-04-01T22:32:43.659 DEBUG:teuthology.orchestra.run.smithi047:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-01T22:32:43.700 DEBUG:teuthology.orchestra.run.smithi181:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-01T22:32:43.726 INFO:teuthology.orchestra.run.smithi047.stdout:[mgr.y] 2024-04-01T22:32:43.726 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQDtNQtmWeLFLRAAb+bndWG1V5Bgt3JTSNTiHQ== 2024-04-01T22:32:43.726 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.a] 2024-04-01T22:32:43.726 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQDtNQtmrvQHNRAAktH/LGDhWwBVziXJwPRJjg== 2024-04-01T22:32:43.726 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.c] 2024-04-01T22:32:43.726 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQDuNQtmzVrJABAAKA2oegx50BiS64Xll9YqDQ== 2024-04-01T22:32:43.726 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.e] 2024-04-01T22:32:43.726 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQDuNQtmGAIgCBAABBbEXyzdJ4zXLbXlQN2TFA== 2024-04-01T22:32:43.726 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.0] 2024-04-01T22:32:43.727 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQDvNQtmwJ0lMxAAsNp9WbfInKXmNrNNEYAwNQ== 2024-04-01T22:32:43.727 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.1] 2024-04-01T22:32:43.727 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQDyNQtmG+00MRAACiRJsG9X14quJfM6uAMdKQ== 2024-04-01T22:32:43.727 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.2] 2024-04-01T22:32:43.727 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQD1NQtmKwvdLhAAEslSJzfpjAuw0kdqwiOIBA== 2024-04-01T22:32:43.727 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.3] 2024-04-01T22:32:43.727 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQD4NQtmfVjyLBAACd6Yqfbxzwy8zx3ZX5SSYQ== 2024-04-01T22:32:43.727 INFO:teuthology.orchestra.run.smithi047.stdout:[mgr.x] 2024-04-01T22:32:43.727 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQDtNQtmgWiiMRAAf5fTIiJ71bYiVFbONVsr4w== 2024-04-01T22:32:43.727 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.b] 2024-04-01T22:32:43.727 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQDuNQtmTXcsDRAALUZQaewPgAPXrY/qRY4I9w== 2024-04-01T22:32:43.727 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.d] 2024-04-01T22:32:43.727 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQDuNQtmky2RFBAAjhw1bp8IPh8hfWA0K/qlww== 2024-04-01T22:32:43.727 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.f] 2024-04-01T22:32:43.727 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQDuNQtmhoH4GxAA2fLNboyeIvdGgls/YWdAYA== 2024-04-01T22:32:43.728 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.4] 2024-04-01T22:32:43.728 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQD+NQtmvF6CMxAAoFokCZNvRvZncAT82cs7Kg== 2024-04-01T22:32:43.728 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.5] 2024-04-01T22:32:43.728 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQABNgtmsu+tMRAAYkplOU91RMxBFT/DLJ2j+Q== 2024-04-01T22:32:43.728 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.6] 2024-04-01T22:32:43.728 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQAENgtmCgWULxAAPAzqs9Zo6uVr38zWrAptsw== 2024-04-01T22:32:43.728 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.7] 2024-04-01T22:32:43.728 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQAHNgtmy+IdLRAA2fmuIpB3/qPnMSigXSbcYQ== 2024-04-01T22:32:43.728 INFO:teuthology.orchestra.run.smithi047.stdout:[client.0] 2024-04-01T22:32:43.728 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQDuNQtm5G5CIBAAbTvi0myD2E+owqiXomFJfw== 2024-04-01T22:32:43.729 INFO:teuthology.orchestra.run.smithi181.stdout:[mgr.y] 2024-04-01T22:32:43.730 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQDtNQtmWeLFLRAAb+bndWG1V5Bgt3JTSNTiHQ== 2024-04-01T22:32:43.730 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.a] 2024-04-01T22:32:43.730 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQDtNQtmrvQHNRAAktH/LGDhWwBVziXJwPRJjg== 2024-04-01T22:32:43.730 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.c] 2024-04-01T22:32:43.730 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQDuNQtmzVrJABAAKA2oegx50BiS64Xll9YqDQ== 2024-04-01T22:32:43.730 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.e] 2024-04-01T22:32:43.730 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQDuNQtmGAIgCBAABBbEXyzdJ4zXLbXlQN2TFA== 2024-04-01T22:32:43.730 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.0] 2024-04-01T22:32:43.730 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQDvNQtmwJ0lMxAAsNp9WbfInKXmNrNNEYAwNQ== 2024-04-01T22:32:43.730 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.1] 2024-04-01T22:32:43.730 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQDyNQtmG+00MRAACiRJsG9X14quJfM6uAMdKQ== 2024-04-01T22:32:43.730 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.2] 2024-04-01T22:32:43.730 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQD1NQtmKwvdLhAAEslSJzfpjAuw0kdqwiOIBA== 2024-04-01T22:32:43.730 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.3] 2024-04-01T22:32:43.731 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQD4NQtmfVjyLBAACd6Yqfbxzwy8zx3ZX5SSYQ== 2024-04-01T22:32:43.731 INFO:teuthology.orchestra.run.smithi181.stdout:[mgr.x] 2024-04-01T22:32:43.731 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQDtNQtmgWiiMRAAf5fTIiJ71bYiVFbONVsr4w== 2024-04-01T22:32:43.731 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.b] 2024-04-01T22:32:43.731 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQDuNQtmTXcsDRAALUZQaewPgAPXrY/qRY4I9w== 2024-04-01T22:32:43.731 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.d] 2024-04-01T22:32:43.731 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQDuNQtmky2RFBAAjhw1bp8IPh8hfWA0K/qlww== 2024-04-01T22:32:43.731 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.f] 2024-04-01T22:32:43.731 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQDuNQtmhoH4GxAA2fLNboyeIvdGgls/YWdAYA== 2024-04-01T22:32:43.731 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.4] 2024-04-01T22:32:43.731 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQD+NQtmvF6CMxAAoFokCZNvRvZncAT82cs7Kg== 2024-04-01T22:32:43.731 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.5] 2024-04-01T22:32:43.731 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQABNgtmsu+tMRAAYkplOU91RMxBFT/DLJ2j+Q== 2024-04-01T22:32:43.731 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.6] 2024-04-01T22:32:43.732 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQAENgtmCgWULxAAPAzqs9Zo6uVr38zWrAptsw== 2024-04-01T22:32:43.732 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.7] 2024-04-01T22:32:43.732 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQAHNgtmy+IdLRAA2fmuIpB3/qPnMSigXSbcYQ== 2024-04-01T22:32:43.732 INFO:teuthology.orchestra.run.smithi181.stdout:[client.0] 2024-04-01T22:32:43.732 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQDuNQtm5G5CIBAAbTvi0myD2E+owqiXomFJfw== 2024-04-01T22:32:43.732 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-01T22:32:43.772 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-01T22:32:43.825 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-01T22:32:43.828 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-01T22:32:43.882 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-01T22:32:43.884 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-01T22:32:43.939 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-01T22:32:43.942 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-01T22:32:43.996 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T22:32:43.998 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T22:32:44.050 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T22:32:44.053 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T22:32:44.105 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T22:32:44.107 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T22:32:44.159 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T22:32:44.161 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T22:32:44.213 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-01T22:32:44.215 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-01T22:32:44.268 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-01T22:32:44.270 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-01T22:32:44.325 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-01T22:32:44.327 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-01T22:32:44.383 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-01T22:32:44.385 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-01T22:32:44.440 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T22:32:44.442 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T22:32:44.494 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T22:32:44.496 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T22:32:44.549 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T22:32:44.551 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T22:32:44.603 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T22:32:44.606 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-01T22:32:44.659 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-01T22:32:44.661 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-01T22:32:44.715 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-01T22:32:44.715 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-01T22:32:44.741 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-01T22:32:44.837 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-01T22:32:44.863 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-01T22:32:44.891 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-01T22:32:44.988 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-01T22:32:45.015 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-01T22:32:45.082 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-01T22:32:45.180 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-01T22:32:45.207 DEBUG:teuthology.orchestra.run.smithi047:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-01T22:32:45.209 DEBUG:teuthology.orchestra.run.smithi181:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-01T22:32:45.262 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-01T22:32:45.262 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-04-01T22:32:45.262 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-01T22:32:45.262 DEBUG:teuthology.orchestra.run.smithi047:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2024-04-01T22:32:45.264 INFO:tasks.ceph.mon.a:Started 2024-04-01T22:32:45.265 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-04-01T22:32:45.265 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-01T22:32:45.265 DEBUG:teuthology.orchestra.run.smithi181:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2024-04-01T22:32:45.305 INFO:tasks.ceph.mon.b:Started 2024-04-01T22:32:45.305 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-04-01T22:32:45.305 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-01T22:32:45.305 DEBUG:teuthology.orchestra.run.smithi181:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2024-04-01T22:32:45.307 INFO:tasks.ceph.mon.c:Started 2024-04-01T22:32:45.307 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-01T22:32:45.307 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-01T22:32:45.308 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2024-04-01T22:32:45.310 INFO:tasks.ceph.mgr.y:Started 2024-04-01T22:32:45.310 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-01T22:32:45.310 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2024-04-01T22:32:45.312 INFO:tasks.ceph.mgr.x:Started 2024-04-01T22:32:45.312 INFO:tasks.ceph:Setting crush tunables to default 2024-04-01T22:32:45.312 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph osd crush tunables default 2024-04-01T22:32:45.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:45.427+0000 7fba2190d640 1 Processor -- start 2024-04-01T22:32:45.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:45.427+0000 7fba2190d640 1 -- start start 2024-04-01T22:32:45.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:45.428+0000 7fba2190d640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fba1c0c93f0 0x7fba1c0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:32:45.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:45.428+0000 7fba2190d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fba1c15afc0 0x7fba1c06c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:32:45.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:45.428+0000 7fba2190d640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba1c0cdae0 con 0x7fba1c06c770 2024-04-01T22:32:45.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:45.428+0000 7fba2190d640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fba1c0c97d0 con 0x7fba1c0c93f0 2024-04-01T22:32:45.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:45.428+0000 7fba2190d640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fba1c0cdd80 con 0x7fba1c15afc0 2024-04-01T22:32:45.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:45.428+0000 7fba1affd640 1 -- >> v2:172.21.15.47:3300/0 conn(0x7fba1c0c93f0 msgr2=0x7fba1c0cee30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.47:3300/0 2024-04-01T22:32:45.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:45.428+0000 7fba1affd640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fba1c0c93f0 0x7fba1c0cee30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-01T22:32:45.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:45.428+0000 7fba1a7fc640 1 -- >> v2:172.21.15.181:3300/0 conn(0x7fba1c15afc0 msgr2=0x7fba1c06c230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.181:3300/0 2024-04-01T22:32:45.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:45.428+0000 7fba1a7fc640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fba1c15afc0 0x7fba1c06c230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-01T22:32:45.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:45.428+0000 7fba1b7fe640 1 -- >> v1:172.21.15.181:6789/0 conn(0x7fba1c06c770 legacy=0x7fba1c0cc0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2024-04-01T22:32:45.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:45.629+0000 7fba1affd640 1 -- >> v2:172.21.15.47:3300/0 conn(0x7fba1c0c93f0 msgr2=0x7fba1c0cee30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.47:3300/0 2024-04-01T22:32:45.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:45.629+0000 7fba1affd640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fba1c0c93f0 0x7fba1c0cee30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-01T22:32:45.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:45.629+0000 7fba1b7fe640 1 -- >> v1:172.21.15.181:6789/0 conn(0x7fba1c06c770 legacy=0x7fba1c0cc0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2024-04-01T22:32:45.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:45.629+0000 7fba1a7fc640 1 -- >> v2:172.21.15.181:3300/0 conn(0x7fba1c15afc0 msgr2=0x7fba1c06c230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.181:3300/0 2024-04-01T22:32:45.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:45.629+0000 7fba1a7fc640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fba1c15afc0 0x7fba1c06c230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-01T22:32:46.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:46.030+0000 7fba1affd640 1 -- >> v2:172.21.15.47:3300/0 conn(0x7fba1c0c93f0 msgr2=0x7fba1c0cee30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.47:3300/0 2024-04-01T22:32:46.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:46.030+0000 7fba1affd640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fba1c0c93f0 0x7fba1c0cee30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-01T22:32:46.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:46.030+0000 7fba1b7fe640 1 -- >> v1:172.21.15.181:6789/0 conn(0x7fba1c06c770 legacy=0x7fba1c0cc0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2024-04-01T22:32:46.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:46.030+0000 7fba1a7fc640 1 -- >> v2:172.21.15.181:3300/0 conn(0x7fba1c15afc0 msgr2=0x7fba1c06c230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.181:3300/0 2024-04-01T22:32:46.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:46.030+0000 7fba1a7fc640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fba1c15afc0 0x7fba1c06c230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-01T22:32:46.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:46.831+0000 7fba1affd640 1 -- >> v2:172.21.15.47:3300/0 conn(0x7fba1c0c93f0 msgr2=0x7fba1c0cee30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.47:3300/0 2024-04-01T22:32:46.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:46.831+0000 7fba1affd640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fba1c0c93f0 0x7fba1c0cee30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-01T22:32:46.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:46.831+0000 7fba1b7fe640 1 -- >> v1:172.21.15.181:6789/0 conn(0x7fba1c06c770 legacy=0x7fba1c0cc0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2024-04-01T22:32:46.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:46.831+0000 7fba1a7fc640 1 -- >> v2:172.21.15.181:3300/0 conn(0x7fba1c15afc0 msgr2=0x7fba1c06c230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.181:3300/0 2024-04-01T22:32:46.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:46.831+0000 7fba1a7fc640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fba1c15afc0 0x7fba1c06c230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-01T22:32:48.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:48.428+0000 7fba18ff9640 1 -- >> v2:172.21.15.181:3300/0 conn(0x7fba1c15afc0 msgr2=0x7fba1c06c230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T22:32:48.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:48.428+0000 7fba18ff9640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fba1c15afc0 0x7fba1c06c230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:32:48.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:48.428+0000 7fba18ff9640 1 -- >> v2:172.21.15.47:3300/0 conn(0x7fba1c0c93f0 msgr2=0x7fba1c0cee30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T22:32:48.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:48.428+0000 7fba18ff9640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fba1c0c93f0 0x7fba1c0cee30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:32:48.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:48.428+0000 7fba18ff9640 1 -- >> v1:172.21.15.181:6789/0 conn(0x7fba1c06c770 legacy=0x7fba1c0cc0d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T22:32:48.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:48.428+0000 7fba18ff9640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9fc003690 0x7fb9fc005ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:32:48.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:48.428+0000 7fba18ff9640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba1c0ce060 con 0x7fb9fc006120 2024-04-01T22:32:48.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:48.428+0000 7fba18ff9640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fba1c0c97d0 con 0x7fb9fc003690 2024-04-01T22:32:48.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:48.428+0000 7fba1a7fc640 1 -- >> v1:172.21.15.47:6789/0 conn(0x7fb9fc006120 legacy=0x7fb9fc0085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.47:6789/0 2024-04-01T22:32:48.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:48.428+0000 7fba1affd640 1 -- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9fc003690 msgr2=0x7fb9fc005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.181:3301/0 2024-04-01T22:32:48.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:48.428+0000 7fba1affd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9fc003690 0x7fb9fc005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-01T22:32:48.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:48.629+0000 7fba1a7fc640 1 -- >> v1:172.21.15.47:6789/0 conn(0x7fb9fc006120 legacy=0x7fb9fc0085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.47:6789/0 2024-04-01T22:32:48.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:48.629+0000 7fba1affd640 1 -- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9fc003690 msgr2=0x7fb9fc005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.181:3301/0 2024-04-01T22:32:48.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:48.629+0000 7fba1affd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9fc003690 0x7fb9fc005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-01T22:32:49.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:49.030+0000 7fba1a7fc640 1 -- >> v1:172.21.15.47:6789/0 conn(0x7fb9fc006120 legacy=0x7fb9fc0085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.47:6789/0 2024-04-01T22:32:49.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:49.030+0000 7fba1affd640 1 -- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9fc003690 msgr2=0x7fb9fc005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.181:3301/0 2024-04-01T22:32:49.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:49.030+0000 7fba1affd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9fc003690 0x7fb9fc005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-01T22:32:49.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:49.831+0000 7fba1a7fc640 1 -- >> v1:172.21.15.47:6789/0 conn(0x7fb9fc006120 legacy=0x7fb9fc0085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.47:6789/0 2024-04-01T22:32:49.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:49.831+0000 7fba1affd640 1 -- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9fc003690 msgr2=0x7fb9fc005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.181:3301/0 2024-04-01T22:32:49.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:49.831+0000 7fba1affd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9fc003690 0x7fb9fc005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-01T22:32:51.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:51.428+0000 7fba18ff9640 1 -- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9fc003690 msgr2=0x7fb9fc005ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T22:32:51.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:51.428+0000 7fba18ff9640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9fc003690 0x7fb9fc005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:32:51.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:51.428+0000 7fba18ff9640 1 -- >> v1:172.21.15.47:6789/0 conn(0x7fb9fc006120 legacy=0x7fb9fc0085e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T22:32:51.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:51.428+0000 7fba1b7fe640 1 -- reap_dead start 2024-04-01T22:32:51.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:51.428+0000 7fba18ff9640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9fc009ec0 0x7fb9fc005ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:32:51.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:51.428+0000 7fba18ff9640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb9fc00a390 0x7fb9fc00a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:32:51.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:51.428+0000 7fba18ff9640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb9fc0085e0 0x7fb9fc008db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:32:51.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:51.428+0000 7fba18ff9640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fba1c0c97d0 con 0x7fb9fc00a390 2024-04-01T22:32:51.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:51.428+0000 7fba18ff9640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fba1c0cdd80 con 0x7fb9fc0085e0 2024-04-01T22:32:51.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:51.428+0000 7fba18ff9640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb9fc0092f0 con 0x7fb9fc009ec0 2024-04-01T22:32:51.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:51.428+0000 7fba1a7fc640 1 -- >> v2:172.21.15.47:3300/0 conn(0x7fb9fc00a390 msgr2=0x7fb9fc00a790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.47:3300/0 2024-04-01T22:32:51.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:51.428+0000 7fba1a7fc640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb9fc00a390 0x7fb9fc00a790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-01T22:32:51.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:51.428+0000 7fba1b7fe640 1 -- >> v2:172.21.15.181:3300/0 conn(0x7fb9fc0085e0 msgr2=0x7fb9fc008db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.181:3300/0 2024-04-01T22:32:51.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:51.428+0000 7fba1affd640 1 -- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9fc009ec0 msgr2=0x7fb9fc005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.181:3301/0 2024-04-01T22:32:51.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:51.428+0000 7fba1b7fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb9fc0085e0 0x7fb9fc008db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-01T22:32:51.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:51.428+0000 7fba1affd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9fc009ec0 0x7fb9fc005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-01T22:32:51.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:51.629+0000 7fba1a7fc640 1 -- >> v2:172.21.15.47:3300/0 conn(0x7fb9fc00a390 msgr2=0x7fb9fc00a790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.47:3300/0 2024-04-01T22:32:51.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:51.629+0000 7fba1a7fc640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb9fc00a390 0x7fb9fc00a790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-01T22:32:51.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:51.629+0000 7fba1b7fe640 1 -- >> v2:172.21.15.181:3300/0 conn(0x7fb9fc0085e0 msgr2=0x7fb9fc008db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.181:3300/0 2024-04-01T22:32:51.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:51.629+0000 7fba1b7fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb9fc0085e0 0x7fb9fc008db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-01T22:32:51.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:51.629+0000 7fba1affd640 1 -- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9fc009ec0 msgr2=0x7fb9fc005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.181:3301/0 2024-04-01T22:32:51.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:51.629+0000 7fba1affd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9fc009ec0 0x7fb9fc005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-01T22:32:52.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:52.030+0000 7fba1a7fc640 1 -- >> v2:172.21.15.47:3300/0 conn(0x7fb9fc00a390 msgr2=0x7fb9fc00a790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.47:3300/0 2024-04-01T22:32:52.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:52.030+0000 7fba1a7fc640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb9fc00a390 0x7fb9fc00a790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-01T22:32:52.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:52.030+0000 7fba1b7fe640 1 -- >> v2:172.21.15.181:3300/0 conn(0x7fb9fc0085e0 msgr2=0x7fb9fc008db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.181:3300/0 2024-04-01T22:32:52.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:52.030+0000 7fba1affd640 1 -- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9fc009ec0 msgr2=0x7fb9fc005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.181:3301/0 2024-04-01T22:32:52.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:52.030+0000 7fba1b7fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb9fc0085e0 0x7fb9fc008db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-01T22:32:52.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:52.030+0000 7fba1affd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9fc009ec0 0x7fb9fc005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-01T22:32:52.577 INFO:tasks.ceph.mon.b.smithi181.stderr:==00:00:00:07.132 37187== Warning: unimplemented fcntl command: 1036 2024-04-01T22:32:52.579 INFO:tasks.ceph.mon.c.smithi181.stderr:==00:00:00:07.135 37188== Warning: unimplemented fcntl command: 1036 2024-04-01T22:32:52.665 INFO:tasks.ceph.mon.a.smithi047.stderr:==00:00:00:07.277 37051== Warning: unimplemented fcntl command: 1036 2024-04-01T22:32:52.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:52.831+0000 7fba1a7fc640 1 -- >> v2:172.21.15.47:3300/0 conn(0x7fb9fc00a390 msgr2=0x7fb9fc00a790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.47:3300/0 2024-04-01T22:32:52.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:52.831+0000 7fba1a7fc640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb9fc00a390 0x7fb9fc00a790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-01T22:32:52.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:52.831+0000 7fba1b7fe640 1 -- >> v2:172.21.15.181:3300/0 conn(0x7fb9fc0085e0 msgr2=0x7fb9fc008db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.181:3300/0 2024-04-01T22:32:52.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:52.831+0000 7fba1affd640 1 -- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9fc009ec0 msgr2=0x7fb9fc005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.181:3301/0 2024-04-01T22:32:52.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:52.831+0000 7fba1b7fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb9fc0085e0 0x7fb9fc008db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-01T22:32:52.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:52.831+0000 7fba1affd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9fc009ec0 0x7fb9fc005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-01T22:32:52.896 INFO:tasks.ceph.mon.b.smithi181.stderr:==00:00:00:07.452 37187== Warning: unimplemented fcntl command: 1036 2024-04-01T22:32:52.899 INFO:tasks.ceph.mon.c.smithi181.stderr:==00:00:00:07.455 37188== Warning: unimplemented fcntl command: 1036 2024-04-01T22:32:52.991 INFO:tasks.ceph.mon.a.smithi047.stderr:==00:00:00:07.605 37051== Warning: unimplemented fcntl command: 1036 2024-04-01T22:32:54.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:54.428+0000 7fba18ff9640 1 -- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9fc009ec0 msgr2=0x7fb9fc005ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T22:32:54.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:54.428+0000 7fba18ff9640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9fc009ec0 0x7fb9fc005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:32:54.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:54.428+0000 7fba18ff9640 1 -- >> v2:172.21.15.181:3300/0 conn(0x7fb9fc0085e0 msgr2=0x7fb9fc008db0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T22:32:54.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:54.428+0000 7fba18ff9640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb9fc0085e0 0x7fb9fc008db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:32:54.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:54.428+0000 7fba18ff9640 1 -- >> v2:172.21.15.47:3300/0 conn(0x7fb9fc00a390 msgr2=0x7fb9fc00a790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T22:32:54.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:54.428+0000 7fba18ff9640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb9fc00a390 0x7fb9fc00a790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:32:54.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:54.428+0000 7fba18ff9640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba1c0cdae0 con 0x7fb9fc010840 2024-04-01T22:32:54.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:54.428+0000 7fba18ff9640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba1c0ce060 con 0x7fb9fc0095b0 2024-04-01T22:32:54.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:54.477+0000 7fba1a7fc640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fb9fc010840 0x7fb9fc012c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35106/0 (socket says 172.21.15.47:35106) 2024-04-01T22:32:54.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:54.477+0000 7fba1a7fc640 1 -- 172.21.15.47:0/2762491691 learned_addr learned my addr 172.21.15.47:0/2762491691 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T22:32:54.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:54.700+0000 7fba1a7fc640 1 -- 172.21.15.47:0/2762491691 >> v1:172.21.15.47:6789/0 conn(0x7fb9fc010840 legacy=0x7fb9fc012c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-01T22:32:54.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:54.700+0000 7fba1a7fc640 1 -- 172.21.15.47:0/2762491691 >> v1:172.21.15.47:6789/0 conn(0x7fb9fc010840 legacy=0x7fb9fc012c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-01T22:32:54.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:54.700+0000 7fba1a7fc640 1 --1- 172.21.15.47:0/2762491691 >> v1:172.21.15.47:6789/0 conn(0x7fb9fc010840 0x7fb9fc012c30 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).handle_connect_reply_1 read connect reply failed 2024-04-01T22:32:57.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:57.429+0000 7fba18ff9640 1 -- 172.21.15.47:0/2762491691 >> v1:172.21.15.181:6789/0 conn(0x7fb9fc0095b0 legacy=0x7fb9fc00f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:32:57.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:57.429+0000 7fba18ff9640 1 -- 172.21.15.47:0/2762491691 >> v1:172.21.15.47:6789/0 conn(0x7fb9fc010840 legacy=0x7fb9fc012c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:32:57.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:57.429+0000 7fba1b7fe640 1 -- 172.21.15.47:0/2762491691 reap_dead start 2024-04-01T22:32:57.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:57.429+0000 7fba18ff9640 1 --2- 172.21.15.47:0/2762491691 >> v2:172.21.15.47:3300/0 conn(0x7fb9fc008db0 0x7fb9fc00a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:32:57.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:57.429+0000 7fba18ff9640 1 --2- 172.21.15.47:0/2762491691 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9fc0085e0 0x7fb9fc005ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:32:57.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:57.429+0000 7fba18ff9640 1 -- 172.21.15.47:0/2762491691 --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9fc016370 con 0x7fb9fc00b100 2024-04-01T22:32:57.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:57.429+0000 7fba18ff9640 1 -- 172.21.15.47:0/2762491691 --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fba1c0c97d0 con 0x7fb9fc008db0 2024-04-01T22:32:57.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:57.429+0000 7fba18ff9640 1 -- 172.21.15.47:0/2762491691 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fba1c0cdd80 con 0x7fb9fc0085e0 2024-04-01T22:32:57.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:57.452+0000 7fba1affd640 1 --2- 172.21.15.47:0/2762491691 >> v2:172.21.15.47:3300/0 conn(0x7fb9fc008db0 0x7fb9fc00a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:32:57.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:57.571+0000 7fba1a7fc640 1 --2- 172.21.15.47:0/2762491691 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9fc0085e0 0x7fb9fc005ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:32:57.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:57.625+0000 7fba1a7fc640 1 -- 172.21.15.47:0/2762491691 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9fc0085e0 msgr2=0x7fb9fc005ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-01T22:32:57.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:57.625+0000 7fba1a7fc640 1 -- 172.21.15.47:0/2762491691 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9fc0085e0 msgr2=0x7fb9fc005ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-01T22:32:57.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:57.625+0000 7fba1a7fc640 1 --2- 172.21.15.47:0/2762491691 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9fc0085e0 0x7fb9fc005ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-01T22:32:57.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:57.625+0000 7fba1a7fc640 1 --2- 172.21.15.47:0/2762491691 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9fc0085e0 0x7fb9fc005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-01T22:32:57.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:57.679+0000 7fba1affd640 1 -- 172.21.15.47:0/2762491691 >> v2:172.21.15.47:3300/0 conn(0x7fb9fc008db0 msgr2=0x7fb9fc00a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-01T22:32:57.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:57.679+0000 7fba1affd640 1 -- 172.21.15.47:0/2762491691 >> v2:172.21.15.47:3300/0 conn(0x7fb9fc008db0 msgr2=0x7fb9fc00a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-01T22:32:57.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:57.679+0000 7fba1affd640 1 --2- 172.21.15.47:0/2762491691 >> v2:172.21.15.47:3300/0 conn(0x7fb9fc008db0 0x7fb9fc00a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-01T22:32:57.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:57.679+0000 7fba1affd640 1 --2- 172.21.15.47:0/2762491691 >> v2:172.21.15.47:3300/0 conn(0x7fb9fc008db0 0x7fb9fc00a790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-01T22:32:57.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:57.826+0000 7fba1a7fc640 1 --2- 172.21.15.47:0/2762491691 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9fc0085e0 0x7fb9fc005ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:32:57.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:57.828+0000 7fba1a7fc640 1 -- 172.21.15.47:0/2762491691 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9fc0085e0 msgr2=0x7fb9fc005ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-01T22:32:57.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:57.828+0000 7fba1a7fc640 1 -- 172.21.15.47:0/2762491691 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9fc0085e0 msgr2=0x7fb9fc005ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-01T22:32:57.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:57.828+0000 7fba1a7fc640 1 --2- 172.21.15.47:0/2762491691 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9fc0085e0 0x7fb9fc005ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-01T22:32:57.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:57.828+0000 7fba1a7fc640 1 --2- 172.21.15.47:0/2762491691 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9fc0085e0 0x7fb9fc005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-01T22:32:57.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:57.933+0000 7fba19ffb640 1 -- 172.21.15.47:0/2762491691 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1553727918 0 0) 0x7fb9fc016370 con 0x7fb9fc00b100 2024-04-01T22:32:57.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:57.933+0000 7fba19ffb640 1 -- 172.21.15.47:0/2762491691 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba08003520 con 0x7fb9fc00b100 2024-04-01T22:32:57.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:57.946+0000 7fba1affd640 1 --2- 172.21.15.47:0/2762491691 >> v2:172.21.15.47:3300/0 conn(0x7fb9fc008db0 0x7fb9fc00a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:32:57.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:57.998+0000 7fba19ffb640 1 -- 172.21.15.47:0/2762491691 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2502482327 0 0) 0x7fba08003520 con 0x7fb9fc00b100 2024-04-01T22:32:57.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:57.998+0000 7fba19ffb640 1 -- 172.21.15.47:0/2762491691 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9fc0085e0 msgr2=0x7fb9fc005ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T22:32:57.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:57.998+0000 7fba19ffb640 1 --2- 172.21.15.47:0/2762491691 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9fc0085e0 0x7fb9fc005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:32:57.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:57.998+0000 7fba19ffb640 1 -- 172.21.15.47:0/2762491691 >> v2:172.21.15.47:3300/0 conn(0x7fb9fc008db0 msgr2=0x7fb9fc00a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:32:57.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:57.998+0000 7fba19ffb640 1 --2- 172.21.15.47:0/2762491691 >> v2:172.21.15.47:3300/0 conn(0x7fb9fc008db0 0x7fb9fc00a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:32:57.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:57.998+0000 7fba19ffb640 1 -- 172.21.15.47:0/2762491691 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9fc00fd60 con 0x7fb9fc00b100 2024-04-01T22:32:57.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:57.998+0000 7fba19ffb640 1 -- 172.21.15.47:0/2762491691 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3952983659 0 0) 0x7fba0c003ec0 con 0x7fb9fc00b100 2024-04-01T22:32:57.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:57.998+0000 7fba19ffb640 1 -- 172.21.15.47:0/2762491691 >> v1:172.21.15.47:6789/0 conn(0x7fb9fc00b100 legacy=0x7fb9fc00d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:32:57.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:57.998+0000 7fba19ffb640 1 --2- 172.21.15.47:0/2762491691 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba080039e0 0x7fba08003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:32:57.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:57.998+0000 7fba19ffb640 1 --2- 172.21.15.47:0/2762491691 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba08004800 0x7fba08004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:32:57.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:57.998+0000 7fba19ffb640 1 --2- 172.21.15.47:0/2762491691 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9fc0085e0 0x7fba080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:32:57.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:57.998+0000 7fba19ffb640 1 -- 172.21.15.47:0/2762491691 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fba1c0c97d0 con 0x7fba080039e0 2024-04-01T22:32:57.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:57.998+0000 7fba19ffb640 1 -- 172.21.15.47:0/2762491691 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fba1c0cdd80 con 0x7fba08004800 2024-04-01T22:32:57.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:57.998+0000 7fba19ffb640 1 -- 172.21.15.47:0/2762491691 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fba0800bb80 con 0x7fb9fc0085e0 2024-04-01T22:32:57.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:57.998+0000 7fba1a7fc640 1 --2- 172.21.15.47:0/2762491691 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba08004800 0x7fba08004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:32:58.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.000+0000 7fba1b7fe640 1 --2- 172.21.15.47:0/2762491691 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9fc0085e0 0x7fba080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:32:58.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.010+0000 7fba1affd640 1 --2- 172.21.15.47:0/2762491691 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba080039e0 0x7fba08003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:32:58.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.057+0000 7fba1a7fc640 1 -- 172.21.15.47:0/2762491691 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9fc0085e0 msgr2=0x7fba080051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:32:58.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.057+0000 7fba1a7fc640 1 --2- 172.21.15.47:0/2762491691 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9fc0085e0 0x7fba080051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:32:58.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.057+0000 7fba1a7fc640 1 -- 172.21.15.47:0/2762491691 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba080039e0 msgr2=0x7fba08003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:32:58.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.057+0000 7fba1a7fc640 1 --2- 172.21.15.47:0/2762491691 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba080039e0 0x7fba08003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:32:58.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.057+0000 7fba1a7fc640 1 -- 172.21.15.47:0/2762491691 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba08003520 con 0x7fba08004800 2024-04-01T22:32:58.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.059+0000 7fba1a7fc640 1 --2- 172.21.15.47:0/2762491691 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba08004800 0x7fba08004c80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc009b60 tx=0x7fba08005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7df76590027dd514 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:32:58.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.130+0000 7fba19ffb640 1 -- 172.21.15.47:0/2762491691 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0403a070 con 0x7fba08004800 2024-04-01T22:32:58.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.130+0000 7fba19ffb640 1 -- 172.21.15.47:0/2762491691 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba04035410 con 0x7fba08004800 2024-04-01T22:32:58.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.130+0000 7fba19ffb640 1 -- 172.21.15.47:0/2762491691 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba04009b60 con 0x7fba08004800 2024-04-01T22:32:58.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.131+0000 7fba2190d640 1 -- 172.21.15.47:0/2762491691 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba08004800 msgr2=0x7fba08004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:32:58.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.131+0000 7fba2190d640 1 --2- 172.21.15.47:0/2762491691 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba08004800 0x7fba08004c80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc009b60 tx=0x7fba08005830 comp rx=0 tx=0).stop 2024-04-01T22:32:58.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.131+0000 7fba1b7fe640 1 -- 172.21.15.47:0/2762491691 reap_dead start 2024-04-01T22:32:58.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.131+0000 7fba2190d640 1 -- 172.21.15.47:0/2762491691 shutdown_connections 2024-04-01T22:32:58.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.131+0000 7fba2190d640 1 -- 172.21.15.47:0/2762491691 >> 172.21.15.47:0/2762491691 conn(0x7fba1c0cfdb0 msgr2=0x7fba1c0d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:32:58.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.131+0000 7fba2190d640 1 -- 172.21.15.47:0/2762491691 shutdown_connections 2024-04-01T22:32:58.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.131+0000 7fba2190d640 1 -- 172.21.15.47:0/2762491691 wait complete. 2024-04-01T22:32:58.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.132+0000 7fba2190d640 1 Processor -- start 2024-04-01T22:32:58.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.132+0000 7fba2190d640 1 -- start start 2024-04-01T22:32:58.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.133+0000 7fba2190d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba08004800 0x7fba1c0ad5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:32:58.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.133+0000 7fba2190d640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fba1c1f0ef0 0x7fba1c0aeea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:32:58.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.133+0000 7fba2190d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba1c0ac5d0 0x7fba1c153a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:32:58.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.133+0000 7fba2190d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fba1c15b400 con 0x7fba08004800 2024-04-01T22:32:58.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.133+0000 7fba2190d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fba1c0ce620 con 0x7fba1c0ac5d0 2024-04-01T22:32:58.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.133+0000 7fba2190d640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fba1c0cf430 con 0x7fba1c1f0ef0 2024-04-01T22:32:58.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.144+0000 7fba1a7fc640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fba1c1f0ef0 0x7fba1c0aeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:32:58.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.145+0000 7fba1a7fc640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fba1c1f0ef0 0x7fba1c0aeea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:56632/0 (socket says 172.21.15.47:56632) 2024-04-01T22:32:58.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.145+0000 7fba1a7fc640 1 -- 172.21.15.47:0/369138071 learned_addr learned my addr 172.21.15.47:0/369138071 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:32:58.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.152+0000 7fba1b7fe640 1 --2- 172.21.15.47:0/369138071 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba1c0ac5d0 0x7fba1c153a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:32:58.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.158+0000 7fba1a7fc640 1 -- 172.21.15.47:0/369138071 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba1c0ac5d0 msgr2=0x7fba1c153a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:32:58.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.158+0000 7fba1a7fc640 1 --2- 172.21.15.47:0/369138071 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba1c0ac5d0 0x7fba1c153a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:32:58.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.158+0000 7fba1a7fc640 1 -- 172.21.15.47:0/369138071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba08004800 msgr2=0x7fba1c0ad5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:32:58.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.158+0000 7fba1a7fc640 1 --2- 172.21.15.47:0/369138071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba08004800 0x7fba1c0ad5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:32:58.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.158+0000 7fba1a7fc640 1 -- 172.21.15.47:0/369138071 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba1c153fd0 con 0x7fba1c1f0ef0 2024-04-01T22:32:58.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.162+0000 7fba1a7fc640 1 --2- 172.21.15.47:0/369138071 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fba1c1f0ef0 0x7fba1c0aeea0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc009a90 tx=0x7fba04005c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:32:58.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.207+0000 7fba13fff640 1 -- 172.21.15.47:0/369138071 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba04045070 con 0x7fba1c1f0ef0 2024-04-01T22:32:58.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.207+0000 7fba13fff640 1 -- 172.21.15.47:0/369138071 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba04035e50 con 0x7fba1c1f0ef0 2024-04-01T22:32:58.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.207+0000 7fba13fff640 1 -- 172.21.15.47:0/369138071 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0403a040 con 0x7fba1c1f0ef0 2024-04-01T22:32:58.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.207+0000 7fba2190d640 1 -- 172.21.15.47:0/369138071 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba1c0ab770 con 0x7fba1c1f0ef0 2024-04-01T22:32:58.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.207+0000 7fba2190d640 1 -- 172.21.15.47:0/369138071 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fba1c0c63f0 con 0x7fba1c1f0ef0 2024-04-01T22:32:58.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.208+0000 7fba2190d640 1 -- 172.21.15.47:0/369138071 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba1c068210 con 0x7fba1c1f0ef0 2024-04-01T22:32:58.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.231+0000 7fba13fff640 1 -- 172.21.15.47:0/369138071 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fba0403d040 con 0x7fba1c1f0ef0 2024-04-01T22:32:58.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.231+0000 7fba13fff640 1 -- 172.21.15.47:0/369138071 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fba0403f790 con 0x7fba1c1f0ef0 2024-04-01T22:32:58.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.395+0000 7fba13fff640 1 -- 172.21.15.47:0/369138071 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fba04009b60 con 0x7fba1c1f0ef0 2024-04-01T22:32:58.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.519+0000 7fba2190d640 1 -- 172.21.15.47:0/369138071 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fba1c0b5990 con 0x7fba1c1f0ef0 2024-04-01T22:32:58.756 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-01T22:32:58.757+0000 7f6b17212040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-01T22:32:58.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.798+0000 7fba13fff640 1 -- 172.21.15.47:0/369138071 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fba04041ad0 con 0x7fba1c1f0ef0 2024-04-01T22:32:58.798 INFO:teuthology.orchestra.run.smithi047.stderr:adjusted tunables profile to default 2024-04-01T22:32:58.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.799+0000 7fba2190d640 1 -- 172.21.15.47:0/369138071 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fba1c1f0ef0 msgr2=0x7fba1c0aeea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:32:58.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.799+0000 7fba2190d640 1 --2- 172.21.15.47:0/369138071 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fba1c1f0ef0 0x7fba1c0aeea0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc009a90 tx=0x7fba04005c20 comp rx=0 tx=0).stop 2024-04-01T22:32:58.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.799+0000 7fba2190d640 1 -- 172.21.15.47:0/369138071 shutdown_connections 2024-04-01T22:32:58.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.799+0000 7fba2190d640 1 --2- 172.21.15.47:0/369138071 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba1c0ac5d0 0x7fba1c153a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:32:58.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.799+0000 7fba2190d640 1 --2- 172.21.15.47:0/369138071 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fba1c1f0ef0 0x7fba1c0aeea0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:32:58.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.799+0000 7fba2190d640 1 --2- 172.21.15.47:0/369138071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba08004800 0x7fba1c0ad5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:32:58.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.799+0000 7fba2190d640 1 -- 172.21.15.47:0/369138071 >> 172.21.15.47:0/369138071 conn(0x7fba1c0cfdb0 msgr2=0x7fba1c0c8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:32:58.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.799+0000 7fba2190d640 1 -- 172.21.15.47:0/369138071 shutdown_connections 2024-04-01T22:32:58.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:32:58.799+0000 7fba2190d640 1 -- 172.21.15.47:0/369138071 wait complete. 2024-04-01T22:32:58.810 INFO:tasks.ceph:check_enable_crimson: False 2024-04-01T22:32:58.810 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-01T22:32:58.810 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-01T22:32:58.811 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-01T22:32:58.814 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-01T22:32:58.815+0000 7f6b17212040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-01T22:32:58.838 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-01T22:32:58.838 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-01T22:32:58.906 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-01T22:32:58.906 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-01T22:32:58.977 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-01T22:32:58.977 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-01T22:32:59.044 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-04-01T22:32:59.044 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-01T22:32:59.066 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-04-01T22:32:59.066+0000 7fd48c638040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-01T22:32:59.071 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-04-01T22:32:59.072 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-01T22:32:59.122 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-04-01T22:32:59.122+0000 7fd48c638040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-01T22:32:59.138 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-04-01T22:32:59.138 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-01T22:32:59.205 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-04-01T22:32:59.205 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-01T22:32:59.273 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new 7bd3f25d-e3a5-4932-b381-53dcbb464dde 0 2024-04-01T22:32:59.400 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-01T22:32:59.400+0000 7f6b17212040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-01T22:32:59.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.416+0000 7efdc0d65640 1 Processor -- start 2024-04-01T22:32:59.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.416+0000 7efdc0d65640 1 -- start start 2024-04-01T22:32:59.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.416+0000 7efdc0d65640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7efdbc1545f0 0x7efdbc15e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:32:59.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.417+0000 7efdc0d65640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efdbc0c86b0 0x7efdbc15a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:32:59.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.417+0000 7efdc0d65640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7efdbc06c220 0x7efdbc071200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:32:59.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.417+0000 7efdc0d65640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7efdbc0cb110 con 0x7efdbc1545f0 2024-04-01T22:32:59.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.417+0000 7efdc0d65640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7efdbc0c8ab0 con 0x7efdbc06c220 2024-04-01T22:32:59.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.417+0000 7efdc0d65640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7efdbc06cb20 con 0x7efdbc0c86b0 2024-04-01T22:32:59.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.417+0000 7efdb9d9b640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efdbc0c86b0 0x7efdbc15a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:32:59.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.417+0000 7efdbad9d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7efdbc06c220 0x7efdbc071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:32:59.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.417+0000 7efdba59c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7efdbc1545f0 0x7efdbc15e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:32:59.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.418+0000 7efdba59c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7efdbc1545f0 0x7efdbc15e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.181:46574/0 (socket says 172.21.15.181:46574) 2024-04-01T22:32:59.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.418+0000 7efdba59c640 1 -- 172.21.15.181:0/2890710190 learned_addr learned my addr 172.21.15.181:0/2890710190 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-04-01T22:32:59.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.420+0000 7efdb9d9b640 1 -- 172.21.15.181:0/2890710190 >> v2:172.21.15.181:3300/0 conn(0x7efdbc06c220 msgr2=0x7efdbc071200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:32:59.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.420+0000 7efdb9d9b640 1 --2- 172.21.15.181:0/2890710190 >> v2:172.21.15.181:3300/0 conn(0x7efdbc06c220 0x7efdbc071200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:32:59.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.420+0000 7efdb9d9b640 1 -- 172.21.15.181:0/2890710190 >> v2:172.21.15.47:3300/0 conn(0x7efdbc1545f0 msgr2=0x7efdbc15e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:32:59.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.420+0000 7efdb9d9b640 1 --2- 172.21.15.181:0/2890710190 >> v2:172.21.15.47:3300/0 conn(0x7efdbc1545f0 0x7efdbc15e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:32:59.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.420+0000 7efdb9d9b640 1 -- 172.21.15.181:0/2890710190 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdbc15da50 con 0x7efdbc0c86b0 2024-04-01T22:32:59.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.422+0000 7efdb9d9b640 1 --2- 172.21.15.181:0/2890710190 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efdbc0c86b0 0x7efdbc15a3c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efdbc15dc20 tx=0x7efdb002b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b7b8f738c21ec81 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:32:59.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.426+0000 7efdb959a640 1 -- 172.21.15.181:0/2890710190 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb0035020 con 0x7efdbc0c86b0 2024-04-01T22:32:59.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.427+0000 7efdb959a640 1 -- 172.21.15.181:0/2890710190 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdb0031800 con 0x7efdbc0c86b0 2024-04-01T22:32:59.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.427+0000 7efdb959a640 1 -- 172.21.15.181:0/2890710190 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb0031bd0 con 0x7efdbc0c86b0 2024-04-01T22:32:59.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.427+0000 7efdc0d65640 1 -- 172.21.15.181:0/2890710190 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efdbc0c86b0 msgr2=0x7efdbc15a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:32:59.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.427+0000 7efdc0d65640 1 --2- 172.21.15.181:0/2890710190 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efdbc0c86b0 0x7efdbc15a3c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efdbc15dc20 tx=0x7efdb002b8a0 comp rx=0 tx=0).stop 2024-04-01T22:32:59.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.427+0000 7efdc0d65640 1 -- 172.21.15.181:0/2890710190 shutdown_connections 2024-04-01T22:32:59.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.427+0000 7efdc0d65640 1 --2- 172.21.15.181:0/2890710190 >> v2:172.21.15.181:3300/0 conn(0x7efdbc06c220 0x7efdbc071200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:32:59.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.427+0000 7efdc0d65640 1 --2- 172.21.15.181:0/2890710190 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efdbc0c86b0 0x7efdbc15a3c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:32:59.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.427+0000 7efdc0d65640 1 --2- 172.21.15.181:0/2890710190 >> v2:172.21.15.47:3300/0 conn(0x7efdbc1545f0 0x7efdbc15e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:32:59.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.427+0000 7efdc0d65640 1 -- 172.21.15.181:0/2890710190 >> 172.21.15.181:0/2890710190 conn(0x7efdbc06b500 msgr2=0x7efdbc06f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:32:59.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.427+0000 7efdc0d65640 1 -- 172.21.15.181:0/2890710190 shutdown_connections 2024-04-01T22:32:59.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.428+0000 7efdc0d65640 1 -- 172.21.15.181:0/2890710190 wait complete. 2024-04-01T22:32:59.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.429+0000 7efdc0d65640 1 Processor -- start 2024-04-01T22:32:59.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.429+0000 7efdc0d65640 1 -- start start 2024-04-01T22:32:59.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.430+0000 7efdc0d65640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdbc06c220 0x7efdbc159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:32:59.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.430+0000 7efdc0d65640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efdbc0c86b0 0x7efdbc0aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:32:59.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.430+0000 7efdc0d65640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efdbc1545f0 0x7efdbc159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:32:59.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.430+0000 7efdc0d65640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efdbc15dfd0 con 0x7efdbc0c86b0 2024-04-01T22:32:59.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.430+0000 7efdc0d65640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7efdbc15dcf0 con 0x7efdbc06c220 2024-04-01T22:32:59.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.430+0000 7efdc0d65640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7efdbc1549d0 con 0x7efdbc1545f0 2024-04-01T22:32:59.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.430+0000 7efdba59c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdbc06c220 0x7efdbc159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:32:59.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.430+0000 7efdb9d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efdbc0c86b0 0x7efdbc0aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:32:59.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.431+0000 7efdb9d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efdbc0c86b0 0x7efdbc0aeda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.181:46590/0 (socket says 172.21.15.181:46590) 2024-04-01T22:32:59.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.431+0000 7efdb9d9b640 1 -- 172.21.15.181:0/425585008 learned_addr learned my addr 172.21.15.181:0/425585008 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-04-01T22:32:59.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.431+0000 7efdbad9d640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efdbc1545f0 0x7efdbc159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:32:59.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.434+0000 7efdba59c640 1 -- 172.21.15.181:0/425585008 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efdbc1545f0 msgr2=0x7efdbc159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:32:59.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.434+0000 7efdba59c640 1 --2- 172.21.15.181:0/425585008 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efdbc1545f0 0x7efdbc159f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:32:59.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.434+0000 7efdba59c640 1 -- 172.21.15.181:0/425585008 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efdbc0c86b0 msgr2=0x7efdbc0aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:32:59.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.434+0000 7efdba59c640 1 --2- 172.21.15.181:0/425585008 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efdbc0c86b0 0x7efdbc0aeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:32:59.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.434+0000 7efdba59c640 1 -- 172.21.15.181:0/425585008 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdbc0ae980 con 0x7efdbc06c220 2024-04-01T22:32:59.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.434+0000 7efdb9d9b640 1 --2- 172.21.15.181:0/425585008 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efdbc0c86b0 0x7efdbc0aeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T22:32:59.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.437+0000 7efdba59c640 1 --2- 172.21.15.181:0/425585008 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdbc06c220 0x7efdbc159770 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efdac00e8a0 tx=0x7efdac00ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:32:59.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.441+0000 7efdaaffd640 1 -- 172.21.15.181:0/425585008 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdac017070 con 0x7efdbc06c220 2024-04-01T22:32:59.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.441+0000 7efdaaffd640 1 -- 172.21.15.181:0/425585008 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdac00c940 con 0x7efdbc06c220 2024-04-01T22:32:59.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.441+0000 7efdc0d65640 1 -- 172.21.15.181:0/425585008 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdbc15a470 con 0x7efdbc06c220 2024-04-01T22:32:59.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.441+0000 7efdaaffd640 1 -- 172.21.15.181:0/425585008 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdac009e60 con 0x7efdbc06c220 2024-04-01T22:32:59.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.441+0000 7efdc0d65640 1 -- 172.21.15.181:0/425585008 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdbc1f40d0 con 0x7efdbc06c220 2024-04-01T22:32:59.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.442+0000 7efdc0d65640 1 -- 172.21.15.181:0/425585008 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdbc068420 con 0x7efdbc06c220 2024-04-01T22:32:59.457 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-01T22:32:59.457+0000 7f6b17212040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-01T22:32:59.503 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-01T22:32:59.503+0000 7f6b17212040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-01T22:32:59.558 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-01T22:32:59.559+0000 7f6b17212040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-01T22:32:59.602 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-01T22:32:59.602+0000 7f6b17212040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-01T22:32:59.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.667+0000 7efdaaffd640 1 -- 172.21.15.181:0/425585008 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efdac01a070 con 0x7efdbc06c220 2024-04-01T22:32:59.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.667+0000 7efdaaffd640 1 -- 172.21.15.181:0/425585008 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7efdac0066e0 con 0x7efdbc06c220 2024-04-01T22:32:59.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.667+0000 7efdaaffd640 1 -- 172.21.15.181:0/425585008 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7efdbc068420 con 0x7efdbc06c220 2024-04-01T22:32:59.713 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-04-01T22:32:59.714+0000 7fd48c638040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-01T22:32:59.721 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-01T22:32:59.722+0000 7f6b17212040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-01T22:32:59.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.741+0000 7efdc0d65640 1 -- 172.21.15.181:0/425585008 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7bd3f25d-e3a5-4932-b381-53dcbb464dde", "id": 0} v 0) -- 0x7efdbc068920 con 0x7efdbc06c220 2024-04-01T22:32:59.771 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-04-01T22:32:59.772+0000 7fd48c638040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-01T22:32:59.794 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-01T22:32:59.794+0000 7f6b17212040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-01T22:32:59.820 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-04-01T22:32:59.821+0000 7fd48c638040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-01T22:32:59.842 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-01T22:32:59.842+0000 7f6b17212040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-01T22:32:59.876 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-04-01T22:32:59.876+0000 7fd48c638040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-01T22:32:59.897 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-01T22:32:59.898+0000 7f6b17212040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-01T22:32:59.921 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-04-01T22:32:59.921+0000 7fd48c638040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-01T22:32:59.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.931+0000 7efdaaffd640 1 -- 172.21.15.181:0/425585008 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7bd3f25d-e3a5-4932-b381-53dcbb464dde", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7efdac005990 con 0x7efdbc06c220 2024-04-01T22:32:59.931 INFO:teuthology.orchestra.run.smithi181.stdout:0 2024-04-01T22:32:59.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.932+0000 7efdc0d65640 1 -- 172.21.15.181:0/425585008 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdbc06c220 msgr2=0x7efdbc159770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:32:59.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.932+0000 7efdc0d65640 1 --2- 172.21.15.181:0/425585008 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdbc06c220 0x7efdbc159770 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efdac00e8a0 tx=0x7efdac00ed60 comp rx=0 tx=0).stop 2024-04-01T22:32:59.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.932+0000 7efdc0d65640 1 -- 172.21.15.181:0/425585008 shutdown_connections 2024-04-01T22:32:59.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.932+0000 7efdc0d65640 1 --2- 172.21.15.181:0/425585008 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7efdbc1545f0 0x7efdbc159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:32:59.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.932+0000 7efdc0d65640 1 --2- 172.21.15.181:0/425585008 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efdbc0c86b0 0x7efdbc0aeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:32:59.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.932+0000 7efdc0d65640 1 --2- 172.21.15.181:0/425585008 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdbc06c220 0x7efdbc159770 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:32:59.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.932+0000 7efdc0d65640 1 -- 172.21.15.181:0/425585008 >> 172.21.15.181:0/425585008 conn(0x7efdbc06b500 msgr2=0x7efdbc0b1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:32:59.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.932+0000 7efdc0d65640 1 -- 172.21.15.181:0/425585008 shutdown_connections 2024-04-01T22:32:59.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:32:59.932+0000 7efdc0d65640 1 -- 172.21.15.181:0/425585008 wait complete. 2024-04-01T22:32:59.946 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new 2aa60ba2-67ff-43c7-96c4-82ae2f3855ef 1 2024-04-01T22:32:59.949 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-01T22:32:59.949+0000 7f6b17212040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-01T22:33:00.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.053+0000 7fe3e7c2e640 1 Processor -- start 2024-04-01T22:33:00.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.053+0000 7fe3e7c2e640 1 -- start start 2024-04-01T22:33:00.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.054+0000 7fe3e7c2e640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3e0152030 0x7fe3e0152410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:00.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.054+0000 7fe3e7c2e640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3e0073430 con 0x7fe3e006f070 2024-04-01T22:33:00.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.054+0000 7fe3e7c2e640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3e00736d0 con 0x7fe3e0158300 2024-04-01T22:33:00.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.054+0000 7fe3e7c2e640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fe3e00c6c70 con 0x7fe3e0152030 2024-04-01T22:33:00.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.055+0000 7fe3e61cb640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fe3e0158300 0x7fe3e0162b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53416/0 (socket says 172.21.15.181:53416) 2024-04-01T22:33:00.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.055+0000 7fe3e61cb640 1 -- 172.21.15.181:0/2517144145 learned_addr learned my addr 172.21.15.181:0/2517144145 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-04-01T22:33:00.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.055+0000 7fe3e59ca640 1 --2- 172.21.15.181:0/2517144145 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3e0152030 0x7fe3e0152410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:00.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.058+0000 7fe3e49c8640 1 -- 172.21.15.181:0/2517144145 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 605166198 0 0) 0x7fe3e0073430 con 0x7fe3e006f070 2024-04-01T22:33:00.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.058+0000 7fe3e49c8640 1 -- 172.21.15.181:0/2517144145 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3cc003520 con 0x7fe3e006f070 2024-04-01T22:33:00.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.058+0000 7fe3e59ca640 1 -- 172.21.15.181:0/2517144145 >> v1:172.21.15.181:6789/0 conn(0x7fe3e0158300 legacy=0x7fe3e0162b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:00.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.058+0000 7fe3e59ca640 1 -- 172.21.15.181:0/2517144145 >> v1:172.21.15.47:6789/0 conn(0x7fe3e006f070 legacy=0x7fe3e0072400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:00.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.058+0000 7fe3e59ca640 1 -- 172.21.15.181:0/2517144145 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3e00c6f50 con 0x7fe3e0152030 2024-04-01T22:33:00.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.060+0000 7fe3e59ca640 1 --2- 172.21.15.181:0/2517144145 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3e0152030 0x7fe3e0152410 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc0097d0 tx=0x7fe3dc02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98d5beb70e632e36 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:00.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.063+0000 7fe3e49c8640 1 -- 172.21.15.181:0/2517144145 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3dc035020 con 0x7fe3e0152030 2024-04-01T22:33:00.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.064+0000 7fe3e49c8640 1 -- 172.21.15.181:0/2517144145 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3dc031890 con 0x7fe3e0152030 2024-04-01T22:33:00.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.064+0000 7fe3e49c8640 1 -- 172.21.15.181:0/2517144145 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3dc031c60 con 0x7fe3e0152030 2024-04-01T22:33:00.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.064+0000 7fe3e7c2e640 1 -- 172.21.15.181:0/2517144145 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3e0152030 msgr2=0x7fe3e0152410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:00.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.064+0000 7fe3e7c2e640 1 --2- 172.21.15.181:0/2517144145 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3e0152030 0x7fe3e0152410 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc0097d0 tx=0x7fe3dc02b930 comp rx=0 tx=0).stop 2024-04-01T22:33:00.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.064+0000 7fe3e7c2e640 1 -- 172.21.15.181:0/2517144145 shutdown_connections 2024-04-01T22:33:00.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.064+0000 7fe3e7c2e640 1 --2- 172.21.15.181:0/2517144145 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3e0152030 0x7fe3e0152410 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:00.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.064+0000 7fe3e7c2e640 1 -- 172.21.15.181:0/2517144145 >> 172.21.15.181:0/2517144145 conn(0x7fe3e00cc450 msgr2=0x7fe3e00cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:00.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.064+0000 7fe3e7c2e640 1 -- 172.21.15.181:0/2517144145 shutdown_connections 2024-04-01T22:33:00.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.064+0000 7fe3e7c2e640 1 -- 172.21.15.181:0/2517144145 wait complete. 2024-04-01T22:33:00.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.066+0000 7fe3e7c2e640 1 Processor -- start 2024-04-01T22:33:00.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.066+0000 7fe3e7c2e640 1 -- start start 2024-04-01T22:33:00.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.066+0000 7fe3e7c2e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3e006f070 0x7fe3e00c6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:00.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.066+0000 7fe3e7c2e640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3e0152030 0x7fe3e00c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:00.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.066+0000 7fe3e7c2e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3e0158300 0x7fe3e00c3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:00.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.067+0000 7fe3e7c2e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e0071d80 con 0x7fe3e006f070 2024-04-01T22:33:00.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.067+0000 7fe3e7c2e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e00b1730 con 0x7fe3e0158300 2024-04-01T22:33:00.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.067+0000 7fe3e7c2e640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fe3e0071f00 con 0x7fe3e0152030 2024-04-01T22:33:00.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.067+0000 7fe3e51c9640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3e0152030 0x7fe3e00c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:00.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.067+0000 7fe3e59ca640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3e006f070 0x7fe3e00c6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:00.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.067+0000 7fe3e61cb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3e0158300 0x7fe3e00c3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:00.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.067+0000 7fe3e51c9640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3e0152030 0x7fe3e00c8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.181:58250/0 (socket says 172.21.15.181:58250) 2024-04-01T22:33:00.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.067+0000 7fe3e51c9640 1 -- 172.21.15.181:0/3064997050 learned_addr learned my addr 172.21.15.181:0/3064997050 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-04-01T22:33:00.068 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-04-01T22:33:00.069+0000 7fd48c638040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-01T22:33:00.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.071+0000 7fe3e51c9640 1 -- 172.21.15.181:0/3064997050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3e0158300 msgr2=0x7fe3e00c3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:00.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.071+0000 7fe3e51c9640 1 --2- 172.21.15.181:0/3064997050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3e0158300 0x7fe3e00c3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:00.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.071+0000 7fe3e51c9640 1 -- 172.21.15.181:0/3064997050 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3e006f070 msgr2=0x7fe3e00c6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:00.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.071+0000 7fe3e51c9640 1 --2- 172.21.15.181:0/3064997050 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3e006f070 0x7fe3e00c6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:00.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.071+0000 7fe3e51c9640 1 -- 172.21.15.181:0/3064997050 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3e01e4ef0 con 0x7fe3e0152030 2024-04-01T22:33:00.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.073+0000 7fe3e51c9640 1 --2- 172.21.15.181:0/3064997050 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3e0152030 0x7fe3e00c8f00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe3d000c530 tx=0x7fe3d000c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:00.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.075+0000 7fe3d67fc640 1 -- 172.21.15.181:0/3064997050 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d00052d0 con 0x7fe3e0152030 2024-04-01T22:33:00.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.075+0000 7fe3e7c2e640 1 -- 172.21.15.181:0/3064997050 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3e01e51d0 con 0x7fe3e0152030 2024-04-01T22:33:00.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.075+0000 7fe3e7c2e640 1 -- 172.21.15.181:0/3064997050 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3e01f2520 con 0x7fe3e0152030 2024-04-01T22:33:00.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.076+0000 7fe3e7c2e640 1 -- 172.21.15.181:0/3064997050 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3e00b2610 con 0x7fe3e0152030 2024-04-01T22:33:00.141 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-04-01T22:33:00.142+0000 7fd48c638040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-01T22:33:00.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.187+0000 7fe3d67fc640 1 -- 172.21.15.181:0/3064997050 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3d0005470 con 0x7fe3e0152030 2024-04-01T22:33:00.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.187+0000 7fe3d67fc640 1 -- 172.21.15.181:0/3064997050 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d0012830 con 0x7fe3e0152030 2024-04-01T22:33:00.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.187+0000 7fe3d67fc640 1 -- 172.21.15.181:0/3064997050 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe3d0012ab0 con 0x7fe3e0152030 2024-04-01T22:33:00.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.187+0000 7fe3d67fc640 1 -- 172.21.15.181:0/3064997050 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fe3d0025590 con 0x7fe3e0152030 2024-04-01T22:33:00.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.187+0000 7fe3d67fc640 1 -- 172.21.15.181:0/3064997050 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fe3e00b2610 con 0x7fe3e0152030 2024-04-01T22:33:00.190 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-04-01T22:33:00.190+0000 7fd48c638040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-01T22:33:00.245 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-04-01T22:33:00.245+0000 7fd48c638040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-01T22:33:00.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.261+0000 7fe3e7c2e640 1 -- 172.21.15.181:0/3064997050 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2aa60ba2-67ff-43c7-96c4-82ae2f3855ef", "id": 1} v 0) -- 0x7fe3e00b0cb0 con 0x7fe3e0152030 2024-04-01T22:33:00.294 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-04-01T22:33:00.294+0000 7fd48c638040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-01T22:33:00.344 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-01T22:33:00.344+0000 7f6b17212040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-01T22:33:00.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.347+0000 7fe3d67fc640 1 -- 172.21.15.181:0/3064997050 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2aa60ba2-67ff-43c7-96c4-82ae2f3855ef", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fe3e00b0cb0 con 0x7fe3e0152030 2024-04-01T22:33:00.347 INFO:teuthology.orchestra.run.smithi181.stdout:1 2024-04-01T22:33:00.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.348+0000 7fe3e7c2e640 1 -- 172.21.15.181:0/3064997050 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3e0152030 msgr2=0x7fe3e00c8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:00.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.348+0000 7fe3e7c2e640 1 --2- 172.21.15.181:0/3064997050 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3e0152030 0x7fe3e00c8f00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe3d000c530 tx=0x7fe3d000c9f0 comp rx=0 tx=0).stop 2024-04-01T22:33:00.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.348+0000 7fe3e7c2e640 1 -- 172.21.15.181:0/3064997050 shutdown_connections 2024-04-01T22:33:00.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.348+0000 7fe3e7c2e640 1 --2- 172.21.15.181:0/3064997050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3e0158300 0x7fe3e00c3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:00.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.348+0000 7fe3e7c2e640 1 --2- 172.21.15.181:0/3064997050 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe3e0152030 0x7fe3e00c8f00 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:00.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.348+0000 7fe3e7c2e640 1 --2- 172.21.15.181:0/3064997050 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3e006f070 0x7fe3e00c6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:00.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.348+0000 7fe3e7c2e640 1 -- 172.21.15.181:0/3064997050 >> 172.21.15.181:0/3064997050 conn(0x7fe3e00cc450 msgr2=0x7fe3e014f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:00.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.348+0000 7fe3e7c2e640 1 -- 172.21.15.181:0/3064997050 shutdown_connections 2024-04-01T22:33:00.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.348+0000 7fe3e7c2e640 1 -- 172.21.15.181:0/3064997050 wait complete. 2024-04-01T22:33:00.358 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new d83f8a98-6db8-42b7-9ef6-5b16eb9a3492 2 2024-04-01T22:33:00.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.459+0000 7fdaf1d02640 1 Processor -- start 2024-04-01T22:33:00.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.460+0000 7fdaf1d02640 1 -- start start 2024-04-01T22:33:00.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.460+0000 7fdaf1d02640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdaec0c93f0 0x7fdaec0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:00.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.460+0000 7fdaf1d02640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fdaec15afc0 0x7fdaec06c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:00.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.460+0000 7fdaf1d02640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaec0cdae0 con 0x7fdaec06c770 2024-04-01T22:33:00.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.460+0000 7fdaf1d02640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fdaec0c97d0 con 0x7fdaec15afc0 2024-04-01T22:33:00.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.460+0000 7fdaf1d02640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fdaec0cdd80 con 0x7fdaec0c93f0 2024-04-01T22:33:00.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.461+0000 7fdaeb7fe640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdaec0c93f0 0x7fdaec0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:00.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.461+0000 7fdaeaffd640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fdaec15afc0 0x7fdaec06c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:00.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.461+0000 7fdaeaffd640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fdaec15afc0 0x7fdaec06c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.181:46614/0 (socket says 172.21.15.181:46614) 2024-04-01T22:33:00.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.461+0000 7fdaeaffd640 1 -- 172.21.15.181:0/4066787895 learned_addr learned my addr 172.21.15.181:0/4066787895 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-04-01T22:33:00.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.463+0000 7fdaeb7fe640 1 -- 172.21.15.181:0/4066787895 >> v2:172.21.15.47:3300/0 conn(0x7fdaec15afc0 msgr2=0x7fdaec06c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:00.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.463+0000 7fdaeb7fe640 1 --2- 172.21.15.181:0/4066787895 >> v2:172.21.15.47:3300/0 conn(0x7fdaec15afc0 0x7fdaec06c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:00.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.463+0000 7fdaeb7fe640 1 -- 172.21.15.181:0/4066787895 >> v1:172.21.15.47:6789/0 conn(0x7fdaec06c770 legacy=0x7fdaec0cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:00.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.463+0000 7fdaeb7fe640 1 -- 172.21.15.181:0/4066787895 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaec0ce060 con 0x7fdaec0c93f0 2024-04-01T22:33:00.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.465+0000 7fdaeb7fe640 1 --2- 172.21.15.181:0/4066787895 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdaec0c93f0 0x7fdaec0cee30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdadc0097a0 tx=0x7fdadc02b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54d567bd39c752e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:00.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.469+0000 7fdaea7fc640 1 -- 172.21.15.181:0/4066787895 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdadc038070 con 0x7fdaec0c93f0 2024-04-01T22:33:00.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.469+0000 7fdaea7fc640 1 -- 172.21.15.181:0/4066787895 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdadc031700 con 0x7fdaec0c93f0 2024-04-01T22:33:00.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.469+0000 7fdaea7fc640 1 -- 172.21.15.181:0/4066787895 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdadc031ad0 con 0x7fdaec0c93f0 2024-04-01T22:33:00.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.470+0000 7fdaf1d02640 1 -- 172.21.15.181:0/4066787895 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdaec0c93f0 msgr2=0x7fdaec0cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:00.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.470+0000 7fdaf1d02640 1 --2- 172.21.15.181:0/4066787895 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdaec0c93f0 0x7fdaec0cee30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdadc0097a0 tx=0x7fdadc02b7a0 comp rx=0 tx=0).stop 2024-04-01T22:33:00.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.470+0000 7fdaf1d02640 1 -- 172.21.15.181:0/4066787895 shutdown_connections 2024-04-01T22:33:00.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.470+0000 7fdaf1d02640 1 --2- 172.21.15.181:0/4066787895 >> v2:172.21.15.47:3300/0 conn(0x7fdaec15afc0 0x7fdaec06c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:00.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.470+0000 7fdaf1d02640 1 --2- 172.21.15.181:0/4066787895 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdaec0c93f0 0x7fdaec0cee30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:00.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.470+0000 7fdaf1d02640 1 -- 172.21.15.181:0/4066787895 >> 172.21.15.181:0/4066787895 conn(0x7fdaec0cfdb0 msgr2=0x7fdaec0d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:00.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.470+0000 7fdaf1d02640 1 -- 172.21.15.181:0/4066787895 shutdown_connections 2024-04-01T22:33:00.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.470+0000 7fdaf1d02640 1 -- 172.21.15.181:0/4066787895 wait complete. 2024-04-01T22:33:00.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.471+0000 7fdaf1d02640 1 Processor -- start 2024-04-01T22:33:00.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.471+0000 7fdaf1d02640 1 -- start start 2024-04-01T22:33:00.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.472+0000 7fdaf1d02640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdaec06c770 0x7fdaec156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:00.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.472+0000 7fdaf1d02640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdaec0c93f0 0x7fdaec158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:00.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.472+0000 7fdaf1d02640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdaec15afc0 0x7fdaec1f08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:00.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.472+0000 7fdaf1d02640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdaec15b400 con 0x7fdaec0c93f0 2024-04-01T22:33:00.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.472+0000 7fdaf1d02640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fdaec0ce620 con 0x7fdaec06c770 2024-04-01T22:33:00.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.472+0000 7fdaf1d02640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fdaec0cf430 con 0x7fdaec15afc0 2024-04-01T22:33:00.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.472+0000 7fdaeb7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdaec06c770 0x7fdaec156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:00.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.473+0000 7fdaeaffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdaec0c93f0 0x7fdaec158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:00.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.473+0000 7fdaebfff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdaec15afc0 0x7fdaec1f08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:00.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.473+0000 7fdaeaffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdaec0c93f0 0x7fdaec158600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.181:46620/0 (socket says 172.21.15.181:46620) 2024-04-01T22:33:00.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.473+0000 7fdaeaffd640 1 -- 172.21.15.181:0/2080680482 learned_addr learned my addr 172.21.15.181:0/2080680482 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-04-01T22:33:00.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.476+0000 7fdaeaffd640 1 -- 172.21.15.181:0/2080680482 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdaec15afc0 msgr2=0x7fdaec1f08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:00.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.476+0000 7fdaeaffd640 1 --2- 172.21.15.181:0/2080680482 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdaec15afc0 0x7fdaec1f08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:00.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.476+0000 7fdaeaffd640 1 -- 172.21.15.181:0/2080680482 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdaec06c770 msgr2=0x7fdaec156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:00.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.476+0000 7fdaeaffd640 1 --2- 172.21.15.181:0/2080680482 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdaec06c770 0x7fdaec156380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:00.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.476+0000 7fdaeaffd640 1 -- 172.21.15.181:0/2080680482 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaec0c6280 con 0x7fdaec0c93f0 2024-04-01T22:33:00.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.478+0000 7fdaeaffd640 1 --2- 172.21.15.181:0/2080680482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdaec0c93f0 0x7fdaec158600 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdae000e870 tx=0x7fdae000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:00.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.482+0000 7fdad3fff640 1 -- 172.21.15.181:0/2080680482 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae0017070 con 0x7fdaec0c93f0 2024-04-01T22:33:00.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.482+0000 7fdad3fff640 1 -- 172.21.15.181:0/2080680482 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdae000c8e0 con 0x7fdaec0c93f0 2024-04-01T22:33:00.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.482+0000 7fdad3fff640 1 -- 172.21.15.181:0/2080680482 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae000ccd0 con 0x7fdaec0c93f0 2024-04-01T22:33:00.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.483+0000 7fdaf1d02640 1 -- 172.21.15.181:0/2080680482 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaec0b5110 con 0x7fdaec0c93f0 2024-04-01T22:33:00.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.483+0000 7fdaf1d02640 1 -- 172.21.15.181:0/2080680482 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaec0b56c0 con 0x7fdaec0c93f0 2024-04-01T22:33:00.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.484+0000 7fdaf1d02640 1 -- 172.21.15.181:0/2080680482 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaec068210 con 0x7fdaec0c93f0 2024-04-01T22:33:00.484 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-01T22:33:00.485+0000 7f6b17212040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-01T22:33:00.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.486+0000 7fdad3fff640 1 -- 172.21.15.181:0/2080680482 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdae001a070 con 0x7fdaec0c93f0 2024-04-01T22:33:00.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.486+0000 7fdad3fff640 1 -- 172.21.15.181:0/2080680482 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fdae0013470 con 0x7fdaec0c93f0 2024-04-01T22:33:00.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.609+0000 7fdad3fff640 1 -- 172.21.15.181:0/2080680482 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fdae0006520 con 0x7fdaec0c93f0 2024-04-01T22:33:00.614 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-01T22:33:00.615+0000 7f6b17212040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-01T22:33:00.661 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-01T22:33:00.662+0000 7f6b17212040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-01T22:33:00.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.692+0000 7fdaf1d02640 1 -- 172.21.15.181:0/2080680482 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d83f8a98-6db8-42b7-9ef6-5b16eb9a3492", "id": 2} v 0) -- 0x7fdaec06cf00 con 0x7fdaec0c93f0 2024-04-01T22:33:00.697 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-04-01T22:33:00.698+0000 7fd48c638040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-01T22:33:00.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.743+0000 7fdad3fff640 1 -- 172.21.15.181:0/2080680482 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d83f8a98-6db8-42b7-9ef6-5b16eb9a3492", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fdae00067e0 con 0x7fdaec0c93f0 2024-04-01T22:33:00.743 INFO:teuthology.orchestra.run.smithi181.stdout:2 2024-04-01T22:33:00.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.744+0000 7fdaf1d02640 1 -- 172.21.15.181:0/2080680482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdaec0c93f0 msgr2=0x7fdaec158600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:00.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.744+0000 7fdaf1d02640 1 --2- 172.21.15.181:0/2080680482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdaec0c93f0 0x7fdaec158600 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdae000e870 tx=0x7fdae000ed30 comp rx=0 tx=0).stop 2024-04-01T22:33:00.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.745+0000 7fdaf1d02640 1 -- 172.21.15.181:0/2080680482 shutdown_connections 2024-04-01T22:33:00.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.745+0000 7fdaf1d02640 1 --2- 172.21.15.181:0/2080680482 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdaec15afc0 0x7fdaec1f08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:00.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.745+0000 7fdaf1d02640 1 --2- 172.21.15.181:0/2080680482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdaec0c93f0 0x7fdaec158600 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:00.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.745+0000 7fdaf1d02640 1 --2- 172.21.15.181:0/2080680482 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdaec06c770 0x7fdaec156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:00.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.745+0000 7fdaf1d02640 1 -- 172.21.15.181:0/2080680482 >> 172.21.15.181:0/2080680482 conn(0x7fdaec0cfdb0 msgr2=0x7fdaec1542e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:00.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.745+0000 7fdaf1d02640 1 -- 172.21.15.181:0/2080680482 shutdown_connections 2024-04-01T22:33:00.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.745+0000 7fdaf1d02640 1 -- 172.21.15.181:0/2080680482 wait complete. 2024-04-01T22:33:00.755 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new edc02ed5-d25c-4dc9-a0c3-7a26f20fae07 3 2024-04-01T22:33:00.779 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-01T22:33:00.779+0000 7f6b17212040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-01T22:33:00.841 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-04-01T22:33:00.842+0000 7fd48c638040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-01T22:33:00.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.857+0000 7f9900b8a640 1 Processor -- start 2024-04-01T22:33:00.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.857+0000 7f9900b8a640 1 -- start start 2024-04-01T22:33:00.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.858+0000 7f9900b8a640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98fc150f80 0x7f98fc0cb680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:00.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.858+0000 7f9900b8a640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f98fc157bc0 0x7f98fc0729d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:00.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.858+0000 7f9900b8a640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98fc151360 con 0x7f98fc0cbbc0 2024-04-01T22:33:00.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.858+0000 7f9900b8a640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f98fc0c4dd0 con 0x7f98fc157bc0 2024-04-01T22:33:00.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.858+0000 7f9900b8a640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f98fc0c5b80 con 0x7f98fc150f80 2024-04-01T22:33:00.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.858+0000 7f98fad9d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f98fc157bc0 0x7f98fc0729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:00.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.858+0000 7f98f1d9b640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f98fc0cbbc0 0x7f98fc1574b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.181:57386/0 (socket says 172.21.15.181:57386) 2024-04-01T22:33:00.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.858+0000 7f98f1d9b640 1 -- 172.21.15.181:0/3199383506 learned_addr learned my addr 172.21.15.181:0/3199383506 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-04-01T22:33:00.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.858+0000 7f98fa59c640 1 --2- 172.21.15.181:0/3199383506 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98fc150f80 0x7f98fc0cb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:00.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.861+0000 7f98fad9d640 1 -- 172.21.15.181:0/3199383506 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98fc150f80 msgr2=0x7f98fc0cb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:00.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.861+0000 7f98fad9d640 1 --2- 172.21.15.181:0/3199383506 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98fc150f80 0x7f98fc0cb680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:00.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.861+0000 7f98fad9d640 1 -- 172.21.15.181:0/3199383506 >> v1:172.21.15.47:6789/0 conn(0x7f98fc0cbbc0 legacy=0x7f98fc1574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:00.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.861+0000 7f98fad9d640 1 -- 172.21.15.181:0/3199383506 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98fc0c5000 con 0x7f98fc157bc0 2024-04-01T22:33:00.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.863+0000 7f98fad9d640 1 --2- 172.21.15.181:0/3199383506 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98fc157bc0 0x7f98fc0729d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f98f4009d90 tx=0x7f98f402be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc7cf709ee8c556c server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:00.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.867+0000 7f98f9d9b640 1 -- 172.21.15.181:0/3199383506 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f4039070 con 0x7f98fc157bc0 2024-04-01T22:33:00.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.867+0000 7f98f9d9b640 1 -- 172.21.15.181:0/3199383506 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98f402cbc0 con 0x7f98fc157bc0 2024-04-01T22:33:00.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.867+0000 7f98f9d9b640 1 -- 172.21.15.181:0/3199383506 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f4034440 con 0x7f98fc157bc0 2024-04-01T22:33:00.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.868+0000 7f9900b8a640 1 -- 172.21.15.181:0/3199383506 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98fc157bc0 msgr2=0x7f98fc0729d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:00.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.868+0000 7f9900b8a640 1 --2- 172.21.15.181:0/3199383506 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98fc157bc0 0x7f98fc0729d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f98f4009d90 tx=0x7f98f402be10 comp rx=0 tx=0).stop 2024-04-01T22:33:00.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.868+0000 7f9900b8a640 1 -- 172.21.15.181:0/3199383506 shutdown_connections 2024-04-01T22:33:00.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.868+0000 7f9900b8a640 1 --2- 172.21.15.181:0/3199383506 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98fc157bc0 0x7f98fc0729d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:00.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.868+0000 7f9900b8a640 1 --2- 172.21.15.181:0/3199383506 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98fc150f80 0x7f98fc0cb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:00.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.868+0000 7f9900b8a640 1 -- 172.21.15.181:0/3199383506 >> 172.21.15.181:0/3199383506 conn(0x7f98fc06b110 msgr2=0x7f98fc06b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:00.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.868+0000 7f9900b8a640 1 -- 172.21.15.181:0/3199383506 shutdown_connections 2024-04-01T22:33:00.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.868+0000 7f9900b8a640 1 -- 172.21.15.181:0/3199383506 wait complete. 2024-04-01T22:33:00.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.869+0000 7f9900b8a640 1 Processor -- start 2024-04-01T22:33:00.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.869+0000 7f9900b8a640 1 -- start start 2024-04-01T22:33:00.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.870+0000 7f9900b8a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98fc0cbbc0 0x7f98fc14f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:00.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.870+0000 7f9900b8a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98fc150f80 0x7f98fc14a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:00.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.870+0000 7f9900b8a640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98fc157bc0 0x7f98fc13bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:00.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.870+0000 7f9900b8a640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f98fc0c58a0 con 0x7f98fc150f80 2024-04-01T22:33:00.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.870+0000 7f9900b8a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f98fc0c55c0 con 0x7f98fc0cbbc0 2024-04-01T22:33:00.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.870+0000 7f9900b8a640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f98fc156f90 con 0x7f98fc157bc0 2024-04-01T22:33:00.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.871+0000 7f98fa59c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98fc0cbbc0 0x7f98fc14f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:00.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.871+0000 7f98f1d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98fc150f80 0x7f98fc14a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:00.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.871+0000 7f98fad9d640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98fc157bc0 0x7f98fc13bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:00.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.871+0000 7f98f1d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98fc150f80 0x7f98fc14a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.181:46634/0 (socket says 172.21.15.181:46634) 2024-04-01T22:33:00.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.871+0000 7f98f1d9b640 1 -- 172.21.15.181:0/395802007 learned_addr learned my addr 172.21.15.181:0/395802007 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-04-01T22:33:00.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.874+0000 7f98f1d9b640 1 -- 172.21.15.181:0/395802007 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98fc157bc0 msgr2=0x7f98fc13bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:00.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.874+0000 7f98f1d9b640 1 --2- 172.21.15.181:0/395802007 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98fc157bc0 0x7f98fc13bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:00.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.874+0000 7f98f1d9b640 1 -- 172.21.15.181:0/395802007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98fc0cbbc0 msgr2=0x7f98fc14f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:00.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.874+0000 7f98f1d9b640 1 --2- 172.21.15.181:0/395802007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98fc0cbbc0 0x7f98fc14f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:00.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.874+0000 7f98f1d9b640 1 -- 172.21.15.181:0/395802007 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98fc14ab70 con 0x7f98fc150f80 2024-04-01T22:33:00.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.876+0000 7f98f1d9b640 1 --2- 172.21.15.181:0/395802007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98fc150f80 0x7f98fc14a0a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f98e400c430 tx=0x7f98e400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:00.877 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-01T22:33:00.878+0000 7f6b17212040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-01T22:33:00.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.880+0000 7f98f37fe640 1 -- 172.21.15.181:0/395802007 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e4017070 con 0x7f98fc150f80 2024-04-01T22:33:00.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.880+0000 7f98f37fe640 1 -- 172.21.15.181:0/395802007 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98e4005ce0 con 0x7f98fc150f80 2024-04-01T22:33:00.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.880+0000 7f9900b8a640 1 -- 172.21.15.181:0/395802007 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98fc158b80 con 0x7f98fc150f80 2024-04-01T22:33:00.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.880+0000 7f98f37fe640 1 -- 172.21.15.181:0/395802007 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e40072f0 con 0x7f98fc150f80 2024-04-01T22:33:00.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.880+0000 7f9900b8a640 1 -- 172.21.15.181:0/395802007 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98fc159140 con 0x7f98fc150f80 2024-04-01T22:33:00.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.881+0000 7f9900b8a640 1 -- 172.21.15.181:0/395802007 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98fc06b680 con 0x7f98fc150f80 2024-04-01T22:33:00.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.883+0000 7f98f37fe640 1 -- 172.21.15.181:0/395802007 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f98e401a070 con 0x7f98fc150f80 2024-04-01T22:33:00.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.883+0000 7f98f37fe640 1 -- 172.21.15.181:0/395802007 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f98e401b840 con 0x7f98fc150f80 2024-04-01T22:33:00.962 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-04-01T22:33:00.962+0000 7fd48c638040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-01T22:33:00.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:00.986+0000 7f98f37fe640 1 -- 172.21.15.181:0/395802007 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f98fc06b680 con 0x7f98fc150f80 2024-04-01T22:33:01.012 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-04-01T22:33:01.012+0000 7fd48c638040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-01T22:33:01.042 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-01T22:33:01.043+0000 7f6b17212040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-01T22:33:01.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.063+0000 7f9900b8a640 1 -- 172.21.15.181:0/395802007 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd new", "uuid": "edc02ed5-d25c-4dc9-a0c3-7a26f20fae07", "id": 3} v 0) -- 0x7f98fc068210 con 0x7f98fc150f80 2024-04-01T22:33:01.087 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-01T22:33:01.087+0000 7f6b17212040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-01T22:33:01.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.113+0000 7f98f37fe640 1 -- 172.21.15.181:0/395802007 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "edc02ed5-d25c-4dc9-a0c3-7a26f20fae07", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f98e4021020 con 0x7f98fc150f80 2024-04-01T22:33:01.113 INFO:teuthology.orchestra.run.smithi181.stdout:3 2024-04-01T22:33:01.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.114+0000 7f9900b8a640 1 -- 172.21.15.181:0/395802007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98fc150f80 msgr2=0x7f98fc14a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:01.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.114+0000 7f9900b8a640 1 --2- 172.21.15.181:0/395802007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98fc150f80 0x7f98fc14a0a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f98e400c430 tx=0x7f98e400c8f0 comp rx=0 tx=0).stop 2024-04-01T22:33:01.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.114+0000 7f9900b8a640 1 -- 172.21.15.181:0/395802007 shutdown_connections 2024-04-01T22:33:01.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.114+0000 7f9900b8a640 1 --2- 172.21.15.181:0/395802007 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f98fc157bc0 0x7f98fc13bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:01.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.114+0000 7f9900b8a640 1 --2- 172.21.15.181:0/395802007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98fc150f80 0x7f98fc14a0a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:01.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.114+0000 7f9900b8a640 1 --2- 172.21.15.181:0/395802007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98fc0cbbc0 0x7f98fc14f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:01.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.114+0000 7f9900b8a640 1 -- 172.21.15.181:0/395802007 >> 172.21.15.181:0/395802007 conn(0x7f98fc06b110 msgr2=0x7f98fc071e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:01.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.115+0000 7f9900b8a640 1 -- 172.21.15.181:0/395802007 shutdown_connections 2024-04-01T22:33:01.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.115+0000 7f9900b8a640 1 -- 172.21.15.181:0/395802007 wait complete. 2024-04-01T22:33:01.126 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new b3d67e74-f51e-4474-9c62-dd0daa60c728 4 2024-04-01T22:33:01.133 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-04-01T22:33:01.133+0000 7fd48c638040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-01T22:33:01.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.226+0000 7f82a0084640 1 Processor -- start 2024-04-01T22:33:01.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.227+0000 7f82a0084640 1 -- start start 2024-04-01T22:33:01.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.227+0000 7f82a0084640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8298071850 0x7f8298158c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:01.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.227+0000 7f82a0084640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f829815c6a0 con 0x7f8298071470 2024-04-01T22:33:01.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.227+0000 7f82a0084640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f829815b840 con 0x7f82980c8560 2024-04-01T22:33:01.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.227+0000 7f82a0084640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f8298159170 con 0x7f8298071850 2024-04-01T22:33:01.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.228+0000 7f829d61f640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f82980c8560 0x7f82980c2df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53420/0 (socket says 172.21.15.181:53420) 2024-04-01T22:33:01.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.228+0000 7f829d61f640 1 -- 172.21.15.181:0/3330038330 learned_addr learned my addr 172.21.15.181:0/3330038330 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-04-01T22:33:01.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.228+0000 7f829e621640 1 --2- 172.21.15.181:0/3330038330 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8298071850 0x7f8298158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:01.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.231+0000 7f829ce1e640 1 -- 172.21.15.181:0/3330038330 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2580761410 0 0) 0x7f829815b840 con 0x7f82980c8560 2024-04-01T22:33:01.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.231+0000 7f829ce1e640 1 -- 172.21.15.181:0/3330038330 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8284003520 con 0x7f82980c8560 2024-04-01T22:33:01.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.231+0000 7f829ce1e640 1 -- 172.21.15.181:0/3330038330 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3183598123 0 0) 0x7f829815c6a0 con 0x7f8298071470 2024-04-01T22:33:01.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.231+0000 7f829ce1e640 1 -- 172.21.15.181:0/3330038330 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f829815b840 con 0x7f8298071470 2024-04-01T22:33:01.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.231+0000 7f829e621640 1 -- 172.21.15.181:0/3330038330 >> v1:172.21.15.181:6789/0 conn(0x7f82980c8560 legacy=0x7f82980c2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:01.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.231+0000 7f829e621640 1 -- 172.21.15.181:0/3330038330 >> v1:172.21.15.47:6789/0 conn(0x7f8298071470 legacy=0x7f8298151db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:01.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.231+0000 7f829e621640 1 -- 172.21.15.181:0/3330038330 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f829815bb20 con 0x7f8298071850 2024-04-01T22:33:01.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.233+0000 7f829e621640 1 --2- 172.21.15.181:0/3330038330 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8298071850 0x7f8298158c30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8290009dc0 tx=0x7f829002bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50ca61196a317757 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:01.236 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-04-01T22:33:01.237+0000 7fd48c638040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-01T22:33:01.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.237+0000 7f829ce1e640 1 -- 172.21.15.181:0/3330038330 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8290039070 con 0x7f8298071850 2024-04-01T22:33:01.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.237+0000 7f829ce1e640 1 -- 172.21.15.181:0/3330038330 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f829002ccd0 con 0x7f8298071850 2024-04-01T22:33:01.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.237+0000 7f829ce1e640 1 -- 172.21.15.181:0/3330038330 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8290034660 con 0x7f8298071850 2024-04-01T22:33:01.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.238+0000 7f82a0084640 1 -- 172.21.15.181:0/3330038330 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8298071850 msgr2=0x7f8298158c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:01.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.238+0000 7f82a0084640 1 --2- 172.21.15.181:0/3330038330 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8298071850 0x7f8298158c30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8290009dc0 tx=0x7f829002bf20 comp rx=0 tx=0).stop 2024-04-01T22:33:01.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.238+0000 7f82a0084640 1 -- 172.21.15.181:0/3330038330 shutdown_connections 2024-04-01T22:33:01.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.238+0000 7f82a0084640 1 --2- 172.21.15.181:0/3330038330 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f8298071850 0x7f8298158c30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:01.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.238+0000 7f82a0084640 1 -- 172.21.15.181:0/3330038330 >> 172.21.15.181:0/3330038330 conn(0x7f829806b500 msgr2=0x7f829806f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:01.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.238+0000 7f82a0084640 1 -- 172.21.15.181:0/3330038330 shutdown_connections 2024-04-01T22:33:01.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.238+0000 7f82a0084640 1 -- 172.21.15.181:0/3330038330 wait complete. 2024-04-01T22:33:01.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.239+0000 7f82a0084640 1 Processor -- start 2024-04-01T22:33:01.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.239+0000 7f82a0084640 1 -- start start 2024-04-01T22:33:01.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.240+0000 7f82a0084640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8298071470 0x7f82981e6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:01.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.240+0000 7f82a0084640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8298071850 0x7f829814b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:01.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.240+0000 7f82a0084640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f82980c8560 0x7f829814b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:01.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.240+0000 7f82a0084640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f829815c3c0 con 0x7f8298071470 2024-04-01T22:33:01.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.240+0000 7f82a0084640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f829815c0e0 con 0x7f8298071850 2024-04-01T22:33:01.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.240+0000 7f82a0084640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f82981524c0 con 0x7f82980c8560 2024-04-01T22:33:01.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.241+0000 7f829e621640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f82980c8560 0x7f829814b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:01.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.241+0000 7f829de20640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8298071470 0x7f82981e6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:01.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.241+0000 7f829d61f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8298071850 0x7f829814b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:01.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.241+0000 7f829de20640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8298071470 0x7f82981e6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.181:46644/0 (socket says 172.21.15.181:46644) 2024-04-01T22:33:01.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.241+0000 7f829de20640 1 -- 172.21.15.181:0/4139018227 learned_addr learned my addr 172.21.15.181:0/4139018227 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-04-01T22:33:01.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.244+0000 7f829de20640 1 -- 172.21.15.181:0/4139018227 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f82980c8560 msgr2=0x7f829814b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:01.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.244+0000 7f829de20640 1 --2- 172.21.15.181:0/4139018227 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f82980c8560 0x7f829814b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:01.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.244+0000 7f829de20640 1 -- 172.21.15.181:0/4139018227 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8298071850 msgr2=0x7f829814b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:01.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.244+0000 7f829de20640 1 --2- 172.21.15.181:0/4139018227 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8298071850 0x7f829814b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:01.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.244+0000 7f829de20640 1 -- 172.21.15.181:0/4139018227 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82981f4560 con 0x7f8298071470 2024-04-01T22:33:01.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.247+0000 7f829de20640 1 --2- 172.21.15.181:0/4139018227 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8298071470 0x7f82981e6b80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f829400c530 tx=0x7f829400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:01.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.250+0000 7f828e7fc640 1 -- 172.21.15.181:0/4139018227 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82940052d0 con 0x7f8298071470 2024-04-01T22:33:01.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.250+0000 7f828e7fc640 1 -- 172.21.15.181:0/4139018227 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8294005490 con 0x7f8298071470 2024-04-01T22:33:01.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.250+0000 7f82a0084640 1 -- 172.21.15.181:0/4139018227 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f829815a7e0 con 0x7f8298071470 2024-04-01T22:33:01.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.250+0000 7f828e7fc640 1 -- 172.21.15.181:0/4139018227 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8294012870 con 0x7f8298071470 2024-04-01T22:33:01.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.250+0000 7f82a0084640 1 -- 172.21.15.181:0/4139018227 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f829815aa80 con 0x7f8298071470 2024-04-01T22:33:01.251 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-01T22:33:01.250+0000 7f6b17212040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-01T22:33:01.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.251+0000 7f82a0084640 1 -- 172.21.15.181:0/4139018227 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8298158ac0 con 0x7f8298071470 2024-04-01T22:33:01.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.253+0000 7f828e7fc640 1 -- 172.21.15.181:0/4139018227 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8294012a10 con 0x7f8298071470 2024-04-01T22:33:01.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.254+0000 7f828e7fc640 1 -- 172.21.15.181:0/4139018227 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f8294025a20 con 0x7f8298071470 2024-04-01T22:33:01.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.356+0000 7f828e7fc640 1 -- 172.21.15.181:0/4139018227 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f8298158ac0 con 0x7f8298071470 2024-04-01T22:33:01.396 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-04-01T22:33:01.396+0000 7fd48c638040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-01T22:33:01.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.428+0000 7f82a0084640 1 -- 172.21.15.181:0/4139018227 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b3d67e74-f51e-4474-9c62-dd0daa60c728", "id": 4} v 0) -- 0x7f8298158220 con 0x7f8298071470 2024-04-01T22:33:01.440 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-04-01T22:33:01.441+0000 7fd48c638040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-01T22:33:01.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.478+0000 7f828e7fc640 1 -- 172.21.15.181:0/4139018227 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b3d67e74-f51e-4474-9c62-dd0daa60c728", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f8298158220 con 0x7f8298071470 2024-04-01T22:33:01.478 INFO:teuthology.orchestra.run.smithi181.stdout:4 2024-04-01T22:33:01.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.479+0000 7f82a0084640 1 -- 172.21.15.181:0/4139018227 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8298071470 msgr2=0x7f82981e6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:01.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.479+0000 7f82a0084640 1 --2- 172.21.15.181:0/4139018227 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8298071470 0x7f82981e6b80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f829400c530 tx=0x7f829400c9f0 comp rx=0 tx=0).stop 2024-04-01T22:33:01.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.479+0000 7f82a0084640 1 -- 172.21.15.181:0/4139018227 shutdown_connections 2024-04-01T22:33:01.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.479+0000 7f82a0084640 1 --2- 172.21.15.181:0/4139018227 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f82980c8560 0x7f829814b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:01.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.479+0000 7f82a0084640 1 --2- 172.21.15.181:0/4139018227 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8298071850 0x7f829814b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:01.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.479+0000 7f82a0084640 1 --2- 172.21.15.181:0/4139018227 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8298071470 0x7f82981e6b80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:01.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.479+0000 7f82a0084640 1 -- 172.21.15.181:0/4139018227 >> 172.21.15.181:0/4139018227 conn(0x7f829806b500 msgr2=0x7f82980742d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:01.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.479+0000 7f82a0084640 1 -- 172.21.15.181:0/4139018227 shutdown_connections 2024-04-01T22:33:01.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.479+0000 7f82a0084640 1 -- 172.21.15.181:0/4139018227 wait complete. 2024-04-01T22:33:01.490 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new d86e8f7a-99f4-4457-9949-cf2cb853e79b 5 2024-04-01T22:33:01.607 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-04-01T22:33:01.608+0000 7fd48c638040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-01T22:33:01.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.632+0000 7eff8c4c0640 1 Processor -- start 2024-04-01T22:33:01.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.632+0000 7eff8c4c0640 1 -- start start 2024-04-01T22:33:01.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.633+0000 7eff8c4c0640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7eff840cee30 0x7eff8415afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:01.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.633+0000 7eff8c4c0640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7eff840cc0d0 0x7eff840cc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:01.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.633+0000 7eff8c4c0640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff840cdae0 con 0x7eff840c93f0 2024-04-01T22:33:01.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.633+0000 7eff8c4c0640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7eff8415b500 con 0x7eff840cee30 2024-04-01T22:33:01.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.633+0000 7eff8c4c0640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7eff840cca60 con 0x7eff840cc0d0 2024-04-01T22:33:01.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.634+0000 7eff8aa5d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7eff840cc0d0 0x7eff840cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:01.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.634+0000 7eff89a5b640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7eff840cee30 0x7eff8415afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:01.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.634+0000 7eff8aa5d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7eff840cc0d0 0x7eff840cc520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:45836/0 (socket says 172.21.15.181:45836) 2024-04-01T22:33:01.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.634+0000 7eff8aa5d640 1 -- 172.21.15.181:0/2555976624 learned_addr learned my addr 172.21.15.181:0/2555976624 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-04-01T22:33:01.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.636+0000 7eff8aa5d640 1 -- 172.21.15.181:0/2555976624 >> v2:172.21.15.47:3300/0 conn(0x7eff840cee30 msgr2=0x7eff8415afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:01.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.636+0000 7eff8aa5d640 1 --2- 172.21.15.181:0/2555976624 >> v2:172.21.15.47:3300/0 conn(0x7eff840cee30 0x7eff8415afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:01.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.636+0000 7eff8aa5d640 1 -- 172.21.15.181:0/2555976624 >> v1:172.21.15.181:6789/0 conn(0x7eff840c93f0 legacy=0x7eff8406c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:01.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.636+0000 7eff8aa5d640 1 -- 172.21.15.181:0/2555976624 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff840c97d0 con 0x7eff840cc0d0 2024-04-01T22:33:01.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.638+0000 7eff8aa5d640 1 --2- 172.21.15.181:0/2555976624 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff840cc0d0 0x7eff840cc520 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7eff8408cd20 tx=0x7eff7c02be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6af535346553d57 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:01.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.644+0000 7eff8925a640 1 -- 172.21.15.181:0/2555976624 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7c02c9e0 con 0x7eff840cc0d0 2024-04-01T22:33:01.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.644+0000 7eff8925a640 1 -- 172.21.15.181:0/2555976624 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff7c02cb80 con 0x7eff840cc0d0 2024-04-01T22:33:01.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.644+0000 7eff8925a640 1 -- 172.21.15.181:0/2555976624 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7c0343f0 con 0x7eff840cc0d0 2024-04-01T22:33:01.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.645+0000 7eff8c4c0640 1 -- 172.21.15.181:0/2555976624 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff840cc0d0 msgr2=0x7eff840cc520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:01.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.645+0000 7eff8c4c0640 1 --2- 172.21.15.181:0/2555976624 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff840cc0d0 0x7eff840cc520 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7eff8408cd20 tx=0x7eff7c02be40 comp rx=0 tx=0).stop 2024-04-01T22:33:01.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.645+0000 7eff8c4c0640 1 -- 172.21.15.181:0/2555976624 shutdown_connections 2024-04-01T22:33:01.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.645+0000 7eff8c4c0640 1 --2- 172.21.15.181:0/2555976624 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff840cc0d0 0x7eff840cc520 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:01.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.645+0000 7eff8c4c0640 1 --2- 172.21.15.181:0/2555976624 >> v2:172.21.15.47:3300/0 conn(0x7eff840cee30 0x7eff8415afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:01.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.645+0000 7eff8c4c0640 1 -- 172.21.15.181:0/2555976624 >> 172.21.15.181:0/2555976624 conn(0x7eff840cfdb0 msgr2=0x7eff840d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:01.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.645+0000 7eff8c4c0640 1 -- 172.21.15.181:0/2555976624 shutdown_connections 2024-04-01T22:33:01.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.645+0000 7eff8c4c0640 1 -- 172.21.15.181:0/2555976624 wait complete. 2024-04-01T22:33:01.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.646+0000 7eff8c4c0640 1 Processor -- start 2024-04-01T22:33:01.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.646+0000 7eff8c4c0640 1 -- start start 2024-04-01T22:33:01.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.647+0000 7eff8c4c0640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7eff840c93f0 0x7eff840c4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:01.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.647+0000 7eff8c4c0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff840cc0d0 0x7eff84154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:01.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.647+0000 7eff8c4c0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff840cee30 0x7eff841550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:01.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.647+0000 7eff8c4c0640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7eff840ce340 con 0x7eff840cee30 2024-04-01T22:33:01.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.647+0000 7eff8c4c0640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7eff840ce060 con 0x7eff840cc0d0 2024-04-01T22:33:01.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.647+0000 7eff8c4c0640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7eff840ce620 con 0x7eff840c93f0 2024-04-01T22:33:01.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.648+0000 7eff8aa5d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff840cee30 0x7eff841550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:01.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.648+0000 7eff89a5b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff840cc0d0 0x7eff84154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:01.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.648+0000 7eff8a25c640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7eff840c93f0 0x7eff840c4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:01.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.648+0000 7eff8aa5d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff840cee30 0x7eff841550b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.181:46664/0 (socket says 172.21.15.181:46664) 2024-04-01T22:33:01.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.648+0000 7eff8aa5d640 1 -- 172.21.15.181:0/357370195 learned_addr learned my addr 172.21.15.181:0/357370195 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-04-01T22:33:01.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.651+0000 7eff8aa5d640 1 -- 172.21.15.181:0/357370195 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7eff840c93f0 msgr2=0x7eff840c4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:01.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.651+0000 7eff8aa5d640 1 --2- 172.21.15.181:0/357370195 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7eff840c93f0 0x7eff840c4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:01.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.651+0000 7eff8aa5d640 1 -- 172.21.15.181:0/357370195 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff840cc0d0 msgr2=0x7eff84154b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:01.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.651+0000 7eff8aa5d640 1 --2- 172.21.15.181:0/357370195 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff840cc0d0 0x7eff84154b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:01.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.651+0000 7eff8aa5d640 1 -- 172.21.15.181:0/357370195 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff840c60c0 con 0x7eff840cee30 2024-04-01T22:33:01.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.654+0000 7eff8aa5d640 1 --2- 172.21.15.181:0/357370195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff840cee30 0x7eff841550b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7eff7c009f10 tx=0x7eff7c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:01.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.657+0000 7eff7affd640 1 -- 172.21.15.181:0/357370195 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7c043020 con 0x7eff840cee30 2024-04-01T22:33:01.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.657+0000 7eff7affd640 1 -- 172.21.15.181:0/357370195 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff7c03e450 con 0x7eff840cee30 2024-04-01T22:33:01.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.657+0000 7eff7affd640 1 -- 172.21.15.181:0/357370195 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7c03e820 con 0x7eff840cee30 2024-04-01T22:33:01.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.657+0000 7eff8c4c0640 1 -- 172.21.15.181:0/357370195 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff840c63a0 con 0x7eff840cee30 2024-04-01T22:33:01.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.657+0000 7eff8c4c0640 1 -- 172.21.15.181:0/357370195 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff840c6960 con 0x7eff840cee30 2024-04-01T22:33:01.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.658+0000 7eff8c4c0640 1 -- 172.21.15.181:0/357370195 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff84068210 con 0x7eff840cee30 2024-04-01T22:33:01.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.661+0000 7eff7affd640 1 -- 172.21.15.181:0/357370195 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7eff7c046020 con 0x7eff840cee30 2024-04-01T22:33:01.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.661+0000 7eff7affd640 1 -- 172.21.15.181:0/357370195 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7eff7c0519b0 con 0x7eff840cee30 2024-04-01T22:33:01.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.765+0000 7eff7affd640 1 -- 172.21.15.181:0/357370195 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7eff7c04d030 con 0x7eff840cee30 2024-04-01T22:33:01.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.837+0000 7eff8c4c0640 1 -- 172.21.15.181:0/357370195 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d86e8f7a-99f4-4457-9949-cf2cb853e79b", "id": 5} v 0) -- 0x7eff8406cf00 con 0x7eff840cee30 2024-04-01T22:33:01.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.893+0000 7eff7affd640 1 -- 172.21.15.181:0/357370195 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d86e8f7a-99f4-4457-9949-cf2cb853e79b", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7eff7c03e9c0 con 0x7eff840cee30 2024-04-01T22:33:01.893 INFO:teuthology.orchestra.run.smithi181.stdout:5 2024-04-01T22:33:01.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.894+0000 7eff8c4c0640 1 -- 172.21.15.181:0/357370195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff840cee30 msgr2=0x7eff841550b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:01.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.894+0000 7eff8c4c0640 1 --2- 172.21.15.181:0/357370195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff840cee30 0x7eff841550b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7eff7c009f10 tx=0x7eff7c004a40 comp rx=0 tx=0).stop 2024-04-01T22:33:01.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.894+0000 7eff8c4c0640 1 -- 172.21.15.181:0/357370195 shutdown_connections 2024-04-01T22:33:01.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.894+0000 7eff8c4c0640 1 --2- 172.21.15.181:0/357370195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff840cee30 0x7eff841550b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:01.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.894+0000 7eff8c4c0640 1 --2- 172.21.15.181:0/357370195 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff840cc0d0 0x7eff84154b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:01.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.894+0000 7eff8c4c0640 1 --2- 172.21.15.181:0/357370195 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7eff840c93f0 0x7eff840c4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:01.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.894+0000 7eff8c4c0640 1 -- 172.21.15.181:0/357370195 >> 172.21.15.181:0/357370195 conn(0x7eff840cfdb0 msgr2=0x7eff84159f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:01.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.894+0000 7eff8c4c0640 1 -- 172.21.15.181:0/357370195 shutdown_connections 2024-04-01T22:33:01.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:01.894+0000 7eff8c4c0640 1 -- 172.21.15.181:0/357370195 wait complete. 2024-04-01T22:33:01.905 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new aa08266c-1719-4abd-afb9-e7e8ac593658 6 2024-04-01T22:33:02.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.007+0000 7fbbc7de2640 1 Processor -- start 2024-04-01T22:33:02.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.007+0000 7fbbc7de2640 1 -- start start 2024-04-01T22:33:02.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.008+0000 7fbbc7de2640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fbbc00c9300 0x7fbbc00c9e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:02.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.008+0000 7fbbc7de2640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbbc00c2cb0 0x7fbbc00c96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:02.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.008+0000 7fbbc7de2640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbc01587d0 con 0x7fbbc0158020 2024-04-01T22:33:02.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.008+0000 7fbbc7de2640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fbbc0158ab0 con 0x7fbbc00c2cb0 2024-04-01T22:33:02.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.008+0000 7fbbc7de2640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fbbc0158d90 con 0x7fbbc00c9300 2024-04-01T22:33:02.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.009+0000 7fbbc5b7e640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fbbc00c9300 0x7fbbc00c9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:02.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.009+0000 7fbbc537d640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbbc00c2cb0 0x7fbbc00c96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:02.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.009+0000 7fbbc5b7e640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fbbc00c9300 0x7fbbc00c9e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:45854/0 (socket says 172.21.15.181:45854) 2024-04-01T22:33:02.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.009+0000 7fbbc537d640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbbc00c2cb0 0x7fbbc00c96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.181:46678/0 (socket says 172.21.15.181:46678) 2024-04-01T22:33:02.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.009+0000 7fbbc5b7e640 1 -- 172.21.15.181:0/71610253 learned_addr learned my addr 172.21.15.181:0/71610253 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-04-01T22:33:02.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.011+0000 7fbbc5b7e640 1 -- 172.21.15.181:0/71610253 >> v2:172.21.15.47:3300/0 conn(0x7fbbc00c2cb0 msgr2=0x7fbbc00c96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:02.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.011+0000 7fbbc5b7e640 1 --2- 172.21.15.181:0/71610253 >> v2:172.21.15.47:3300/0 conn(0x7fbbc00c2cb0 0x7fbbc00c96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:02.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.011+0000 7fbbc5b7e640 1 -- 172.21.15.181:0/71610253 >> v1:172.21.15.181:6789/0 conn(0x7fbbc0158020 legacy=0x7fbbc015bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:02.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.011+0000 7fbbc5b7e640 1 -- 172.21.15.181:0/71610253 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbc015b7b0 con 0x7fbbc00c9300 2024-04-01T22:33:02.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.011+0000 7fbbc537d640 1 --2- 172.21.15.181:0/71610253 >> v2:172.21.15.47:3300/0 conn(0x7fbbc00c2cb0 0x7fbbc00c96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T22:33:02.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.013+0000 7fbbc5b7e640 1 --2- 172.21.15.181:0/71610253 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbbc00c9300 0x7fbbc00c9e40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0072000 tx=0x7fbbbc02b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b4ea424e2bb21d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:02.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.017+0000 7fbbc4b7c640 1 -- 172.21.15.181:0/71610253 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc034070 con 0x7fbbc00c9300 2024-04-01T22:33:02.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.018+0000 7fbbc4b7c640 1 -- 172.21.15.181:0/71610253 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbbc030860 con 0x7fbbc00c9300 2024-04-01T22:33:02.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.018+0000 7fbbc4b7c640 1 -- 172.21.15.181:0/71610253 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc030c30 con 0x7fbbc00c9300 2024-04-01T22:33:02.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.018+0000 7fbbc7de2640 1 -- 172.21.15.181:0/71610253 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbbc00c9300 msgr2=0x7fbbc00c9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:02.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.018+0000 7fbbc7de2640 1 --2- 172.21.15.181:0/71610253 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbbc00c9300 0x7fbbc00c9e40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0072000 tx=0x7fbbbc02b9a0 comp rx=0 tx=0).stop 2024-04-01T22:33:02.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.018+0000 7fbbc7de2640 1 -- 172.21.15.181:0/71610253 shutdown_connections 2024-04-01T22:33:02.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.018+0000 7fbbc7de2640 1 --2- 172.21.15.181:0/71610253 >> v2:172.21.15.47:3300/0 conn(0x7fbbc00c2cb0 0x7fbbc00c96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:02.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.018+0000 7fbbc7de2640 1 --2- 172.21.15.181:0/71610253 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbbc00c9300 0x7fbbc00c9e40 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:02.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.018+0000 7fbbc7de2640 1 -- 172.21.15.181:0/71610253 >> 172.21.15.181:0/71610253 conn(0x7fbbc0071290 msgr2=0x7fbbc00716a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:02.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.018+0000 7fbbc7de2640 1 -- 172.21.15.181:0/71610253 shutdown_connections 2024-04-01T22:33:02.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.018+0000 7fbbc7de2640 1 -- 172.21.15.181:0/71610253 wait complete. 2024-04-01T22:33:02.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.020+0000 7fbbc7de2640 1 Processor -- start 2024-04-01T22:33:02.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.020+0000 7fbbc7de2640 1 -- start start 2024-04-01T22:33:02.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.021+0000 7fbbc7de2640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbbc00c2cb0 0x7fbbc01562e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:02.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.021+0000 7fbbc7de2640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbbc00c9300 0x7fbbc01e4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:02.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.021+0000 7fbbc7de2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbc0158020 0x7fbbc014dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:02.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.021+0000 7fbbc7de2640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc0158430 con 0x7fbbc0158020 2024-04-01T22:33:02.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.021+0000 7fbbc7de2640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc0152670 con 0x7fbbc00c9300 2024-04-01T22:33:02.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.021+0000 7fbbc7de2640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fbbc01585b0 con 0x7fbbc00c2cb0 2024-04-01T22:33:02.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.021+0000 7fbbc537d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbbc00c9300 0x7fbbc01e4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:02.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.021+0000 7fbbc5b7e640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbbc00c2cb0 0x7fbbc01562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:02.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.022+0000 7fbbc537d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbbc00c9300 0x7fbbc01e4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:45866/0 (socket says 172.21.15.181:45866) 2024-04-01T22:33:02.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.022+0000 7fbbc537d640 1 -- 172.21.15.181:0/2141814972 learned_addr learned my addr 172.21.15.181:0/2141814972 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-04-01T22:33:02.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.023+0000 7fbbc637f640 1 --2- 172.21.15.181:0/2141814972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbc0158020 0x7fbbc014dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:02.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.025+0000 7fbbc5b7e640 1 -- 172.21.15.181:0/2141814972 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbbc00c9300 msgr2=0x7fbbc01e4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:02.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.025+0000 7fbbc5b7e640 1 --2- 172.21.15.181:0/2141814972 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbbc00c9300 0x7fbbc01e4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:02.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.025+0000 7fbbc5b7e640 1 -- 172.21.15.181:0/2141814972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbc0158020 msgr2=0x7fbbc014dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:02.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.025+0000 7fbbc5b7e640 1 --2- 172.21.15.181:0/2141814972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbc0158020 0x7fbbc014dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:02.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.025+0000 7fbbc5b7e640 1 -- 172.21.15.181:0/2141814972 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbc00cbdc0 con 0x7fbbc00c2cb0 2024-04-01T22:33:02.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.029+0000 7fbbc5b7e640 1 --2- 172.21.15.181:0/2141814972 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbbc00c2cb0 0x7fbbc01562e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0158f10 tx=0x7fbbbc004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:02.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.037+0000 7fbbb67fc640 1 -- 172.21.15.181:0/2141814972 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc048070 con 0x7fbbc00c2cb0 2024-04-01T22:33:02.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.037+0000 7fbbb67fc640 1 -- 172.21.15.181:0/2141814972 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbbc030660 con 0x7fbbc00c2cb0 2024-04-01T22:33:02.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.037+0000 7fbbc7de2640 1 -- 172.21.15.181:0/2141814972 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbc00cc0a0 con 0x7fbbc00c2cb0 2024-04-01T22:33:02.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.037+0000 7fbbb67fc640 1 -- 172.21.15.181:0/2141814972 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc034040 con 0x7fbbc00c2cb0 2024-04-01T22:33:02.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.037+0000 7fbbc7de2640 1 -- 172.21.15.181:0/2141814972 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbc01e3920 con 0x7fbbc00c2cb0 2024-04-01T22:33:02.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.038+0000 7fbbc7de2640 1 -- 172.21.15.181:0/2141814972 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbc00b2d50 con 0x7fbbc00c2cb0 2024-04-01T22:33:02.102 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-01T22:33:02.102+0000 7f6b17212040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-01T22:33:02.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.140+0000 7fbbb67fc640 1 -- 172.21.15.181:0/2141814972 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbbbc04b070 con 0x7fbbc00c2cb0 2024-04-01T22:33:02.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.140+0000 7fbbb67fc640 1 -- 172.21.15.181:0/2141814972 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fbbbc04c9a0 con 0x7fbbc00c2cb0 2024-04-01T22:33:02.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.140+0000 7fbbb67fc640 1 -- 172.21.15.181:0/2141814972 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fbbc00b2d50 con 0x7fbbc00c2cb0 2024-04-01T22:33:02.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.216+0000 7fbbc7de2640 1 -- 172.21.15.181:0/2141814972 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd new", "uuid": "aa08266c-1719-4abd-afb9-e7e8ac593658", "id": 6} v 0) -- 0x7fbbc0068920 con 0x7fbbc00c2cb0 2024-04-01T22:33:02.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.279+0000 7fbbb67fc640 1 -- 172.21.15.181:0/2141814972 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "aa08266c-1719-4abd-afb9-e7e8ac593658", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fbbbc052020 con 0x7fbbc00c2cb0 2024-04-01T22:33:02.279 INFO:teuthology.orchestra.run.smithi181.stdout:6 2024-04-01T22:33:02.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.280+0000 7fbbc7de2640 1 -- 172.21.15.181:0/2141814972 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbbc00c2cb0 msgr2=0x7fbbc01562e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:02.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.280+0000 7fbbc7de2640 1 --2- 172.21.15.181:0/2141814972 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbbc00c2cb0 0x7fbbc01562e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0158f10 tx=0x7fbbbc004730 comp rx=0 tx=0).stop 2024-04-01T22:33:02.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.280+0000 7fbbc7de2640 1 -- 172.21.15.181:0/2141814972 shutdown_connections 2024-04-01T22:33:02.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.280+0000 7fbbc7de2640 1 --2- 172.21.15.181:0/2141814972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbc0158020 0x7fbbc014dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:02.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.280+0000 7fbbc7de2640 1 --2- 172.21.15.181:0/2141814972 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbbc00c9300 0x7fbbc01e4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:02.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.280+0000 7fbbc7de2640 1 --2- 172.21.15.181:0/2141814972 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbbc00c2cb0 0x7fbbc01562e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:02.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.280+0000 7fbbc7de2640 1 -- 172.21.15.181:0/2141814972 >> 172.21.15.181:0/2141814972 conn(0x7fbbc0071290 msgr2=0x7fbbc00b2100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:02.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.280+0000 7fbbc7de2640 1 -- 172.21.15.181:0/2141814972 shutdown_connections 2024-04-01T22:33:02.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.280+0000 7fbbc7de2640 1 -- 172.21.15.181:0/2141814972 wait complete. 2024-04-01T22:33:02.291 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new 6e509762-24c8-46c3-93a1-4c50b11ebcf8 7 2024-04-01T22:33:02.390 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-01T22:33:02.390+0000 7f6b17212040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-01T22:33:02.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.391+0000 7f45a806f640 1 Processor -- start 2024-04-01T22:33:02.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.392+0000 7f45a806f640 1 -- start start 2024-04-01T22:33:02.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.392+0000 7f45a806f640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f45a0071470 0x7f45a0158c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:02.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.392+0000 7f45a806f640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f45a00c8560 0x7f45a0151db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:02.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.392+0000 7f45a806f640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45a015c6a0 con 0x7f45a0071850 2024-04-01T22:33:02.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.392+0000 7f45a806f640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f45a0159170 con 0x7f45a00c8560 2024-04-01T22:33:02.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.392+0000 7f45a806f640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f45a015b840 con 0x7f45a0071470 2024-04-01T22:33:02.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.393+0000 7f45a5e0b640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f45a0071470 0x7f45a0158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:02.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.393+0000 7f45a560a640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f45a00c8560 0x7f45a0151db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:02.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.393+0000 7f45a560a640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f45a00c8560 0x7f45a0151db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.181:46688/0 (socket says 172.21.15.181:46688) 2024-04-01T22:33:02.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.393+0000 7f45a560a640 1 -- 172.21.15.181:0/2702512035 learned_addr learned my addr 172.21.15.181:0/2702512035 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-04-01T22:33:02.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.396+0000 7f45a5e0b640 1 -- 172.21.15.181:0/2702512035 >> v2:172.21.15.47:3300/0 conn(0x7f45a00c8560 msgr2=0x7f45a0151db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:02.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.396+0000 7f45a5e0b640 1 --2- 172.21.15.181:0/2702512035 >> v2:172.21.15.47:3300/0 conn(0x7f45a00c8560 0x7f45a0151db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:02.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.396+0000 7f45a5e0b640 1 -- 172.21.15.181:0/2702512035 >> v1:172.21.15.181:6789/0 conn(0x7f45a0071850 legacy=0x7f45a00c2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:02.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.396+0000 7f45a5e0b640 1 -- 172.21.15.181:0/2702512035 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a015bb20 con 0x7f45a0071470 2024-04-01T22:33:02.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.397+0000 7f45a5e0b640 1 --2- 172.21.15.181:0/2702512035 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45a0071470 0x7f45a0158c30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f45a00cad10 tx=0x7f459802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1799afc3775e32df server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:02.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.402+0000 7f45a4e09640 1 -- 172.21.15.181:0/2702512035 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45980315a0 con 0x7f45a0071470 2024-04-01T22:33:02.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.402+0000 7f45a4e09640 1 -- 172.21.15.181:0/2702512035 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4598037070 con 0x7f45a0071470 2024-04-01T22:33:02.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.402+0000 7f45a4e09640 1 -- 172.21.15.181:0/2702512035 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4598031960 con 0x7f45a0071470 2024-04-01T22:33:02.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.403+0000 7f45a806f640 1 -- 172.21.15.181:0/2702512035 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45a0071470 msgr2=0x7f45a0158c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:02.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.403+0000 7f45a806f640 1 --2- 172.21.15.181:0/2702512035 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45a0071470 0x7f45a0158c30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f45a00cad10 tx=0x7f459802b840 comp rx=0 tx=0).stop 2024-04-01T22:33:02.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.403+0000 7f45a806f640 1 -- 172.21.15.181:0/2702512035 shutdown_connections 2024-04-01T22:33:02.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.403+0000 7f45a806f640 1 --2- 172.21.15.181:0/2702512035 >> v2:172.21.15.47:3300/0 conn(0x7f45a00c8560 0x7f45a0151db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:02.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.404+0000 7f45a806f640 1 --2- 172.21.15.181:0/2702512035 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45a0071470 0x7f45a0158c30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:02.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.404+0000 7f45a806f640 1 -- 172.21.15.181:0/2702512035 >> 172.21.15.181:0/2702512035 conn(0x7f45a006b500 msgr2=0x7f45a006f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:02.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.404+0000 7f45a806f640 1 -- 172.21.15.181:0/2702512035 shutdown_connections 2024-04-01T22:33:02.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.404+0000 7f45a806f640 1 -- 172.21.15.181:0/2702512035 wait complete. 2024-04-01T22:33:02.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.405+0000 7f45a806f640 1 Processor -- start 2024-04-01T22:33:02.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.405+0000 7f45a806f640 1 -- start start 2024-04-01T22:33:02.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.407+0000 7f45a806f640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f45a0071470 0x7f45a00c5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:02.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.407+0000 7f45a806f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45a0071850 0x7f45a01ef090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:02.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.407+0000 7f45a806f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45a00c8560 0x7f45a01499e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:02.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.407+0000 7f45a806f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f45a015c3c0 con 0x7f45a0071850 2024-04-01T22:33:02.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.407+0000 7f45a806f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f45a015c0e0 con 0x7f45a00c8560 2024-04-01T22:33:02.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.407+0000 7f45a806f640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f45a00c3500 con 0x7f45a0071470 2024-04-01T22:33:02.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.407+0000 7f45a660c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45a00c8560 0x7f45a01499e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:02.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.407+0000 7f45a5e0b640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f45a0071470 0x7f45a00c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:02.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.407+0000 7f45a560a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45a0071850 0x7f45a01ef090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:02.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.408+0000 7f45a660c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45a00c8560 0x7f45a01499e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:45876/0 (socket says 172.21.15.181:45876) 2024-04-01T22:33:02.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.408+0000 7f45a660c640 1 -- 172.21.15.181:0/3224120823 learned_addr learned my addr 172.21.15.181:0/3224120823 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-04-01T22:33:02.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.411+0000 7f45a5e0b640 1 -- 172.21.15.181:0/3224120823 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45a00c8560 msgr2=0x7f45a01499e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:02.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.411+0000 7f45a5e0b640 1 --2- 172.21.15.181:0/3224120823 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45a00c8560 0x7f45a01499e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:02.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.411+0000 7f45a5e0b640 1 -- 172.21.15.181:0/3224120823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45a0071850 msgr2=0x7f45a01ef090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:02.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.411+0000 7f45a5e0b640 1 --2- 172.21.15.181:0/3224120823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45a0071850 0x7f45a01ef090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:02.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.411+0000 7f45a5e0b640 1 -- 172.21.15.181:0/3224120823 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a00c6ef0 con 0x7f45a0071470 2024-04-01T22:33:02.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.411+0000 7f45a560a640 1 --2- 172.21.15.181:0/3224120823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45a0071850 0x7f45a01ef090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T22:33:02.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.413+0000 7f45a5e0b640 1 --2- 172.21.15.181:0/3224120823 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f45a0071470 0x7f45a00c5900 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4598033000 tx=0x7f45980046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:02.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.417+0000 7f45967fc640 1 -- 172.21.15.181:0/3224120823 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4598032630 con 0x7f45a0071470 2024-04-01T22:33:02.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.417+0000 7f45967fc640 1 -- 172.21.15.181:0/3224120823 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4598032810 con 0x7f45a0071470 2024-04-01T22:33:02.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.417+0000 7f45967fc640 1 -- 172.21.15.181:0/3224120823 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4598032c00 con 0x7f45a0071470 2024-04-01T22:33:02.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.417+0000 7f45a806f640 1 -- 172.21.15.181:0/3224120823 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45a015adb0 con 0x7f45a0071470 2024-04-01T22:33:02.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.417+0000 7f45a806f640 1 -- 172.21.15.181:0/3224120823 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f45a00c72b0 con 0x7f45a0071470 2024-04-01T22:33:02.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.418+0000 7f45a806f640 1 -- 172.21.15.181:0/3224120823 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45a0068920 con 0x7f45a0071470 2024-04-01T22:33:02.443 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-01T22:33:02.444+0000 7f6b17212040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-01T22:33:02.478 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-04-01T22:33:02.478+0000 7fd48c638040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-01T22:33:02.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.521+0000 7f45967fc640 1 -- 172.21.15.181:0/3224120823 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f459804e7c0 con 0x7f45a0071470 2024-04-01T22:33:02.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.521+0000 7f45967fc640 1 -- 172.21.15.181:0/3224120823 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f459802f030 con 0x7f45a0071470 2024-04-01T22:33:02.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.521+0000 7f45967fc640 1 -- 172.21.15.181:0/3224120823 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f45a00c6ef0 con 0x7f45a0071470 2024-04-01T22:33:02.634 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-01T22:33:02.563+0000 7f6b17212040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-01T22:33:02.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.592+0000 7f45a806f640 1 -- 172.21.15.181:0/3224120823 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6e509762-24c8-46c3-93a1-4c50b11ebcf8", "id": 7} v 0) -- 0x7f45a00c9720 con 0x7f45a0071470 2024-04-01T22:33:02.764 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-04-01T22:33:02.764+0000 7fd48c638040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-01T22:33:02.831 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-04-01T22:33:02.831+0000 7fd48c638040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-01T22:33:02.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:02.893+0000 7f45967fc640 1 -- 172.21.15.181:0/3224120823 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mgrmap(e 2) ==== 45103+0+0 (secure 0 0 0) 0x7f459804ebf0 con 0x7f45a0071470 2024-04-01T22:33:02.958 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-04-01T22:33:02.958+0000 7fd48c638040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-01T22:33:03.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:03.074+0000 7f45967fc640 1 -- 172.21.15.181:0/3224120823 <== mon.2 v2:172.21.15.181:3301/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6e509762-24c8-46c3-93a1-4c50b11ebcf8", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f4598040070 con 0x7f45a0071470 2024-04-01T22:33:03.074 INFO:teuthology.orchestra.run.smithi181.stdout:7 2024-04-01T22:33:03.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:03.075+0000 7f45a806f640 1 -- 172.21.15.181:0/3224120823 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f45a0071470 msgr2=0x7f45a00c5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:03.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:03.075+0000 7f45a806f640 1 --2- 172.21.15.181:0/3224120823 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f45a0071470 0x7f45a00c5900 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4598033000 tx=0x7f45980046c0 comp rx=0 tx=0).stop 2024-04-01T22:33:03.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:03.075+0000 7f45a806f640 1 -- 172.21.15.181:0/3224120823 shutdown_connections 2024-04-01T22:33:03.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:03.075+0000 7f45a806f640 1 --2- 172.21.15.181:0/3224120823 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45a00c8560 0x7f45a01499e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:03.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:03.075+0000 7f45a806f640 1 --2- 172.21.15.181:0/3224120823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45a0071850 0x7f45a01ef090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:03.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:03.075+0000 7f45a806f640 1 --2- 172.21.15.181:0/3224120823 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f45a0071470 0x7f45a00c5900 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:03.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:03.075+0000 7f45a806f640 1 -- 172.21.15.181:0/3224120823 >> 172.21.15.181:0/3224120823 conn(0x7f45a006b500 msgr2=0x7f45a00ca170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:03.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:03.075+0000 7f45a806f640 1 -- 172.21.15.181:0/3224120823 shutdown_connections 2024-04-01T22:33:03.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-04-01T22:33:03.075+0000 7f45a806f640 1 -- 172.21.15.181:0/3224120823 wait complete. 2024-04-01T22:33:03.085 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-01T22:33:03.085 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 0 2024-04-01T22:33:03.088 INFO:tasks.ceph.osd.0:Started 2024-04-01T22:33:03.088 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-01T22:33:03.088 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 1 2024-04-01T22:33:03.092 INFO:tasks.ceph.osd.1:Started 2024-04-01T22:33:03.092 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-01T22:33:03.092 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 2 2024-04-01T22:33:03.094 INFO:tasks.ceph.osd.2:Started 2024-04-01T22:33:03.094 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-01T22:33:03.094 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 3 2024-04-01T22:33:03.096 INFO:tasks.ceph.osd.3:Started 2024-04-01T22:33:03.096 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-01T22:33:03.097 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 4 2024-04-01T22:33:03.098 INFO:tasks.ceph.osd.4:Started 2024-04-01T22:33:03.099 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-01T22:33:03.099 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 5 2024-04-01T22:33:03.100 INFO:tasks.ceph.osd.5:Started 2024-04-01T22:33:03.101 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-01T22:33:03.101 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 6 2024-04-01T22:33:03.103 INFO:tasks.ceph.osd.6:Started 2024-04-01T22:33:03.103 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-01T22:33:03.103 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 7 2024-04-01T22:33:03.105 INFO:tasks.ceph.osd.7:Started 2024-04-01T22:33:03.106 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T22:33:03.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.237+0000 7f0a437f6640 1 Processor -- start 2024-04-01T22:33:03.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.238+0000 7f0a437f6640 1 -- start start 2024-04-01T22:33:03.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.238+0000 7f0a437f6640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f0a3c15c230 0x7f0a3c06c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:03.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.238+0000 7f0a437f6640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a3c154b70 con 0x7f0a3c15aec0 2024-04-01T22:33:03.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.238+0000 7f0a437f6640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a3c0cdac0 con 0x7f0a3c06c250 2024-04-01T22:33:03.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.238+0000 7f0a437f6640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f0a3c0ce990 con 0x7f0a3c15c230 2024-04-01T22:33:03.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.241+0000 7f0a40d91640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f0a3c15aec0 0x7f0a3c15bb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:42402/0 (socket says 172.21.15.47:42402) 2024-04-01T22:33:03.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.241+0000 7f0a40d91640 1 -- 172.21.15.47:0/2596280216 learned_addr learned my addr 172.21.15.47:0/2596280216 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T22:33:03.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.258+0000 7f0a41d93640 1 --2- 172.21.15.47:0/2596280216 >> v2:172.21.15.181:3300/0 conn(0x7f0a3c15c230 0x7f0a3c06c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:03.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.268+0000 7f0a41d93640 1 -- 172.21.15.47:0/2596280216 >> v1:172.21.15.181:6789/0 conn(0x7f0a3c06c250 legacy=0x7f0a3c0ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:03.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.268+0000 7f0a41d93640 1 -- 172.21.15.47:0/2596280216 >> v1:172.21.15.47:6789/0 conn(0x7f0a3c15aec0 legacy=0x7f0a3c15bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:03.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.268+0000 7f0a41d93640 1 -- 172.21.15.47:0/2596280216 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a3c0cf2a0 con 0x7f0a3c15c230 2024-04-01T22:33:03.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.328+0000 7f0a41d93640 1 --2- 172.21.15.47:0/2596280216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a3c15c230 0x7f0a3c06c630 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0a340097a0 tx=0x7f0a3402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9340bac2b08771f server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:03.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.356+0000 7f0a33fff640 1 -- 172.21.15.47:0/2596280216 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a34034070 con 0x7f0a3c15c230 2024-04-01T22:33:03.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.356+0000 7f0a33fff640 1 -- 172.21.15.47:0/2596280216 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a34030610 con 0x7f0a3c15c230 2024-04-01T22:33:03.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.356+0000 7f0a33fff640 1 -- 172.21.15.47:0/2596280216 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a340309e0 con 0x7f0a3c15c230 2024-04-01T22:33:03.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.357+0000 7f0a437f6640 1 -- 172.21.15.47:0/2596280216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a3c15c230 msgr2=0x7f0a3c06c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:03.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.357+0000 7f0a437f6640 1 --2- 172.21.15.47:0/2596280216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a3c15c230 0x7f0a3c06c630 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0a340097a0 tx=0x7f0a3402b960 comp rx=0 tx=0).stop 2024-04-01T22:33:03.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.357+0000 7f0a437f6640 1 -- 172.21.15.47:0/2596280216 shutdown_connections 2024-04-01T22:33:03.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.357+0000 7f0a437f6640 1 --2- 172.21.15.47:0/2596280216 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a3c15c230 0x7f0a3c06c630 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:03.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.357+0000 7f0a437f6640 1 -- 172.21.15.47:0/2596280216 >> 172.21.15.47:0/2596280216 conn(0x7f0a3c0cfdb0 msgr2=0x7f0a3c0d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:03.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.357+0000 7f0a437f6640 1 -- 172.21.15.47:0/2596280216 shutdown_connections 2024-04-01T22:33:03.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.357+0000 7f0a437f6640 1 -- 172.21.15.47:0/2596280216 wait complete. 2024-04-01T22:33:03.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.358+0000 7f0a437f6640 1 Processor -- start 2024-04-01T22:33:03.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.358+0000 7f0a437f6640 1 -- start start 2024-04-01T22:33:03.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.359+0000 7f0a437f6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a3c06c250 0x7f0a3c1f4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:03.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.359+0000 7f0a437f6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a3c15aec0 0x7f0a3c0b1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:03.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.359+0000 7f0a437f6640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0a3c15c230 0x7f0a3c0b2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:03.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.359+0000 7f0a437f6640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0a3c0ce340 con 0x7f0a3c15aec0 2024-04-01T22:33:03.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.359+0000 7f0a437f6640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0a3c0ce060 con 0x7f0a3c06c250 2024-04-01T22:33:03.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.359+0000 7f0a437f6640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f0a3c0ce620 con 0x7f0a3c15c230 2024-04-01T22:33:03.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.361+0000 7f0a41592640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a3c06c250 0x7f0a3c1f4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:03.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.361+0000 7f0a41592640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a3c06c250 0x7f0a3c1f4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:49454/0 (socket says 172.21.15.47:49454) 2024-04-01T22:33:03.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.361+0000 7f0a41592640 1 -- 172.21.15.47:0/1209499821 learned_addr learned my addr 172.21.15.47:0/1209499821 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:03.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.382+0000 7f0a40d91640 1 --2- 172.21.15.47:0/1209499821 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a3c15aec0 0x7f0a3c0b1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:03.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.389+0000 7f0a40d91640 1 -- 172.21.15.47:0/1209499821 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0a3c15c230 msgr2=0x7f0a3c0b2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:03.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.389+0000 7f0a40d91640 1 --2- 172.21.15.47:0/1209499821 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0a3c15c230 0x7f0a3c0b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:03.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.389+0000 7f0a40d91640 1 -- 172.21.15.47:0/1209499821 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a3c06c250 msgr2=0x7f0a3c1f4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:03.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.389+0000 7f0a40d91640 1 --2- 172.21.15.47:0/1209499821 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a3c06c250 0x7f0a3c1f4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:03.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.389+0000 7f0a40d91640 1 -- 172.21.15.47:0/1209499821 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a3c0b38b0 con 0x7f0a3c15aec0 2024-04-01T22:33:03.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.394+0000 7f0a40d91640 1 --2- 172.21.15.47:0/1209499821 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a3c15aec0 0x7f0a3c0b1cc0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c00c370 tx=0x7f0a2c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:03.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.403+0000 7f0a31ffb640 1 -- 172.21.15.47:0/1209499821 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c017070 con 0x7f0a3c15aec0 2024-04-01T22:33:03.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.403+0000 7f0a31ffb640 1 -- 172.21.15.47:0/1209499821 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a2c005ce0 con 0x7f0a3c15aec0 2024-04-01T22:33:03.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.403+0000 7f0a437f6640 1 -- 172.21.15.47:0/1209499821 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a3c0b0190 con 0x7f0a3c15aec0 2024-04-01T22:33:03.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.403+0000 7f0a31ffb640 1 -- 172.21.15.47:0/1209499821 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c007310 con 0x7f0a3c15aec0 2024-04-01T22:33:03.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.404+0000 7f0a437f6640 1 -- 172.21.15.47:0/1209499821 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a3c0b0470 con 0x7f0a3c15aec0 2024-04-01T22:33:03.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.405+0000 7f0a437f6640 1 -- 172.21.15.47:0/1209499821 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a3c154800 con 0x7f0a3c15aec0 2024-04-01T22:33:03.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.517+0000 7f0a31ffb640 1 -- 172.21.15.47:0/1209499821 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 2) ==== 45103+0+0 (secure 0 0 0) 0x7f0a2c01a070 con 0x7f0a3c15aec0 2024-04-01T22:33:03.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.523+0000 7f0a31ffb640 1 -- 172.21.15.47:0/1209499821 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f0a2c010b90 con 0x7f0a3c15aec0 2024-04-01T22:33:03.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.523+0000 7f0a31ffb640 1 -- 172.21.15.47:0/1209499821 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f0a3c154800 con 0x7f0a3c15aec0 2024-04-01T22:33:03.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.587+0000 7f0a437f6640 1 -- 172.21.15.47:0/1209499821 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0a3c15a0e0 con 0x7f0a3c15aec0 2024-04-01T22:33:03.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.678+0000 7f0a31ffb640 1 -- 172.21.15.47:0/1209499821 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f0a3c15a0e0 con 0x7f0a3c15aec0 2024-04-01T22:33:03.678 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:33:03.678 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":10,"fsid":"a6998a48-38bc-4e42-b0d9-04f2fb5c3c87","created":"2024-04-01T22:32:57.112033+0000","modified":"2024-04-01T22:33:02.650459+0000","last_up_change":"0.000000","last_in_change":"2024-04-01T22:33:02.650459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7bd3f25d-e3a5-4932-b381-53dcbb464dde","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2aa60ba2-67ff-43c7-96c4-82ae2f3855ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d83f8a98-6db8-42b7-9ef6-5b16eb9a3492","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"edc02ed5-d25c-4dc9-a0c3-7a26f20fae07","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b3d67e74-f51e-4474-9c62-dd0daa60c728","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d86e8f7a-99f4-4457-9949-cf2cb853e79b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"aa08266c-1719-4abd-afb9-e7e8ac593658","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6e509762-24c8-46c3-93a1-4c50b11ebcf8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T22:33:03.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.679+0000 7f0a437f6640 1 -- 172.21.15.47:0/1209499821 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a3c15aec0 msgr2=0x7f0a3c0b1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:03.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.679+0000 7f0a437f6640 1 --2- 172.21.15.47:0/1209499821 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a3c15aec0 0x7f0a3c0b1cc0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c00c370 tx=0x7f0a2c00c830 comp rx=0 tx=0).stop 2024-04-01T22:33:03.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.679+0000 7f0a437f6640 1 -- 172.21.15.47:0/1209499821 shutdown_connections 2024-04-01T22:33:03.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.679+0000 7f0a437f6640 1 --2- 172.21.15.47:0/1209499821 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0a3c15c230 0x7f0a3c0b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:03.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.679+0000 7f0a437f6640 1 --2- 172.21.15.47:0/1209499821 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a3c15aec0 0x7f0a3c0b1cc0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:03.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.679+0000 7f0a437f6640 1 --2- 172.21.15.47:0/1209499821 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a3c06c250 0x7f0a3c1f4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:03.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.679+0000 7f0a437f6640 1 -- 172.21.15.47:0/1209499821 >> 172.21.15.47:0/1209499821 conn(0x7f0a3c0cfdb0 msgr2=0x7f0a3c1540f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:03.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.679+0000 7f0a437f6640 1 -- 172.21.15.47:0/1209499821 shutdown_connections 2024-04-01T22:33:03.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:03.679+0000 7f0a437f6640 1 -- 172.21.15.47:0/1209499821 wait complete. 2024-04-01T22:33:03.689 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-01T22:33:03.689 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-01T22:33:03.703 INFO:tasks.ceph.osd.2.smithi047.stderr:2024-04-01T22:33:03.704+0000 7f102f9fa640 -1 Falling back to public interface 2024-04-01T22:33:03.715 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-04-01T22:33:03.715+0000 7f0de2810640 -1 Falling back to public interface 2024-04-01T22:33:03.719 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-04-01T22:33:03.719+0000 7f31fbc15640 -1 Falling back to public interface 2024-04-01T22:33:03.741 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-04-01T22:33:03.741+0000 7ff07e010640 -1 Falling back to public interface 2024-04-01T22:33:03.746 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-04-01T22:33:03.746+0000 7f6af9401640 -1 Falling back to public interface 2024-04-01T22:33:03.753 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-04-01T22:33:03.753+0000 7f127ea13640 -1 Falling back to public interface 2024-04-01T22:33:03.755 INFO:tasks.ceph.osd.1.smithi047.stderr:2024-04-01T22:33:03.755+0000 7f7305212640 -1 Falling back to public interface 2024-04-01T22:33:03.757 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-04-01T22:33:03.757+0000 7f2101ad5640 -1 Falling back to public interface 2024-04-01T22:33:04.489 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-01T22:33:04.489+0000 7f6ab7a7a640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-01T22:33:04.494 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-01T22:33:04.543 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-01T22:33:04.543+0000 7f6ab7a7a640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-01T22:33:04.586 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.586+0000 7f316c181640 1 Processor -- start 2024-04-01T22:33:04.586 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.586+0000 7f316c181640 1 -- start start 2024-04-01T22:33:04.586 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.587+0000 7f316c181640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f31640c8310 0x7f316415de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:04.587 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.587+0000 7f316c181640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f316415e340 0x7f3164164c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:04.587 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.587+0000 7f316c181640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31640c90c0 con 0x7f31641542d0 2024-04-01T22:33:04.587 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.587+0000 7f316c181640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f316415d970 con 0x7f316415e340 2024-04-01T22:33:04.587 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.587+0000 7f316c181640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f316415e780 con 0x7f31640c8310 2024-04-01T22:33:04.589 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.589+0000 7f316a71e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f316415e340 0x7f3164164c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:04.589 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.589+0000 7f316a71e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f316415e340 0x7f3164164c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59610/0 (socket says 172.21.15.47:59610) 2024-04-01T22:33:04.589 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.589+0000 7f316a71e640 1 -- 172.21.15.47:0/1327771090 learned_addr learned my addr 172.21.15.47:0/1327771090 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:04.591 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.592+0000 7f316a71e640 1 -- 172.21.15.47:0/1327771090 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f31640c8310 msgr2=0x7f316415de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:04.591 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.592+0000 7f316a71e640 1 --2- 172.21.15.47:0/1327771090 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f31640c8310 0x7f316415de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:04.591 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.592+0000 7f316a71e640 1 -- 172.21.15.47:0/1327771090 >> v1:172.21.15.181:6789/0 conn(0x7f31641542d0 legacy=0x7f3164071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:04.591 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.592+0000 7f316a71e640 1 -- 172.21.15.47:0/1327771090 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f316415a620 con 0x7f316415e340 2024-04-01T22:33:04.593 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.593+0000 7f316a71e640 1 --2- 172.21.15.47:0/1327771090 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f316415e340 0x7f3164164c70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f316415daf0 tx=0x7f315c02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b75ee0e18e832ef7 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:04.597 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.597+0000 7f3168f1b640 1 -- 172.21.15.47:0/1327771090 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315c02caf0 con 0x7f316415e340 2024-04-01T22:33:04.597 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.597+0000 7f3168f1b640 1 -- 172.21.15.47:0/1327771090 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f315c02cc90 con 0x7f316415e340 2024-04-01T22:33:04.597 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.597+0000 7f3168f1b640 1 -- 172.21.15.47:0/1327771090 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315c034610 con 0x7f316415e340 2024-04-01T22:33:04.598 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.598+0000 7f316c181640 1 -- 172.21.15.47:0/1327771090 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f316415e340 msgr2=0x7f3164164c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:04.598 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.598+0000 7f316c181640 1 --2- 172.21.15.47:0/1327771090 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f316415e340 0x7f3164164c70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f316415daf0 tx=0x7f315c02bf50 comp rx=0 tx=0).stop 2024-04-01T22:33:04.598 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.598+0000 7f316c181640 1 -- 172.21.15.47:0/1327771090 shutdown_connections 2024-04-01T22:33:04.598 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.598+0000 7f316c181640 1 --2- 172.21.15.47:0/1327771090 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f316415e340 0x7f3164164c70 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:04.598 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.598+0000 7f316c181640 1 --2- 172.21.15.47:0/1327771090 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f31640c8310 0x7f316415de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:04.598 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.598+0000 7f316c181640 1 -- 172.21.15.47:0/1327771090 >> 172.21.15.47:0/1327771090 conn(0x7f3164067600 msgr2=0x7f316406f660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:04.598 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.598+0000 7f316c181640 1 -- 172.21.15.47:0/1327771090 shutdown_connections 2024-04-01T22:33:04.598 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.598+0000 7f316c181640 1 -- 172.21.15.47:0/1327771090 wait complete. 2024-04-01T22:33:04.599 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.599+0000 7f316c181640 1 Processor -- start 2024-04-01T22:33:04.599 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.599+0000 7f316c181640 1 -- start start 2024-04-01T22:33:04.599 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.600+0000 7f316c181640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f31640c8310 0x7f31641e5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:04.600 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.600+0000 7f316c181640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f31641542d0 0x7f31640c3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:04.600 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.600+0000 7f316c181640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f316415e340 0x7f316415cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:04.600 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.600+0000 7f316c181640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f316415aec0 con 0x7f316415e340 2024-04-01T22:33:04.600 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.600+0000 7f316c181640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f316415abe0 con 0x7f31640c8310 2024-04-01T22:33:04.600 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.600+0000 7f316c181640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f316415b1a0 con 0x7f31641542d0 2024-04-01T22:33:04.600 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.600+0000 7f316a71e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f316415e340 0x7f316415cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:04.600 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.601+0000 7f316a71e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f316415e340 0x7f316415cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59614/0 (socket says 172.21.15.47:59614) 2024-04-01T22:33:04.600 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.601+0000 7f316a71e640 1 -- 172.21.15.47:0/988384854 learned_addr learned my addr 172.21.15.47:0/988384854 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:04.603 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.604+0000 7f316971c640 1 --2- 172.21.15.47:0/988384854 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f31641542d0 0x7f31640c3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:04.604 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.604+0000 7f316a71e640 1 -- 172.21.15.47:0/988384854 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f31641542d0 msgr2=0x7f31640c3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:04.604 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.604+0000 7f316a71e640 1 --2- 172.21.15.47:0/988384854 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f31641542d0 0x7f31640c3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:04.604 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.604+0000 7f316a71e640 1 -- 172.21.15.47:0/988384854 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f31640c8310 msgr2=0x7f31641e5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:04.604 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.604+0000 7f316a71e640 1 --2- 172.21.15.47:0/988384854 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f31640c8310 0x7f31641e5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:04.604 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.604+0000 7f316a71e640 1 -- 172.21.15.47:0/988384854 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31641e6230 con 0x7f316415e340 2024-04-01T22:33:04.607 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.607+0000 7f316a71e640 1 --2- 172.21.15.47:0/988384854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f316415e340 0x7f316415cef0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f315c009f40 tx=0x7f315c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:04.611 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.611+0000 7f315a7fc640 1 -- 172.21.15.47:0/988384854 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315c043020 con 0x7f316415e340 2024-04-01T22:33:04.611 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.611+0000 7f315a7fc640 1 -- 172.21.15.47:0/988384854 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f315c03e450 con 0x7f316415e340 2024-04-01T22:33:04.611 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.611+0000 7f315a7fc640 1 -- 172.21.15.47:0/988384854 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315c03e840 con 0x7f316415e340 2024-04-01T22:33:04.611 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.611+0000 7f316c181640 1 -- 172.21.15.47:0/988384854 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31641e64d0 con 0x7f316415e340 2024-04-01T22:33:04.611 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.611+0000 7f316c181640 1 -- 172.21.15.47:0/988384854 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31640c3200 con 0x7f316415e340 2024-04-01T22:33:04.611 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.612+0000 7f316c181640 1 -- 172.21.15.47:0/988384854 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31640c2d10 con 0x7f316415e340 2024-04-01T22:33:04.639 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.639+0000 7f315a7fc640 1 -- 172.21.15.47:0/988384854 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 3) ==== 89994+0+0 (secure 0 0 0) 0x7f315c046020 con 0x7f316415e340 2024-04-01T22:33:04.639 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.640+0000 7f315a7fc640 1 --2- 172.21.15.47:0/988384854 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f314806b830 0x7f314806dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:04.639 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.640+0000 7f3169f1d640 1 --2- 172.21.15.47:0/988384854 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f314806b830 0x7f314806dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:04.640 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.640+0000 7f3169f1d640 1 --2- 172.21.15.47:0/988384854 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f314806b830 0x7f314806dcf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3160001560 tx=0x7f3160007990 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:04.893 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.893+0000 7f315a7fc640 1 -- 172.21.15.47:0/988384854 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f315c079b20 con 0x7f316415e340 2024-04-01T22:33:04.893 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:04.894+0000 7f315a7fc640 1 -- 172.21.15.47:0/988384854 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f315c04d030 con 0x7f316415e340 2024-04-01T22:33:05.076 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:05.076+0000 7f316c181640 1 -- 172.21.15.47:0/988384854 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f316404f4b0 con 0x7f316415e340 2024-04-01T22:33:05.091 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:05.092+0000 7f315a7fc640 1 -- 172.21.15.47:0/988384854 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f315c07c180 con 0x7f316415e340 2024-04-01T22:33:05.091 INFO:teuthology.misc.health.smithi047.stdout: 2024-04-01T22:33:05.091 INFO:teuthology.misc.health.smithi047.stdout:{"epoch":10,"fsid":"a6998a48-38bc-4e42-b0d9-04f2fb5c3c87","created":"2024-04-01T22:32:57.112033+0000","modified":"2024-04-01T22:33:02.650459+0000","last_up_change":"0.000000","last_in_change":"2024-04-01T22:33:02.650459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7bd3f25d-e3a5-4932-b381-53dcbb464dde","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2aa60ba2-67ff-43c7-96c4-82ae2f3855ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d83f8a98-6db8-42b7-9ef6-5b16eb9a3492","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"edc02ed5-d25c-4dc9-a0c3-7a26f20fae07","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b3d67e74-f51e-4474-9c62-dd0daa60c728","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d86e8f7a-99f4-4457-9949-cf2cb853e79b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"aa08266c-1719-4abd-afb9-e7e8ac593658","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6e509762-24c8-46c3-93a1-4c50b11ebcf8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T22:33:05.094 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:05.094+0000 7f316c181640 1 -- 172.21.15.47:0/988384854 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f314806b830 msgr2=0x7f314806dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:05.094 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:05.094+0000 7f316c181640 1 --2- 172.21.15.47:0/988384854 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f314806b830 0x7f314806dcf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3160001560 tx=0x7f3160007990 comp rx=0 tx=0).stop 2024-04-01T22:33:05.094 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:05.094+0000 7f316c181640 1 -- 172.21.15.47:0/988384854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f316415e340 msgr2=0x7f316415cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:05.094 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:05.094+0000 7f316c181640 1 --2- 172.21.15.47:0/988384854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f316415e340 0x7f316415cef0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f315c009f40 tx=0x7f315c004a40 comp rx=0 tx=0).stop 2024-04-01T22:33:05.094 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:05.094+0000 7f316c181640 1 -- 172.21.15.47:0/988384854 shutdown_connections 2024-04-01T22:33:05.094 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:05.094+0000 7f316c181640 1 --2- 172.21.15.47:0/988384854 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f314806b830 0x7f314806dcf0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:05.094 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:05.094+0000 7f316c181640 1 --2- 172.21.15.47:0/988384854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f316415e340 0x7f316415cef0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:05.094 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:05.094+0000 7f316c181640 1 --2- 172.21.15.47:0/988384854 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f31641542d0 0x7f31640c3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:05.094 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:05.094+0000 7f316c181640 1 --2- 172.21.15.47:0/988384854 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f31640c8310 0x7f31641e5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:05.094 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:05.094+0000 7f316c181640 1 -- 172.21.15.47:0/988384854 >> 172.21.15.47:0/988384854 conn(0x7f3164067600 msgr2=0x7f3164071060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:05.095 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:05.094+0000 7f316c181640 1 -- 172.21.15.47:0/988384854 shutdown_connections 2024-04-01T22:33:05.095 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:05.094+0000 7f316c181640 1 -- 172.21.15.47:0/988384854 wait complete. 2024-04-01T22:33:05.103 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-01T22:33:07.143 INFO:tasks.ceph.osd.2.smithi047.stderr:2024-04-01T22:33:07.143+0000 7f102f9fa640 -1 osd.2 0 log_to_monitors true 2024-04-01T22:33:07.153 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-04-01T22:33:07.154+0000 7f0de2810640 -1 osd.6 0 log_to_monitors true 2024-04-01T22:33:07.189 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-04-01T22:33:07.190+0000 7ff07e010640 -1 osd.4 0 log_to_monitors true 2024-04-01T22:33:07.193 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-04-01T22:33:07.192+0000 7f31fbc15640 -1 osd.0 0 log_to_monitors true 2024-04-01T22:33:07.221 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-04-01T22:33:07.222+0000 7f127ea13640 -1 osd.5 0 log_to_monitors true 2024-04-01T22:33:07.225 INFO:tasks.ceph.osd.1.smithi047.stderr:2024-04-01T22:33:07.224+0000 7f7305212640 -1 osd.1 0 log_to_monitors true 2024-04-01T22:33:07.238 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-04-01T22:33:07.238+0000 7f6af9401640 -1 osd.3 0 log_to_monitors true 2024-04-01T22:33:07.255 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-04-01T22:33:07.255+0000 7f2101ad5640 -1 osd.7 0 log_to_monitors true 2024-04-01T22:33:10.072 INFO:tasks.ceph.osd.2.smithi047.stderr:2024-04-01T22:33:10.071+0000 7f102b990640 -1 osd.2 0 waiting for initial osdmap 2024-04-01T22:33:10.121 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-04-01T22:33:10.121+0000 7f0dde0d4640 -1 osd.6 0 waiting for initial osdmap 2024-04-01T22:33:10.140 INFO:tasks.ceph.osd.2.smithi047.stderr:2024-04-01T22:33:10.140+0000 7f10237b0640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T22:33:10.154 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-04-01T22:33:10.154+0000 7f127a3d3640 -1 osd.5 0 waiting for initial osdmap 2024-04-01T22:33:10.155 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-04-01T22:33:10.156+0000 7f0dd5ef4640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T22:33:10.185 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-04-01T22:33:10.184+0000 7f31f75db640 -1 osd.0 0 waiting for initial osdmap 2024-04-01T22:33:10.225 INFO:tasks.ceph.osd.1.smithi047.stderr:2024-04-01T22:33:10.224+0000 7f7300b59640 -1 osd.1 0 waiting for initial osdmap 2024-04-01T22:33:10.229 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-04-01T22:33:10.229+0000 7f6af5397640 -1 osd.3 0 waiting for initial osdmap 2024-04-01T22:33:10.248 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-04-01T22:33:10.249+0000 7f12721f3640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T22:33:10.270 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-04-01T22:33:10.270+0000 7ff0798d4640 -1 osd.4 0 waiting for initial osdmap 2024-04-01T22:33:10.271 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-04-01T22:33:10.271+0000 7f20fda6b640 -1 osd.7 0 waiting for initial osdmap 2024-04-01T22:33:10.280 INFO:tasks.ceph.osd.1.smithi047.stderr:2024-04-01T22:33:10.280+0000 7f72f8979640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T22:33:10.288 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-04-01T22:33:10.288+0000 7f31ef3fb640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T22:33:10.288 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-04-01T22:33:10.288+0000 7f6aed1b7640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T22:33:10.302 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-04-01T22:33:10.303+0000 7ff0716f4640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T22:33:10.306 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-04-01T22:33:10.307+0000 7f20f588b640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T22:33:11.413 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:33:11.415 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:33:11.909 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-01T22:33:12.001 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.001+0000 7f6c6ab0d640 1 Processor -- start 2024-04-01T22:33:12.001 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.001+0000 7f6c6ab0d640 1 -- start start 2024-04-01T22:33:12.002 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.002+0000 7f6c6ab0d640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6c64154460 0x7f6c64071290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:12.003 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.002+0000 7f6c6ab0d640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6c640c8310 0x7f6c640717d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:12.003 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.002+0000 7f6c6ab0d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6c6415dd70 0x7f6c6415e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:12.003 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.002+0000 7f6c6ab0d640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f6c6415d8e0 con 0x7f6c640c8310 2024-04-01T22:33:12.003 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.002+0000 7f6c6ab0d640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f6c6415e740 con 0x7f6c6415dd70 2024-04-01T22:33:12.003 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.002+0000 7f6c6ab0d640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6c6415a2f0 con 0x7f6c64154460 2024-04-01T22:33:12.003 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.002+0000 7f6c63fff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6c640c8310 0x7f6c640717d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:12.003 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.003+0000 7f6c690aa640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6c6415dd70 0x7f6c6415e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:12.003 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.003+0000 7f6c63fff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6c640c8310 0x7f6c640717d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55914/0 (socket says 172.21.15.47:55914) 2024-04-01T22:33:12.003 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.003+0000 7f6c63fff640 1 -- 172.21.15.47:0/2815966341 learned_addr learned my addr 172.21.15.47:0/2815966341 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:12.004 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.003+0000 7f6c688a9640 1 --2- 172.21.15.47:0/2815966341 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6c64154460 0x7f6c64071290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:12.005 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.005+0000 7f6c63fff640 1 -- 172.21.15.47:0/2815966341 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6c64154460 msgr2=0x7f6c64071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:12.005 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.005+0000 7f6c63fff640 1 --2- 172.21.15.47:0/2815966341 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6c64154460 0x7f6c64071290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:12.005 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.005+0000 7f6c63fff640 1 -- 172.21.15.47:0/2815966341 >> v2:172.21.15.181:3300/0 conn(0x7f6c6415dd70 msgr2=0x7f6c6415e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:12.005 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.005+0000 7f6c63fff640 1 --2- 172.21.15.47:0/2815966341 >> v2:172.21.15.181:3300/0 conn(0x7f6c6415dd70 0x7f6c6415e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:12.005 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.005+0000 7f6c63fff640 1 -- 172.21.15.47:0/2815966341 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c6415a590 con 0x7f6c640c8310 2024-04-01T22:33:12.006 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.007+0000 7f6c63fff640 1 --2- 172.21.15.47:0/2815966341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c640c8310 0x7f6c640717d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6c64070f10 tx=0x7f6c5802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c7c60dac1862a4e server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:12.010 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.010+0000 7f6c637fe640 1 -- 172.21.15.47:0/2815966341 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c58035020 con 0x7f6c640c8310 2024-04-01T22:33:12.010 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.010+0000 7f6c637fe640 1 -- 172.21.15.47:0/2815966341 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c58031870 con 0x7f6c640c8310 2024-04-01T22:33:12.010 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.010+0000 7f6c637fe640 1 -- 172.21.15.47:0/2815966341 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c58031c40 con 0x7f6c640c8310 2024-04-01T22:33:12.011 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.011+0000 7f6c6ab0d640 1 -- 172.21.15.47:0/2815966341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c640c8310 msgr2=0x7f6c640717d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:12.011 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.011+0000 7f6c6ab0d640 1 --2- 172.21.15.47:0/2815966341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c640c8310 0x7f6c640717d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6c64070f10 tx=0x7f6c5802b910 comp rx=0 tx=0).stop 2024-04-01T22:33:12.011 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.011+0000 7f6c6ab0d640 1 -- 172.21.15.47:0/2815966341 shutdown_connections 2024-04-01T22:33:12.011 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.011+0000 7f6c6ab0d640 1 --2- 172.21.15.47:0/2815966341 >> v2:172.21.15.181:3300/0 conn(0x7f6c6415dd70 0x7f6c6415e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:12.011 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.011+0000 7f6c6ab0d640 1 --2- 172.21.15.47:0/2815966341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c640c8310 0x7f6c640717d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:12.011 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.011+0000 7f6c6ab0d640 1 --2- 172.21.15.47:0/2815966341 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6c64154460 0x7f6c64071290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:12.011 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.011+0000 7f6c6ab0d640 1 -- 172.21.15.47:0/2815966341 >> 172.21.15.47:0/2815966341 conn(0x7f6c64067600 msgr2=0x7f6c6406f660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:12.012 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.011+0000 7f6c6ab0d640 1 -- 172.21.15.47:0/2815966341 shutdown_connections 2024-04-01T22:33:12.012 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.011+0000 7f6c6ab0d640 1 -- 172.21.15.47:0/2815966341 wait complete. 2024-04-01T22:33:12.012 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.012+0000 7f6c6ab0d640 1 Processor -- start 2024-04-01T22:33:12.012 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.013+0000 7f6c6ab0d640 1 -- start start 2024-04-01T22:33:12.013 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.013+0000 7f6c6ab0d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c640c8310 0x7f6c640c7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:12.013 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.013+0000 7f6c6ab0d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6c64154460 0x7f6c640c5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:12.013 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.013+0000 7f6c6ab0d640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6c6415dd70 0x7f6c640c5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:12.013 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.013+0000 7f6c6ab0d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6415ae30 con 0x7f6c640c8310 2024-04-01T22:33:12.013 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.013+0000 7f6c6ab0d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6415ab50 con 0x7f6c64154460 2024-04-01T22:33:12.013 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.013+0000 7f6c6ab0d640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6c6415b110 con 0x7f6c6415dd70 2024-04-01T22:33:12.014 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.014+0000 7f6c688a9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c640c8310 0x7f6c640c7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:12.014 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.014+0000 7f6c690aa640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6c6415dd70 0x7f6c640c5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:12.014 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.014+0000 7f6c63fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6c64154460 0x7f6c640c5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:12.014 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.014+0000 7f6c688a9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c640c8310 0x7f6c640c7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55930/0 (socket says 172.21.15.47:55930) 2024-04-01T22:33:12.014 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.014+0000 7f6c688a9640 1 -- 172.21.15.47:0/771488906 learned_addr learned my addr 172.21.15.47:0/771488906 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:12.014 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.014+0000 7f6c690aa640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6c6415dd70 0x7f6c640c5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:38494/0 (socket says 172.21.15.47:38494) 2024-04-01T22:33:12.017 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.017+0000 7f6c688a9640 1 -- 172.21.15.47:0/771488906 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6c6415dd70 msgr2=0x7f6c640c5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:12.017 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.017+0000 7f6c688a9640 1 --2- 172.21.15.47:0/771488906 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6c6415dd70 0x7f6c640c5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:12.017 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.017+0000 7f6c688a9640 1 -- 172.21.15.47:0/771488906 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6c64154460 msgr2=0x7f6c640c5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:12.017 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.017+0000 7f6c688a9640 1 --2- 172.21.15.47:0/771488906 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6c64154460 0x7f6c640c5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:12.017 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.017+0000 7f6c688a9640 1 -- 172.21.15.47:0/771488906 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c6415d1c0 con 0x7f6c640c8310 2024-04-01T22:33:12.019 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.019+0000 7f6c688a9640 1 --2- 172.21.15.47:0/771488906 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c640c8310 0x7f6c640c7840 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c00eed0 tx=0x7f6c5c00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:12.023 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.023+0000 7f6c617fa640 1 -- 172.21.15.47:0/771488906 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c018020 con 0x7f6c640c8310 2024-04-01T22:33:12.023 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.023+0000 7f6c617fa640 1 -- 172.21.15.47:0/771488906 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c5c014400 con 0x7f6c640c8310 2024-04-01T22:33:12.023 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.023+0000 7f6c6ab0d640 1 -- 172.21.15.47:0/771488906 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c640c5370 con 0x7f6c640c8310 2024-04-01T22:33:12.023 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.023+0000 7f6c617fa640 1 -- 172.21.15.47:0/771488906 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c0147d0 con 0x7f6c640c8310 2024-04-01T22:33:12.023 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.023+0000 7f6c6ab0d640 1 -- 172.21.15.47:0/771488906 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c640c4db0 con 0x7f6c640c8310 2024-04-01T22:33:12.023 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.024+0000 7f6c6ab0d640 1 -- 172.21.15.47:0/771488906 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c640c2930 con 0x7f6c640c8310 2024-04-01T22:33:12.044 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.044+0000 7f6c617fa640 1 -- 172.21.15.47:0/771488906 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 4) ==== 90100+0+0 (secure 0 0 0) 0x7f6c5c005d10 con 0x7f6c640c8310 2024-04-01T22:33:12.044 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.045+0000 7f6c617fa640 1 --2- 172.21.15.47:0/771488906 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f6c5006b950 0x7f6c5006de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:12.044 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.045+0000 7f6c63fff640 1 --2- 172.21.15.47:0/771488906 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f6c5006b950 0x7f6c5006de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:12.045 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.045+0000 7f6c63fff640 1 --2- 172.21.15.47:0/771488906 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f6c5006b950 0x7f6c5006de10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6c58036000 tx=0x7f6c5803c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:12.047 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.047+0000 7f6c617fa640 1 -- 172.21.15.47:0/771488906 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 4471+0+0 (secure 0 0 0) 0x7f6c5c057d10 con 0x7f6c640c8310 2024-04-01T22:33:12.310 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.308+0000 7f6c617fa640 1 -- 172.21.15.47:0/771488906 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f6c640c2930 con 0x7f6c640c8310 2024-04-01T22:33:12.500 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.500+0000 7f6c6ab0d640 1 -- 172.21.15.47:0/771488906 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6c6404f4b0 con 0x7f6c640c8310 2024-04-01T22:33:12.541 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.541+0000 7f6c617fa640 1 -- 172.21.15.47:0/771488906 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+10921 (secure 0 0 0) 0x7f6c5c022030 con 0x7f6c640c8310 2024-04-01T22:33:12.541 INFO:teuthology.misc.health.smithi047.stdout: 2024-04-01T22:33:12.541 INFO:teuthology.misc.health.smithi047.stdout:{"epoch":13,"fsid":"a6998a48-38bc-4e42-b0d9-04f2fb5c3c87","created":"2024-04-01T22:32:57.112033+0000","modified":"2024-04-01T22:33:11.141073+0000","last_up_change":"2024-04-01T22:33:11.141073+0000","last_in_change":"2024-04-01T22:33:02.650459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7bd3f25d-e3a5-4932-b381-53dcbb464dde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6811","nonce":3827395709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6813","nonce":3827395709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6817","nonce":3827395709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6815","nonce":3827395709}]},"public_addr":"172.21.15.47:6811/3827395709","cluster_addr":"172.21.15.47:6813/3827395709","heartbeat_back_addr":"172.21.15.47:6817/3827395709","heartbeat_front_addr":"172.21.15.47:6815/3827395709","state":["exists","up"]},{"osd":1,"uuid":"2aa60ba2-67ff-43c7-96c4-82ae2f3855ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6827","nonce":3152157503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6829","nonce":3152157503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6833","nonce":3152157503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6831","nonce":3152157503}]},"public_addr":"172.21.15.47:6827/3152157503","cluster_addr":"172.21.15.47:6829/3152157503","heartbeat_back_addr":"172.21.15.47:6833/3152157503","heartbeat_front_addr":"172.21.15.47:6831/3152157503","state":["exists","up"]},{"osd":2,"uuid":"d83f8a98-6db8-42b7-9ef6-5b16eb9a3492","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6803","nonce":1003968856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6805","nonce":1003968856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6809","nonce":1003968856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6807","nonce":1003968856}]},"public_addr":"172.21.15.47:6803/1003968856","cluster_addr":"172.21.15.47:6805/1003968856","heartbeat_back_addr":"172.21.15.47:6809/1003968856","heartbeat_front_addr":"172.21.15.47:6807/1003968856","state":["exists","up"]},{"osd":3,"uuid":"edc02ed5-d25c-4dc9-a0c3-7a26f20fae07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6819","nonce":2845699561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6821","nonce":2845699561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6825","nonce":2845699561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6823","nonce":2845699561}]},"public_addr":"172.21.15.47:6819/2845699561","cluster_addr":"172.21.15.47:6821/2845699561","heartbeat_back_addr":"172.21.15.47:6825/2845699561","heartbeat_front_addr":"172.21.15.47:6823/2845699561","state":["exists","up"]},{"osd":4,"uuid":"b3d67e74-f51e-4474-9c62-dd0daa60c728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6809","nonce":2961538461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6811","nonce":2961538461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6815","nonce":2961538461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6813","nonce":2961538461}]},"public_addr":"172.21.15.181:6809/2961538461","cluster_addr":"172.21.15.181:6811/2961538461","heartbeat_back_addr":"172.21.15.181:6815/2961538461","heartbeat_front_addr":"172.21.15.181:6813/2961538461","state":["exists","up"]},{"osd":5,"uuid":"d86e8f7a-99f4-4457-9949-cf2cb853e79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6817","nonce":2161566540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6819","nonce":2161566540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6823","nonce":2161566540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6821","nonce":2161566540}]},"public_addr":"172.21.15.181:6817/2161566540","cluster_addr":"172.21.15.181:6819/2161566540","heartbeat_back_addr":"172.21.15.181:6823/2161566540","heartbeat_front_addr":"172.21.15.181:6821/2161566540","state":["exists","up"]},{"osd":6,"uuid":"aa08266c-1719-4abd-afb9-e7e8ac593658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6801","nonce":3792144865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6803","nonce":3792144865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6807","nonce":3792144865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6805","nonce":3792144865}]},"public_addr":"172.21.15.181:6801/3792144865","cluster_addr":"172.21.15.181:6803/3792144865","heartbeat_back_addr":"172.21.15.181:6807/3792144865","heartbeat_front_addr":"172.21.15.181:6805/3792144865","state":["exists","up"]},{"osd":7,"uuid":"6e509762-24c8-46c3-93a1-4c50b11ebcf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6825","nonce":1760995885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6827","nonce":1760995885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6831","nonce":1760995885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6829","nonce":1760995885}]},"public_addr":"172.21.15.181:6825/1760995885","cluster_addr":"172.21.15.181:6827/1760995885","heartbeat_back_addr":"172.21.15.181:6831/1760995885","heartbeat_front_addr":"172.21.15.181:6829/1760995885","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T22:33:12.544 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.544+0000 7f6c6ab0d640 1 -- 172.21.15.47:0/771488906 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f6c5006b950 msgr2=0x7f6c5006de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:12.544 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.544+0000 7f6c6ab0d640 1 --2- 172.21.15.47:0/771488906 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f6c5006b950 0x7f6c5006de10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6c58036000 tx=0x7f6c5803c040 comp rx=0 tx=0).stop 2024-04-01T22:33:12.544 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.544+0000 7f6c6ab0d640 1 -- 172.21.15.47:0/771488906 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c640c8310 msgr2=0x7f6c640c7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:12.544 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.544+0000 7f6c6ab0d640 1 --2- 172.21.15.47:0/771488906 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c640c8310 0x7f6c640c7840 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c00eed0 tx=0x7f6c5c00b480 comp rx=0 tx=0).stop 2024-04-01T22:33:12.544 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.544+0000 7f6c6ab0d640 1 -- 172.21.15.47:0/771488906 shutdown_connections 2024-04-01T22:33:12.544 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.544+0000 7f6c6ab0d640 1 --2- 172.21.15.47:0/771488906 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f6c5006b950 0x7f6c5006de10 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:12.544 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.544+0000 7f6c6ab0d640 1 --2- 172.21.15.47:0/771488906 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6c6415dd70 0x7f6c640c5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:12.544 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.544+0000 7f6c6ab0d640 1 --2- 172.21.15.47:0/771488906 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6c64154460 0x7f6c640c5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:12.544 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.544+0000 7f6c6ab0d640 1 --2- 172.21.15.47:0/771488906 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c640c8310 0x7f6c640c7840 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:12.544 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.544+0000 7f6c6ab0d640 1 -- 172.21.15.47:0/771488906 >> 172.21.15.47:0/771488906 conn(0x7f6c64067600 msgr2=0x7f6c6406cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:12.544 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.544+0000 7f6c6ab0d640 1 -- 172.21.15.47:0/771488906 shutdown_connections 2024-04-01T22:33:12.545 INFO:teuthology.misc.health.smithi047.stderr:2024-04-01T22:33:12.544+0000 7f6c6ab0d640 1 -- 172.21.15.47:0/771488906 wait complete. 2024-04-01T22:33:12.553 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-01T22:33:12.554 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-01T22:33:12.554 DEBUG:tasks.ceph_manager:running mds.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-04-01T22:33:12.554 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-01T22:33:12.554 DEBUG:teuthology.orchestra.run.smithi047:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i a 2024-04-01T22:33:12.556 INFO:tasks.ceph.mds.a:Started 2024-04-01T22:33:12.556 DEBUG:tasks.ceph_manager:running mds.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-04-01T22:33:12.556 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-01T22:33:12.557 DEBUG:teuthology.orchestra.run.smithi047:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i c 2024-04-01T22:33:12.559 INFO:tasks.ceph.mds.c:Started 2024-04-01T22:33:12.559 DEBUG:tasks.ceph_manager:running mds.e under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.e.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-04-01T22:33:12.559 INFO:tasks.ceph.mds.e:Restarting daemon 2024-04-01T22:33:12.559 DEBUG:teuthology.orchestra.run.smithi047:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i e 2024-04-01T22:33:12.561 INFO:tasks.ceph.mds.e:Started 2024-04-01T22:33:12.561 DEBUG:tasks.ceph_manager:running mds.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-04-01T22:33:12.561 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-01T22:33:12.561 DEBUG:teuthology.orchestra.run.smithi181:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i b 2024-04-01T22:33:12.564 INFO:tasks.ceph.mds.b:Started 2024-04-01T22:33:12.564 DEBUG:tasks.ceph_manager:running mds.d under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.d.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-04-01T22:33:12.564 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-01T22:33:12.564 DEBUG:teuthology.orchestra.run.smithi181:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i d 2024-04-01T22:33:12.566 INFO:tasks.ceph.mds.d:Started 2024-04-01T22:33:12.566 DEBUG:tasks.ceph_manager:running mds.f under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.f.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-04-01T22:33:12.566 INFO:tasks.ceph.mds.f:Restarting daemon 2024-04-01T22:33:12.567 DEBUG:teuthology.orchestra.run.smithi181:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i f 2024-04-01T22:33:12.569 INFO:tasks.ceph.mds.f:Started 2024-04-01T22:33:12.569 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-01T22:33:12.569 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T22:33:12.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.677+0000 7f19e128d640 1 Processor -- start 2024-04-01T22:33:12.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.677+0000 7f19e128d640 1 -- start start 2024-04-01T22:33:12.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.677+0000 7f19e128d640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f19dc06c250 0x7f19dc15aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:12.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.677+0000 7f19e128d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f19dc06c630 0x7f19dc0ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:12.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.677+0000 7f19e128d640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f19dc0cf0d0 0x7f19dc15bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:12.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.677+0000 7f19e128d640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f19dc0ce990 con 0x7f19dc0cf0d0 2024-04-01T22:33:12.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.678+0000 7f19e128d640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f19dc154b70 con 0x7f19dc06c630 2024-04-01T22:33:12.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.678+0000 7f19e128d640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f19dc0cdac0 con 0x7f19dc06c250 2024-04-01T22:33:12.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.679+0000 7f19daffd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f19dc06c250 0x7f19dc15aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:12.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.679+0000 7f19daffd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f19dc06c250 0x7f19dc15aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:38500/0 (socket says 172.21.15.47:38500) 2024-04-01T22:33:12.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.679+0000 7f19daffd640 1 -- 172.21.15.47:0/459206 learned_addr learned my addr 172.21.15.47:0/459206 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:12.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.681+0000 7f19db7fe640 1 --2- 172.21.15.47:0/459206 >> v2:172.21.15.47:3300/0 conn(0x7f19dc0cf0d0 0x7f19dc15bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:12.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.682+0000 7f19daffd640 1 -- 172.21.15.47:0/459206 >> v2:172.21.15.181:3300/0 conn(0x7f19dc06c630 msgr2=0x7f19dc0ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:12.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.682+0000 7f19daffd640 1 --2- 172.21.15.47:0/459206 >> v2:172.21.15.181:3300/0 conn(0x7f19dc06c630 0x7f19dc0ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:12.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.682+0000 7f19daffd640 1 -- 172.21.15.47:0/459206 >> v2:172.21.15.47:3300/0 conn(0x7f19dc0cf0d0 msgr2=0x7f19dc15bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:12.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.682+0000 7f19daffd640 1 --2- 172.21.15.47:0/459206 >> v2:172.21.15.47:3300/0 conn(0x7f19dc0cf0d0 0x7f19dc15bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:12.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.682+0000 7f19daffd640 1 -- 172.21.15.47:0/459206 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19dc0cdd80 con 0x7f19dc06c250 2024-04-01T22:33:12.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.685+0000 7f19daffd640 1 --2- 172.21.15.47:0/459206 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f19dc06c250 0x7f19dc15aec0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f19dc06b690 tx=0x7f19cc02b990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5532c22e1a0b0949 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:12.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.690+0000 7f19d9ffb640 1 -- 172.21.15.47:0/459206 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19cc034070 con 0x7f19dc06c250 2024-04-01T22:33:12.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.690+0000 7f19d9ffb640 1 -- 172.21.15.47:0/459206 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19cc030850 con 0x7f19dc06c250 2024-04-01T22:33:12.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.690+0000 7f19d9ffb640 1 -- 172.21.15.47:0/459206 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19cc030c20 con 0x7f19dc06c250 2024-04-01T22:33:12.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.690+0000 7f19e128d640 1 -- 172.21.15.47:0/459206 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f19dc06c250 msgr2=0x7f19dc15aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:12.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.690+0000 7f19e128d640 1 --2- 172.21.15.47:0/459206 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f19dc06c250 0x7f19dc15aec0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f19dc06b690 tx=0x7f19cc02b990 comp rx=0 tx=0).stop 2024-04-01T22:33:12.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.690+0000 7f19e128d640 1 -- 172.21.15.47:0/459206 shutdown_connections 2024-04-01T22:33:12.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.690+0000 7f19e128d640 1 --2- 172.21.15.47:0/459206 >> v2:172.21.15.47:3300/0 conn(0x7f19dc0cf0d0 0x7f19dc15bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:12.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.690+0000 7f19e128d640 1 --2- 172.21.15.47:0/459206 >> v2:172.21.15.181:3300/0 conn(0x7f19dc06c630 0x7f19dc0ceb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:12.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.690+0000 7f19e128d640 1 --2- 172.21.15.47:0/459206 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f19dc06c250 0x7f19dc15aec0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:12.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.690+0000 7f19e128d640 1 -- 172.21.15.47:0/459206 >> 172.21.15.47:0/459206 conn(0x7f19dc0cfdb0 msgr2=0x7f19dc0d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:12.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.691+0000 7f19e128d640 1 -- 172.21.15.47:0/459206 shutdown_connections 2024-04-01T22:33:12.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.691+0000 7f19e128d640 1 -- 172.21.15.47:0/459206 wait complete. 2024-04-01T22:33:12.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.692+0000 7f19e128d640 1 Processor -- start 2024-04-01T22:33:12.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.692+0000 7f19e128d640 1 -- start start 2024-04-01T22:33:12.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.693+0000 7f19e128d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19dc06c250 0x7f19dc1535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:12.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.693+0000 7f19e128d640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f19dc06c630 0x7f19dc0cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:12.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.693+0000 7f19e128d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19dc0b2110 0x7f19dc0b01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:12.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.693+0000 7f19e128d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f19dc0ce620 con 0x7f19dc0b2110 2024-04-01T22:33:12.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.693+0000 7f19e128d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f19dc0ce340 con 0x7f19dc06c250 2024-04-01T22:33:12.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.693+0000 7f19e128d640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f19dc06ca30 con 0x7f19dc06c630 2024-04-01T22:33:12.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.693+0000 7f19da7fc640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f19dc06c630 0x7f19dc0cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:12.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.694+0000 7f19db7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19dc0b2110 0x7f19dc0b01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:12.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.694+0000 7f19da7fc640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f19dc06c630 0x7f19dc0cb8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:38508/0 (socket says 172.21.15.47:38508) 2024-04-01T22:33:12.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.694+0000 7f19da7fc640 1 -- 172.21.15.47:0/3740870505 learned_addr learned my addr 172.21.15.47:0/3740870505 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:12.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.699+0000 7f19da7fc640 1 -- 172.21.15.47:0/3740870505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19dc06c250 msgr2=0x7f19dc1535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:12.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.699+0000 7f19da7fc640 1 --2- 172.21.15.47:0/3740870505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19dc06c250 0x7f19dc1535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:12.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.699+0000 7f19da7fc640 1 -- 172.21.15.47:0/3740870505 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19dc0b2110 msgr2=0x7f19dc0b01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:12.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.699+0000 7f19da7fc640 1 --2- 172.21.15.47:0/3740870505 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19dc0b2110 0x7f19dc0b01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:12.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.699+0000 7f19da7fc640 1 -- 172.21.15.47:0/3740870505 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19dc155b40 con 0x7f19dc06c630 2024-04-01T22:33:12.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.703+0000 7f19da7fc640 1 --2- 172.21.15.47:0/3740870505 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f19dc06c630 0x7f19dc0cb8a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f19d000b4a0 tx=0x7f19d000b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:12.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.708+0000 7f19c37fe640 1 -- 172.21.15.47:0/3740870505 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d0014070 con 0x7f19dc06c630 2024-04-01T22:33:12.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.708+0000 7f19c37fe640 1 -- 172.21.15.47:0/3740870505 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19d0010610 con 0x7f19dc06c630 2024-04-01T22:33:12.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.708+0000 7f19c37fe640 1 -- 172.21.15.47:0/3740870505 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d0010a00 con 0x7f19dc06c630 2024-04-01T22:33:12.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.708+0000 7f19e128d640 1 -- 172.21.15.47:0/3740870505 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19dc155e20 con 0x7f19dc06c630 2024-04-01T22:33:12.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.708+0000 7f19e128d640 1 -- 172.21.15.47:0/3740870505 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f19dc1563e0 con 0x7f19dc06c630 2024-04-01T22:33:12.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.709+0000 7f19e128d640 1 -- 172.21.15.47:0/3740870505 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19dc068210 con 0x7f19dc06c630 2024-04-01T22:33:12.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.742+0000 7f19c37fe640 1 -- 172.21.15.47:0/3740870505 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 4) ==== 90100+0+0 (secure 0 0 0) 0x7f19d0017070 con 0x7f19dc06c630 2024-04-01T22:33:12.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.742+0000 7f19c37fe640 1 --2- 172.21.15.47:0/3740870505 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f19c806b900 0x7f19c806ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:12.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.742+0000 7f19daffd640 1 --2- 172.21.15.47:0/3740870505 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f19c806b900 0x7f19c806ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:12.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:12.743+0000 7f19daffd640 1 --2- 172.21.15.47:0/3740870505 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f19c806b900 0x7f19c806ddc0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f19cc036000 tx=0x7f19cc03b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:13.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.030+0000 7f19c37fe640 1 -- 172.21.15.47:0/3740870505 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(13..13 src has 1..13) ==== 4471+0+0 (secure 0 0 0) 0x7f19d0056ce0 con 0x7f19dc06c630 2024-04-01T22:33:13.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.072+0000 7f19c37fe640 1 -- 172.21.15.47:0/3740870505 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f19d0058c40 con 0x7f19dc06c630 2024-04-01T22:33:13.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.446+0000 7f19e128d640 1 -- 172.21.15.47:0/3740870505 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f19dc0b5b50 con 0x7f19dc06c630 2024-04-01T22:33:13.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.551+0000 7f19c37fe640 1 -- 172.21.15.47:0/3740870505 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+11105 (secure 0 0 0) 0x7f19d005cce0 con 0x7f19dc06c630 2024-04-01T22:33:13.551 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:33:13.552 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":14,"fsid":"a6998a48-38bc-4e42-b0d9-04f2fb5c3c87","created":"2024-04-01T22:32:57.112033+0000","modified":"2024-04-01T22:33:12.619048+0000","last_up_change":"2024-04-01T22:33:11.141073+0000","last_in_change":"2024-04-01T22:33:02.650459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7bd3f25d-e3a5-4932-b381-53dcbb464dde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6811","nonce":3827395709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6813","nonce":3827395709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6817","nonce":3827395709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6815","nonce":3827395709}]},"public_addr":"172.21.15.47:6811/3827395709","cluster_addr":"172.21.15.47:6813/3827395709","heartbeat_back_addr":"172.21.15.47:6817/3827395709","heartbeat_front_addr":"172.21.15.47:6815/3827395709","state":["exists","up"]},{"osd":1,"uuid":"2aa60ba2-67ff-43c7-96c4-82ae2f3855ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6827","nonce":3152157503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6829","nonce":3152157503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6833","nonce":3152157503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6831","nonce":3152157503}]},"public_addr":"172.21.15.47:6827/3152157503","cluster_addr":"172.21.15.47:6829/3152157503","heartbeat_back_addr":"172.21.15.47:6833/3152157503","heartbeat_front_addr":"172.21.15.47:6831/3152157503","state":["exists","up"]},{"osd":2,"uuid":"d83f8a98-6db8-42b7-9ef6-5b16eb9a3492","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6803","nonce":1003968856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6805","nonce":1003968856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6809","nonce":1003968856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6807","nonce":1003968856}]},"public_addr":"172.21.15.47:6803/1003968856","cluster_addr":"172.21.15.47:6805/1003968856","heartbeat_back_addr":"172.21.15.47:6809/1003968856","heartbeat_front_addr":"172.21.15.47:6807/1003968856","state":["exists","up"]},{"osd":3,"uuid":"edc02ed5-d25c-4dc9-a0c3-7a26f20fae07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6819","nonce":2845699561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6821","nonce":2845699561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6825","nonce":2845699561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6823","nonce":2845699561}]},"public_addr":"172.21.15.47:6819/2845699561","cluster_addr":"172.21.15.47:6821/2845699561","heartbeat_back_addr":"172.21.15.47:6825/2845699561","heartbeat_front_addr":"172.21.15.47:6823/2845699561","state":["exists","up"]},{"osd":4,"uuid":"b3d67e74-f51e-4474-9c62-dd0daa60c728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6809","nonce":2961538461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6811","nonce":2961538461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6815","nonce":2961538461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6813","nonce":2961538461}]},"public_addr":"172.21.15.181:6809/2961538461","cluster_addr":"172.21.15.181:6811/2961538461","heartbeat_back_addr":"172.21.15.181:6815/2961538461","heartbeat_front_addr":"172.21.15.181:6813/2961538461","state":["exists","up"]},{"osd":5,"uuid":"d86e8f7a-99f4-4457-9949-cf2cb853e79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6817","nonce":2161566540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6819","nonce":2161566540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6823","nonce":2161566540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6821","nonce":2161566540}]},"public_addr":"172.21.15.181:6817/2161566540","cluster_addr":"172.21.15.181:6819/2161566540","heartbeat_back_addr":"172.21.15.181:6823/2161566540","heartbeat_front_addr":"172.21.15.181:6821/2161566540","state":["exists","up"]},{"osd":6,"uuid":"aa08266c-1719-4abd-afb9-e7e8ac593658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6801","nonce":3792144865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6803","nonce":3792144865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6807","nonce":3792144865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6805","nonce":3792144865}]},"public_addr":"172.21.15.181:6801/3792144865","cluster_addr":"172.21.15.181:6803/3792144865","heartbeat_back_addr":"172.21.15.181:6807/3792144865","heartbeat_front_addr":"172.21.15.181:6805/3792144865","state":["exists","up"]},{"osd":7,"uuid":"6e509762-24c8-46c3-93a1-4c50b11ebcf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6825","nonce":1760995885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6827","nonce":1760995885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6831","nonce":1760995885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6829","nonce":1760995885}]},"public_addr":"172.21.15.181:6825/1760995885","cluster_addr":"172.21.15.181:6827/1760995885","heartbeat_back_addr":"172.21.15.181:6831/1760995885","heartbeat_front_addr":"172.21.15.181:6829/1760995885","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.202426+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.255318+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.170288+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.290065+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.214871+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.176432+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.139940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.299546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T22:33:13.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.554+0000 7f19e128d640 1 -- 172.21.15.47:0/3740870505 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f19c806b900 msgr2=0x7f19c806ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:13.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.554+0000 7f19e128d640 1 --2- 172.21.15.47:0/3740870505 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f19c806b900 0x7f19c806ddc0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f19cc036000 tx=0x7f19cc03b040 comp rx=0 tx=0).stop 2024-04-01T22:33:13.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.554+0000 7f19e128d640 1 -- 172.21.15.47:0/3740870505 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f19dc06c630 msgr2=0x7f19dc0cb8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:13.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.554+0000 7f19e128d640 1 --2- 172.21.15.47:0/3740870505 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f19dc06c630 0x7f19dc0cb8a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f19d000b4a0 tx=0x7f19d000b960 comp rx=0 tx=0).stop 2024-04-01T22:33:13.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.554+0000 7f19e128d640 1 -- 172.21.15.47:0/3740870505 shutdown_connections 2024-04-01T22:33:13.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.554+0000 7f19e128d640 1 --2- 172.21.15.47:0/3740870505 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f19c806b900 0x7f19c806ddc0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:13.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.554+0000 7f19e128d640 1 --2- 172.21.15.47:0/3740870505 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19dc0b2110 0x7f19dc0b01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:13.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.554+0000 7f19e128d640 1 --2- 172.21.15.47:0/3740870505 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f19dc06c630 0x7f19dc0cb8a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:13.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.554+0000 7f19e128d640 1 --2- 172.21.15.47:0/3740870505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19dc06c250 0x7f19dc1535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:13.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.554+0000 7f19e128d640 1 -- 172.21.15.47:0/3740870505 >> 172.21.15.47:0/3740870505 conn(0x7f19dc0cfdb0 msgr2=0x7f19dc0d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:13.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.555+0000 7f19e128d640 1 -- 172.21.15.47:0/3740870505 shutdown_connections 2024-04-01T22:33:13.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.555+0000 7f19e128d640 1 -- 172.21.15.47:0/3740870505 wait complete. 2024-04-01T22:33:13.569 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-04-01T22:33:13.570 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T22:33:13.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.677+0000 7f0d5e3bc640 1 Processor -- start 2024-04-01T22:33:13.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.677+0000 7f0d5e3bc640 1 -- start start 2024-04-01T22:33:13.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.678+0000 7f0d5e3bc640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f0d581549d0 0x7f0d580c3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:13.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.678+0000 7f0d5e3bc640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f0d580ce470 0x7f0d580c3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:13.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.678+0000 7f0d5e3bc640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d580ce940 con 0x7f0d581545f0 2024-04-01T22:33:13.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.678+0000 7f0d5e3bc640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f0d580c9a60 con 0x7f0d580ce470 2024-04-01T22:33:13.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.678+0000 7f0d5e3bc640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f0d580c8890 con 0x7f0d581549d0 2024-04-01T22:33:13.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.679+0000 7f0d5c959640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f0d580ce470 0x7f0d580c3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:13.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.679+0000 7f0d577fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f0d581549d0 0x7f0d580c3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:13.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.679+0000 7f0d577fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f0d581549d0 0x7f0d580c3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:51426/0 (socket says 172.21.15.47:51426) 2024-04-01T22:33:13.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.679+0000 7f0d5c959640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f0d580ce470 0x7f0d580c3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55958/0 (socket says 172.21.15.47:55958) 2024-04-01T22:33:13.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.679+0000 7f0d577fe640 1 -- 172.21.15.47:0/263615228 learned_addr learned my addr 172.21.15.47:0/263615228 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:13.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.683+0000 7f0d577fe640 1 -- 172.21.15.47:0/263615228 >> v2:172.21.15.47:3300/0 conn(0x7f0d580ce470 msgr2=0x7f0d580c3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:13.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.683+0000 7f0d577fe640 1 --2- 172.21.15.47:0/263615228 >> v2:172.21.15.47:3300/0 conn(0x7f0d580ce470 0x7f0d580c3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:13.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.683+0000 7f0d577fe640 1 -- 172.21.15.47:0/263615228 >> v1:172.21.15.181:6789/0 conn(0x7f0d581545f0 legacy=0x7f0d580ca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:13.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.683+0000 7f0d577fe640 1 -- 172.21.15.47:0/263615228 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d580c8b70 con 0x7f0d581549d0 2024-04-01T22:33:13.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.689+0000 7f0d577fe640 1 --2- 172.21.15.47:0/263615228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d581549d0 0x7f0d580c3a50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0d5806c050 tx=0x7f0d4c02b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db5c91c6c75e6a06 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:13.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.694+0000 7f0d56ffd640 1 -- 172.21.15.47:0/263615228 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c034070 con 0x7f0d581549d0 2024-04-01T22:33:13.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.694+0000 7f0d56ffd640 1 -- 172.21.15.47:0/263615228 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d4c030860 con 0x7f0d581549d0 2024-04-01T22:33:13.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.694+0000 7f0d56ffd640 1 -- 172.21.15.47:0/263615228 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c030c30 con 0x7f0d581549d0 2024-04-01T22:33:13.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.695+0000 7f0d5e3bc640 1 -- 172.21.15.47:0/263615228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d581549d0 msgr2=0x7f0d580c3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:13.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.695+0000 7f0d5e3bc640 1 --2- 172.21.15.47:0/263615228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d581549d0 0x7f0d580c3a50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0d5806c050 tx=0x7f0d4c02b9a0 comp rx=0 tx=0).stop 2024-04-01T22:33:13.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.695+0000 7f0d5e3bc640 1 -- 172.21.15.47:0/263615228 shutdown_connections 2024-04-01T22:33:13.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.695+0000 7f0d5e3bc640 1 --2- 172.21.15.47:0/263615228 >> v2:172.21.15.47:3300/0 conn(0x7f0d580ce470 0x7f0d580c3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:13.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.695+0000 7f0d5e3bc640 1 --2- 172.21.15.47:0/263615228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d581549d0 0x7f0d580c3a50 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:13.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.695+0000 7f0d5e3bc640 1 -- 172.21.15.47:0/263615228 >> 172.21.15.47:0/263615228 conn(0x7f0d58071330 msgr2=0x7f0d58071740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:13.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.695+0000 7f0d5e3bc640 1 -- 172.21.15.47:0/263615228 shutdown_connections 2024-04-01T22:33:13.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.695+0000 7f0d5e3bc640 1 -- 172.21.15.47:0/263615228 wait complete. 2024-04-01T22:33:13.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.696+0000 7f0d5e3bc640 1 Processor -- start 2024-04-01T22:33:13.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.696+0000 7f0d5e3bc640 1 -- start start 2024-04-01T22:33:13.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.697+0000 7f0d5e3bc640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0d580ce470 0x7f0d580afab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:13.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.697+0000 7f0d5e3bc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d581545f0 0x7f0d581487a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:13.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.697+0000 7f0d5e3bc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d5815c580 0x7f0d581f3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:13.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.697+0000 7f0d5e3bc640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0d5806c7f0 con 0x7f0d581545f0 2024-04-01T22:33:13.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.697+0000 7f0d5e3bc640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0d580c9070 con 0x7f0d5815c580 2024-04-01T22:33:13.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.697+0000 7f0d5e3bc640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f0d5806c970 con 0x7f0d580ce470 2024-04-01T22:33:13.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.698+0000 7f0d5c959640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d5815c580 0x7f0d581f3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:13.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.698+0000 7f0d577fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d581545f0 0x7f0d581487a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:13.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.698+0000 7f0d57fff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0d580ce470 0x7f0d580afab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:13.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.698+0000 7f0d5c959640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d5815c580 0x7f0d581f3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:51428/0 (socket says 172.21.15.47:51428) 2024-04-01T22:33:13.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.698+0000 7f0d5c959640 1 -- 172.21.15.47:0/1572825461 learned_addr learned my addr 172.21.15.47:0/1572825461 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:13.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.702+0000 7f0d57fff640 1 -- 172.21.15.47:0/1572825461 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d5815c580 msgr2=0x7f0d581f3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:13.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.702+0000 7f0d57fff640 1 --2- 172.21.15.47:0/1572825461 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d5815c580 0x7f0d581f3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:13.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.702+0000 7f0d57fff640 1 -- 172.21.15.47:0/1572825461 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d581545f0 msgr2=0x7f0d581487a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:13.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.702+0000 7f0d57fff640 1 --2- 172.21.15.47:0/1572825461 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d581545f0 0x7f0d581487a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:13.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.702+0000 7f0d57fff640 1 -- 172.21.15.47:0/1572825461 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d580ad960 con 0x7f0d580ce470 2024-04-01T22:33:13.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.704+0000 7f0d57fff640 1 --2- 172.21.15.47:0/1572825461 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0d580ce470 0x7f0d580afab0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0d4800c370 tx=0x7f0d4800c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:13.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.708+0000 7f0d54ff9640 1 -- 172.21.15.47:0/1572825461 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d480052d0 con 0x7f0d580ce470 2024-04-01T22:33:13.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.708+0000 7f0d5e3bc640 1 -- 172.21.15.47:0/1572825461 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d580b0310 con 0x7f0d580ce470 2024-04-01T22:33:13.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.709+0000 7f0d5e3bc640 1 -- 172.21.15.47:0/1572825461 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d580adeb0 con 0x7f0d580ce470 2024-04-01T22:33:13.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.709+0000 7f0d54ff9640 1 -- 172.21.15.47:0/1572825461 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d48005470 con 0x7f0d580ce470 2024-04-01T22:33:13.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.709+0000 7f0d54ff9640 1 -- 172.21.15.47:0/1572825461 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d48020060 con 0x7f0d580ce470 2024-04-01T22:33:13.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.710+0000 7f0d5e3bc640 1 -- 172.21.15.47:0/1572825461 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d38005290 con 0x7f0d580ce470 2024-04-01T22:33:13.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.733+0000 7f0d54ff9640 1 -- 172.21.15.47:0/1572825461 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 4) ==== 90100+0+0 (secure 0 0 0) 0x7f0d48007220 con 0x7f0d580ce470 2024-04-01T22:33:13.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.734+0000 7f0d54ff9640 1 --2- 172.21.15.47:0/1572825461 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f0d4406b930 0x7f0d4406ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:13.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.734+0000 7f0d577fe640 1 --2- 172.21.15.47:0/1572825461 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f0d4406b930 0x7f0d4406ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:13.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.734+0000 7f0d577fe640 1 --2- 172.21.15.47:0/1572825461 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f0d4406b930 0x7f0d4406ddf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c036000 tx=0x7f0d4c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:13.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:13.996+0000 7f0d54ff9640 1 -- 172.21.15.47:0/1572825461 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(14..14 src has 1..14) ==== 4471+0+0 (secure 0 0 0) 0x7f0d48088ab0 con 0x7f0d580ce470 2024-04-01T22:33:14.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:14.015+0000 7f0d54ff9640 1 -- 172.21.15.47:0/1572825461 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f0d480589f0 con 0x7f0d580ce470 2024-04-01T22:33:14.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:14.249+0000 7f0d5e3bc640 1 -- 172.21.15.47:0/1572825461 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0d38005580 con 0x7f0d580ce470 2024-04-01T22:33:14.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:14.445+0000 7f0d54ff9640 1 -- 172.21.15.47:0/1572825461 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+569 (secure 0 0 0) 0x7f0d4805ca90 con 0x7f0d580ce470 2024-04-01T22:33:14.445 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:33:14.445 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-04-01T22:33:14.446 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 1 2024-04-01T22:33:14.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:14.447+0000 7f0d5e3bc640 1 -- 172.21.15.47:0/1572825461 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f0d4406b930 msgr2=0x7f0d4406ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:14.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:14.447+0000 7f0d5e3bc640 1 --2- 172.21.15.47:0/1572825461 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f0d4406b930 0x7f0d4406ddf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c036000 tx=0x7f0d4c008030 comp rx=0 tx=0).stop 2024-04-01T22:33:14.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:14.447+0000 7f0d5e3bc640 1 -- 172.21.15.47:0/1572825461 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0d580ce470 msgr2=0x7f0d580afab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:14.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:14.447+0000 7f0d5e3bc640 1 --2- 172.21.15.47:0/1572825461 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0d580ce470 0x7f0d580afab0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0d4800c370 tx=0x7f0d4800c830 comp rx=0 tx=0).stop 2024-04-01T22:33:14.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:14.447+0000 7f0d5e3bc640 1 -- 172.21.15.47:0/1572825461 shutdown_connections 2024-04-01T22:33:14.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:14.447+0000 7f0d5e3bc640 1 --2- 172.21.15.47:0/1572825461 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f0d4406b930 0x7f0d4406ddf0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:14.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:14.447+0000 7f0d5e3bc640 1 --2- 172.21.15.47:0/1572825461 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d5815c580 0x7f0d581f3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:14.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:14.447+0000 7f0d5e3bc640 1 --2- 172.21.15.47:0/1572825461 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d581545f0 0x7f0d581487a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:14.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:14.447+0000 7f0d5e3bc640 1 --2- 172.21.15.47:0/1572825461 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0d580ce470 0x7f0d580afab0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:14.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:14.447+0000 7f0d5e3bc640 1 -- 172.21.15.47:0/1572825461 >> 172.21.15.47:0/1572825461 conn(0x7f0d58071330 msgr2=0x7f0d580c39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:14.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:14.448+0000 7f0d5e3bc640 1 -- 172.21.15.47:0/1572825461 shutdown_connections 2024-04-01T22:33:14.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:14.448+0000 7f0d5e3bc640 1 -- 172.21.15.47:0/1572825461 wait complete. 2024-04-01T22:33:16.460 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T22:33:16.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.587+0000 7f079273e640 1 Processor -- start 2024-04-01T22:33:16.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.587+0000 7f079273e640 1 -- start start 2024-04-01T22:33:16.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.588+0000 7f079273e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f078c152220 0x7f078c0ce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:16.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.588+0000 7f079273e640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f078c0c2970 0x7f078c15bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:16.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.588+0000 7f079273e640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f078c157fc0 0x7f078c071280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:16.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.588+0000 7f079273e640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f078c15c4e0 con 0x7f078c152220 2024-04-01T22:33:16.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.588+0000 7f079273e640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f078c0caf80 con 0x7f078c157fc0 2024-04-01T22:33:16.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.588+0000 7f079273e640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f078c0c7e70 con 0x7f078c0c2970 2024-04-01T22:33:16.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.601+0000 7f0783fff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f078c0c2970 0x7f078c15bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:16.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.601+0000 7f0783fff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f078c0c2970 0x7f078c15bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:38540/0 (socket says 172.21.15.47:38540) 2024-04-01T22:33:16.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.601+0000 7f0783fff640 1 -- 172.21.15.47:0/3988151967 learned_addr learned my addr 172.21.15.47:0/3988151967 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:16.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.604+0000 7f0783fff640 1 -- 172.21.15.47:0/3988151967 >> v2:172.21.15.181:3300/0 conn(0x7f078c157fc0 msgr2=0x7f078c071280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:16.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.604+0000 7f0783fff640 1 --2- 172.21.15.47:0/3988151967 >> v2:172.21.15.181:3300/0 conn(0x7f078c157fc0 0x7f078c071280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:16.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.604+0000 7f0783fff640 1 -- 172.21.15.47:0/3988151967 >> v2:172.21.15.47:3300/0 conn(0x7f078c152220 msgr2=0x7f078c0ce2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:16.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.604+0000 7f0783fff640 1 --2- 172.21.15.47:0/3988151967 >> v2:172.21.15.47:3300/0 conn(0x7f078c152220 0x7f078c0ce2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:16.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.604+0000 7f0783fff640 1 -- 172.21.15.47:0/3988151967 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f078c158830 con 0x7f078c0c2970 2024-04-01T22:33:16.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.607+0000 7f0783fff640 1 --2- 172.21.15.47:0/3988151967 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f078c0c2970 0x7f078c15bfa0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f078c070f00 tx=0x7f077c02bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e30606b2352ec075 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:16.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.612+0000 7f078b7fe640 1 -- 172.21.15.47:0/3988151967 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f077c02ca70 con 0x7f078c0c2970 2024-04-01T22:33:16.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.612+0000 7f078b7fe640 1 -- 172.21.15.47:0/3988151967 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f077c02cc10 con 0x7f078c0c2970 2024-04-01T22:33:16.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.612+0000 7f078b7fe640 1 -- 172.21.15.47:0/3988151967 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f077c0343f0 con 0x7f078c0c2970 2024-04-01T22:33:16.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.614+0000 7f079273e640 1 -- 172.21.15.47:0/3988151967 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f078c0c2970 msgr2=0x7f078c15bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:16.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.614+0000 7f079273e640 1 --2- 172.21.15.47:0/3988151967 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f078c0c2970 0x7f078c15bfa0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f078c070f00 tx=0x7f077c02bed0 comp rx=0 tx=0).stop 2024-04-01T22:33:16.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.614+0000 7f079273e640 1 -- 172.21.15.47:0/3988151967 shutdown_connections 2024-04-01T22:33:16.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.614+0000 7f079273e640 1 --2- 172.21.15.47:0/3988151967 >> v2:172.21.15.181:3300/0 conn(0x7f078c157fc0 0x7f078c071280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:16.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.614+0000 7f079273e640 1 --2- 172.21.15.47:0/3988151967 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f078c0c2970 0x7f078c15bfa0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:16.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.614+0000 7f079273e640 1 --2- 172.21.15.47:0/3988151967 >> v2:172.21.15.47:3300/0 conn(0x7f078c152220 0x7f078c0ce2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:16.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.614+0000 7f079273e640 1 -- 172.21.15.47:0/3988151967 >> 172.21.15.47:0/3988151967 conn(0x7f078c06b530 msgr2=0x7f078c06f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:16.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.615+0000 7f079273e640 1 -- 172.21.15.47:0/3988151967 shutdown_connections 2024-04-01T22:33:16.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.615+0000 7f079273e640 1 -- 172.21.15.47:0/3988151967 wait complete. 2024-04-01T22:33:16.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.616+0000 7f079273e640 1 Processor -- start 2024-04-01T22:33:16.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.616+0000 7f079273e640 1 -- start start 2024-04-01T22:33:16.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.618+0000 7f079273e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f078c0c2970 0x7f078c1ef2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:16.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.618+0000 7f079273e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f078c152220 0x7f078c148b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:16.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.618+0000 7f079273e640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f078c157fc0 0x7f078c14e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:16.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.618+0000 7f079273e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f078c15b7a0 con 0x7f078c0c2970 2024-04-01T22:33:16.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.618+0000 7f079273e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f078c158df0 con 0x7f078c152220 2024-04-01T22:33:16.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.618+0000 7f079273e640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f078c15ba80 con 0x7f078c157fc0 2024-04-01T22:33:16.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.619+0000 7f078bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f078c0c2970 0x7f078c1ef2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:16.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.619+0000 7f0790cdb640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f078c157fc0 0x7f078c14e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:16.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.619+0000 7f0790cdb640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f078c157fc0 0x7f078c14e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:38548/0 (socket says 172.21.15.47:38548) 2024-04-01T22:33:16.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.619+0000 7f0790cdb640 1 -- 172.21.15.47:0/4247849481 learned_addr learned my addr 172.21.15.47:0/4247849481 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:16.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.625+0000 7f0790cdb640 1 -- 172.21.15.47:0/4247849481 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f078c152220 msgr2=0x7f078c148b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:16.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.625+0000 7f0790cdb640 1 --2- 172.21.15.47:0/4247849481 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f078c152220 0x7f078c148b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:16.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.625+0000 7f0790cdb640 1 -- 172.21.15.47:0/4247849481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f078c0c2970 msgr2=0x7f078c1ef2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:16.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.625+0000 7f0790cdb640 1 --2- 172.21.15.47:0/4247849481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f078c0c2970 0x7f078c1ef2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:16.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.625+0000 7f0790cdb640 1 -- 172.21.15.47:0/4247849481 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f078c150680 con 0x7f078c157fc0 2024-04-01T22:33:16.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.628+0000 7f0790cdb640 1 --2- 172.21.15.47:0/4247849481 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f078c157fc0 0x7f078c14e740 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f078400b440 tx=0x7f078400b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:16.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.633+0000 7f07897fa640 1 -- 172.21.15.47:0/4247849481 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0784015020 con 0x7f078c157fc0 2024-04-01T22:33:16.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.633+0000 7f07897fa640 1 -- 172.21.15.47:0/4247849481 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0784011830 con 0x7f078c157fc0 2024-04-01T22:33:16.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.633+0000 7f07897fa640 1 -- 172.21.15.47:0/4247849481 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0784015020 con 0x7f078c157fc0 2024-04-01T22:33:16.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.633+0000 7f079273e640 1 -- 172.21.15.47:0/4247849481 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f078c150ee0 con 0x7f078c157fc0 2024-04-01T22:33:16.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.634+0000 7f079273e640 1 -- 172.21.15.47:0/4247849481 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f078c150c00 con 0x7f078c157fc0 2024-04-01T22:33:16.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.636+0000 7f079273e640 1 -- 172.21.15.47:0/4247849481 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f078c0cad60 con 0x7f078c157fc0 2024-04-01T22:33:16.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.664+0000 7f07897fa640 1 -- 172.21.15.47:0/4247849481 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 4) ==== 90100+0+0 (secure 0 0 0) 0x7f0784018020 con 0x7f078c157fc0 2024-04-01T22:33:16.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.664+0000 7f07897fa640 1 --2- 172.21.15.47:0/4247849481 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f076c06bd00 0x7f076c06e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:16.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.664+0000 7f078bfff640 1 --2- 172.21.15.47:0/4247849481 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f076c06bd00 0x7f076c06e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:16.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.665+0000 7f078bfff640 1 --2- 172.21.15.47:0/4247849481 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f076c06bd00 0x7f076c06e1c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0774009990 tx=0x7f0774009110 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:16.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.917+0000 7f07897fa640 1 -- 172.21.15.47:0/4247849481 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f0784011630 con 0x7f078c157fc0 2024-04-01T22:33:16.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:16.937+0000 7f07897fa640 1 -- 172.21.15.47:0/4247849481 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f078c0cad60 con 0x7f078c157fc0 2024-04-01T22:33:17.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:17.164+0000 7f079273e640 1 -- 172.21.15.47:0/4247849481 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f078c0c44a0 con 0x7f078c157fc0 2024-04-01T22:33:17.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:17.305+0000 7f07897fa640 1 -- 172.21.15.47:0/4247849481 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+569 (secure 0 0 0) 0x7f078c0c44a0 con 0x7f078c157fc0 2024-04-01T22:33:17.306 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:33:17.306 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-04-01T22:33:17.306 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 1 2024-04-01T22:33:17.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:17.308+0000 7f079273e640 1 -- 172.21.15.47:0/4247849481 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f076c06bd00 msgr2=0x7f076c06e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:17.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:17.308+0000 7f079273e640 1 --2- 172.21.15.47:0/4247849481 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f076c06bd00 0x7f076c06e1c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0774009990 tx=0x7f0774009110 comp rx=0 tx=0).stop 2024-04-01T22:33:17.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:17.308+0000 7f079273e640 1 -- 172.21.15.47:0/4247849481 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f078c157fc0 msgr2=0x7f078c14e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:17.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:17.308+0000 7f079273e640 1 --2- 172.21.15.47:0/4247849481 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f078c157fc0 0x7f078c14e740 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f078400b440 tx=0x7f078400b840 comp rx=0 tx=0).stop 2024-04-01T22:33:17.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:17.308+0000 7f079273e640 1 -- 172.21.15.47:0/4247849481 shutdown_connections 2024-04-01T22:33:17.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:17.308+0000 7f079273e640 1 --2- 172.21.15.47:0/4247849481 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f076c06bd00 0x7f076c06e1c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:17.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:17.308+0000 7f079273e640 1 --2- 172.21.15.47:0/4247849481 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f078c157fc0 0x7f078c14e740 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:17.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:17.308+0000 7f079273e640 1 --2- 172.21.15.47:0/4247849481 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f078c152220 0x7f078c148b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:17.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:17.308+0000 7f079273e640 1 --2- 172.21.15.47:0/4247849481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f078c0c2970 0x7f078c1ef2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:17.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:17.308+0000 7f079273e640 1 -- 172.21.15.47:0/4247849481 >> 172.21.15.47:0/4247849481 conn(0x7f078c06b530 msgr2=0x7f078c155e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:17.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:17.308+0000 7f079273e640 1 -- 172.21.15.47:0/4247849481 shutdown_connections 2024-04-01T22:33:17.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:17.308+0000 7f079273e640 1 -- 172.21.15.47:0/4247849481 wait complete. 2024-04-01T22:33:19.161 INFO:tasks.ceph.mds.e.smithi047.stdout:starting mds.e at 2024-04-01T22:33:19.207 INFO:tasks.ceph.mds.a.smithi047.stdout:starting mds.a at 2024-04-01T22:33:19.266 INFO:tasks.ceph.mds.b.smithi181.stdout:starting mds.b at 2024-04-01T22:33:19.319 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T22:33:19.350 INFO:tasks.ceph.mds.f.smithi181.stdout:starting mds.f at 2024-04-01T22:33:19.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.433+0000 7f6084823640 1 Processor -- start 2024-04-01T22:33:19.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.433+0000 7f6084823640 1 -- start start 2024-04-01T22:33:19.434 INFO:tasks.ceph.mds.d.smithi181.stdout:starting mds.d at 2024-04-01T22:33:19.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.435+0000 7f6084823640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f608015aec0 0x7f608006c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:19.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.435+0000 7f6084823640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6080154b70 con 0x7f608015bb20 2024-04-01T22:33:19.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.435+0000 7f6084823640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60800cdac0 con 0x7f608006c250 2024-04-01T22:33:19.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.435+0000 7f6084823640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f60800ce990 con 0x7f608015aec0 2024-04-01T22:33:19.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.435+0000 7f607ed9d640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f608015bb20 0x7f608015bf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:46134/0 (socket says 172.21.15.47:46134) 2024-04-01T22:33:19.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.435+0000 7f607ed9d640 1 -- 172.21.15.47:0/3662166221 learned_addr learned my addr 172.21.15.47:0/3662166221 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T22:33:19.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.435+0000 7f607dd9b640 1 --2- 172.21.15.47:0/3662166221 >> v2:172.21.15.181:3300/0 conn(0x7f608015aec0 0x7f608006c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:19.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.439+0000 7f607d59a640 1 -- 172.21.15.47:0/3662166221 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3783938377 0 0) 0x7f6080154b70 con 0x7f608015bb20 2024-04-01T22:33:19.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.439+0000 7f607d59a640 1 -- 172.21.15.47:0/3662166221 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6068003520 con 0x7f608015bb20 2024-04-01T22:33:19.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.439+0000 7f607dd9b640 1 -- 172.21.15.47:0/3662166221 >> v1:172.21.15.181:6789/0 conn(0x7f608006c250 legacy=0x7f60800ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:19.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.439+0000 7f607dd9b640 1 -- 172.21.15.47:0/3662166221 >> v1:172.21.15.47:6789/0 conn(0x7f608015bb20 legacy=0x7f608015bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:19.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.439+0000 7f607dd9b640 1 -- 172.21.15.47:0/3662166221 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60800cf2a0 con 0x7f608015aec0 2024-04-01T22:33:19.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.445+0000 7f607dd9b640 1 --2- 172.21.15.47:0/3662166221 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f608015aec0 0x7f608006c630 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f60740097a0 tx=0x7f607402b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3ce332d5dcd8738 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:19.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.453+0000 7f607d59a640 1 -- 172.21.15.47:0/3662166221 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607402f810 con 0x7f608015aec0 2024-04-01T22:33:19.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.453+0000 7f607d59a640 1 -- 172.21.15.47:0/3662166221 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f607402f9b0 con 0x7f608015aec0 2024-04-01T22:33:19.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.453+0000 7f607d59a640 1 -- 172.21.15.47:0/3662166221 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607402fd80 con 0x7f608015aec0 2024-04-01T22:33:19.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.453+0000 7f6084823640 1 -- 172.21.15.47:0/3662166221 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f608015aec0 msgr2=0x7f608006c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:19.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.453+0000 7f6084823640 1 --2- 172.21.15.47:0/3662166221 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f608015aec0 0x7f608006c630 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f60740097a0 tx=0x7f607402b9f0 comp rx=0 tx=0).stop 2024-04-01T22:33:19.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.454+0000 7f6084823640 1 -- 172.21.15.47:0/3662166221 shutdown_connections 2024-04-01T22:33:19.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.454+0000 7f6084823640 1 --2- 172.21.15.47:0/3662166221 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f608015aec0 0x7f608006c630 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:19.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.454+0000 7f6084823640 1 -- 172.21.15.47:0/3662166221 >> 172.21.15.47:0/3662166221 conn(0x7f60800cfdb0 msgr2=0x7f60800d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:19.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.454+0000 7f6084823640 1 -- 172.21.15.47:0/3662166221 shutdown_connections 2024-04-01T22:33:19.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.454+0000 7f6084823640 1 -- 172.21.15.47:0/3662166221 wait complete. 2024-04-01T22:33:19.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.455+0000 7f6084823640 1 Processor -- start 2024-04-01T22:33:19.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.455+0000 7f6084823640 1 -- start start 2024-04-01T22:33:19.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.456+0000 7f6084823640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f608006c250 0x7f60801f4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:19.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.456+0000 7f6084823640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f608015aec0 0x7f6080158d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:19.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.456+0000 7f6084823640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f608015bb20 0x7f6080156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:19.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.456+0000 7f6084823640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f60800ce340 con 0x7f608015bb20 2024-04-01T22:33:19.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.456+0000 7f6084823640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f60800ce060 con 0x7f608015aec0 2024-04-01T22:33:19.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.456+0000 7f6084823640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f60800ce620 con 0x7f608006c250 2024-04-01T22:33:19.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.456+0000 7f607e59c640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f608006c250 0x7f60801f4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:19.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.457+0000 7f607e59c640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f608006c250 0x7f60801f4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:38586/0 (socket says 172.21.15.47:38586) 2024-04-01T22:33:19.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.457+0000 7f607e59c640 1 -- 172.21.15.47:0/83351831 learned_addr learned my addr 172.21.15.47:0/83351831 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:19.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.460+0000 7f607ed9d640 1 --2- 172.21.15.47:0/83351831 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f608015bb20 0x7f6080156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:19.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.461+0000 7f607e59c640 1 -- 172.21.15.47:0/83351831 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f608015aec0 msgr2=0x7f6080158d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:19.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.461+0000 7f607e59c640 1 --2- 172.21.15.47:0/83351831 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f608015aec0 0x7f6080158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:19.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.461+0000 7f607e59c640 1 -- 172.21.15.47:0/83351831 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f608015bb20 msgr2=0x7f6080156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:19.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.461+0000 7f607e59c640 1 --2- 172.21.15.47:0/83351831 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f608015bb20 0x7f6080156d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:19.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.461+0000 7f607e59c640 1 -- 172.21.15.47:0/83351831 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60800b21a0 con 0x7f608006c250 2024-04-01T22:33:19.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.465+0000 7f607e59c640 1 --2- 172.21.15.47:0/83351831 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f608006c250 0x7f60801f4090 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f607000c450 tx=0x7f607000c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:19.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.470+0000 7f606effd640 1 -- 172.21.15.47:0/83351831 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60700052d0 con 0x7f608006c250 2024-04-01T22:33:19.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.470+0000 7f606effd640 1 -- 172.21.15.47:0/83351831 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6070005470 con 0x7f608006c250 2024-04-01T22:33:19.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.470+0000 7f606effd640 1 -- 172.21.15.47:0/83351831 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6070012870 con 0x7f608006c250 2024-04-01T22:33:19.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.471+0000 7f6084823640 1 -- 172.21.15.47:0/83351831 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60801f0fe0 con 0x7f608006c250 2024-04-01T22:33:19.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.471+0000 7f6084823640 1 -- 172.21.15.47:0/83351831 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f60801f0220 con 0x7f608006c250 2024-04-01T22:33:19.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.472+0000 7f6084823640 1 -- 172.21.15.47:0/83351831 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6080068210 con 0x7f608006c250 2024-04-01T22:33:19.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.494+0000 7f606effd640 1 -- 172.21.15.47:0/83351831 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f6070012a10 con 0x7f608006c250 2024-04-01T22:33:19.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.495+0000 7f606effd640 1 --2- 172.21.15.47:0/83351831 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f606006b990 0x7f606006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:19.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.495+0000 7f607dd9b640 1 --2- 172.21.15.47:0/83351831 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f606006b990 0x7f606006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:19.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.495+0000 7f607dd9b640 1 --2- 172.21.15.47:0/83351831 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f606006b990 0x7f606006de50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6074036000 tx=0x7f6074039040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:19.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.498+0000 7f606effd640 1 -- 172.21.15.47:0/83351831 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f607005fa30 con 0x7f608006c250 2024-04-01T22:33:19.500 INFO:tasks.ceph.mds.c.smithi047.stdout:starting mds.c at 2024-04-01T22:33:19.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.755+0000 7f606effd640 1 -- 172.21.15.47:0/83351831 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f6070059af0 con 0x7f608006c250 2024-04-01T22:33:19.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:19.979+0000 7f6084823640 1 -- 172.21.15.47:0/83351831 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60800b5b50 con 0x7f608006c250 2024-04-01T22:33:20.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:20.083+0000 7f606effd640 1 -- 172.21.15.47:0/83351831 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7f60700593f0 con 0x7f608006c250 2024-04-01T22:33:20.083 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:33:20.083 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/1610100855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":1610100855},{"type":"v1","addr":"172.21.15.47:6835","nonce":1610100855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-01T22:33:20.084 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 2 2024-04-01T22:33:20.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:20.086+0000 7f6084823640 1 -- 172.21.15.47:0/83351831 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f606006b990 msgr2=0x7f606006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:20.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:20.086+0000 7f6084823640 1 --2- 172.21.15.47:0/83351831 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f606006b990 0x7f606006de50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6074036000 tx=0x7f6074039040 comp rx=0 tx=0).stop 2024-04-01T22:33:20.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:20.086+0000 7f6084823640 1 -- 172.21.15.47:0/83351831 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f608006c250 msgr2=0x7f60801f4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:20.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:20.086+0000 7f6084823640 1 --2- 172.21.15.47:0/83351831 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f608006c250 0x7f60801f4090 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f607000c450 tx=0x7f607000c910 comp rx=0 tx=0).stop 2024-04-01T22:33:20.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:20.086+0000 7f6084823640 1 -- 172.21.15.47:0/83351831 shutdown_connections 2024-04-01T22:33:20.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:20.086+0000 7f6084823640 1 --2- 172.21.15.47:0/83351831 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f606006b990 0x7f606006de50 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:20.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:20.086+0000 7f6084823640 1 --2- 172.21.15.47:0/83351831 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f608015bb20 0x7f6080156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:20.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:20.086+0000 7f6084823640 1 --2- 172.21.15.47:0/83351831 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f608015aec0 0x7f6080158d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:20.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:20.086+0000 7f6084823640 1 --2- 172.21.15.47:0/83351831 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f608006c250 0x7f60801f4090 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:20.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:20.086+0000 7f6084823640 1 -- 172.21.15.47:0/83351831 >> 172.21.15.47:0/83351831 conn(0x7f60800cfdb0 msgr2=0x7f60801540c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:20.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:20.086+0000 7f6084823640 1 -- 172.21.15.47:0/83351831 shutdown_connections 2024-04-01T22:33:20.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:20.087+0000 7f6084823640 1 -- 172.21.15.47:0/83351831 wait complete. 2024-04-01T22:33:22.101 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T22:33:22.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.206+0000 7f876a765640 1 Processor -- start 2024-04-01T22:33:22.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.206+0000 7f876a765640 1 -- start start 2024-04-01T22:33:22.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.207+0000 7f876a765640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f876415a780 0x7f876415ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:22.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.207+0000 7f876a765640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f876415b150 con 0x7f87640c3a60 2024-04-01T22:33:22.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.207+0000 7f876a765640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f876415a280 con 0x7f87641544a0 2024-04-01T22:33:22.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.207+0000 7f876a765640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f87640ca280 con 0x7f876415a780 2024-04-01T22:33:22.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.208+0000 7f87637fe640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f876415a780 0x7f876415ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:22.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.208+0000 7f8763fff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f87641544a0 0x7f87640c87d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.47:38860/0 (socket says 172.21.15.47:38860) 2024-04-01T22:33:22.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.208+0000 7f8763fff640 1 -- 172.21.15.47:0/1714905395 learned_addr learned my addr 172.21.15.47:0/1714905395 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T22:33:22.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.210+0000 7f8762ffd640 1 -- 172.21.15.47:0/1714905395 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2907493348 0 0) 0x7f876415a280 con 0x7f87641544a0 2024-04-01T22:33:22.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.210+0000 7f8762ffd640 1 -- 172.21.15.47:0/1714905395 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8750003520 con 0x7f87641544a0 2024-04-01T22:33:22.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.211+0000 7f87637fe640 1 -- 172.21.15.47:0/1714905395 >> v1:172.21.15.181:6789/0 conn(0x7f87641544a0 legacy=0x7f87640c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:22.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.211+0000 7f87637fe640 1 -- 172.21.15.47:0/1714905395 >> v1:172.21.15.47:6789/0 conn(0x7f87640c3a60 legacy=0x7f87640c3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:22.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.211+0000 7f87637fe640 1 -- 172.21.15.47:0/1714905395 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87640ca560 con 0x7f876415a780 2024-04-01T22:33:22.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.214+0000 7f87637fe640 1 --2- 172.21.15.47:0/1714905395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f876415a780 0x7f876415ac10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f87540097a0 tx=0x7f875402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ae48f413b6257dc server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:22.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.218+0000 7f8762ffd640 1 -- 172.21.15.47:0/1714905395 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8754034070 con 0x7f876415a780 2024-04-01T22:33:22.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.218+0000 7f8762ffd640 1 -- 172.21.15.47:0/1714905395 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8754030610 con 0x7f876415a780 2024-04-01T22:33:22.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.218+0000 7f8762ffd640 1 -- 172.21.15.47:0/1714905395 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87540309e0 con 0x7f876415a780 2024-04-01T22:33:22.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.218+0000 7f876a765640 1 -- 172.21.15.47:0/1714905395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f876415a780 msgr2=0x7f876415ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:22.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.218+0000 7f876a765640 1 --2- 172.21.15.47:0/1714905395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f876415a780 0x7f876415ac10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f87540097a0 tx=0x7f875402b960 comp rx=0 tx=0).stop 2024-04-01T22:33:22.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.219+0000 7f876a765640 1 -- 172.21.15.47:0/1714905395 shutdown_connections 2024-04-01T22:33:22.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.219+0000 7f876a765640 1 --2- 172.21.15.47:0/1714905395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f876415a780 0x7f876415ac10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:22.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.219+0000 7f876a765640 1 -- 172.21.15.47:0/1714905395 >> 172.21.15.47:0/1714905395 conn(0x7f87640715a0 msgr2=0x7f87640719b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:22.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.219+0000 7f876a765640 1 -- 172.21.15.47:0/1714905395 shutdown_connections 2024-04-01T22:33:22.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.219+0000 7f876a765640 1 -- 172.21.15.47:0/1714905395 wait complete. 2024-04-01T22:33:22.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.220+0000 7f876a765640 1 Processor -- start 2024-04-01T22:33:22.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.220+0000 7f876a765640 1 -- start start 2024-04-01T22:33:22.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.221+0000 7f876a765640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f87640c3a60 0x7f8764156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:22.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.221+0000 7f876a765640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87641544a0 0x7f8764157330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:22.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.221+0000 7f876a765640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f876415a780 0x7f8764146490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:22.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.221+0000 7f876a765640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f87640cae00 con 0x7f876415a780 2024-04-01T22:33:22.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.221+0000 7f876a765640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f87640cab20 con 0x7f87641544a0 2024-04-01T22:33:22.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.221+0000 7f876a765640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f87640c4ac0 con 0x7f87640c3a60 2024-04-01T22:33:22.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.221+0000 7f8768d02640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f876415a780 0x7f8764146490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:22.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.221+0000 7f87637fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87641544a0 0x7f8764157330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:22.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.221+0000 7f8763fff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f87640c3a60 0x7f8764156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:22.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.222+0000 7f8768d02640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f876415a780 0x7f8764146490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49132/0 (socket says 172.21.15.47:49132) 2024-04-01T22:33:22.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.222+0000 7f8768d02640 1 -- 172.21.15.47:0/2124599622 learned_addr learned my addr 172.21.15.47:0/2124599622 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:22.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.225+0000 7f8768d02640 1 -- 172.21.15.47:0/2124599622 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f87640c3a60 msgr2=0x7f8764156df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:22.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.225+0000 7f8768d02640 1 --2- 172.21.15.47:0/2124599622 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f87640c3a60 0x7f8764156df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:22.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.225+0000 7f8768d02640 1 -- 172.21.15.47:0/2124599622 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87641544a0 msgr2=0x7f8764157330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:22.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.225+0000 7f8768d02640 1 --2- 172.21.15.47:0/2124599622 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87641544a0 0x7f8764157330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:22.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.225+0000 7f8768d02640 1 -- 172.21.15.47:0/2124599622 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8764151fd0 con 0x7f876415a780 2024-04-01T22:33:22.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.227+0000 7f8768d02640 1 --2- 172.21.15.47:0/2124599622 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f876415a780 0x7f8764146490 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f875c00c740 tx=0x7f875c00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:22.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.231+0000 7f8760ff9640 1 -- 172.21.15.47:0/2124599622 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f875c016020 con 0x7f876415a780 2024-04-01T22:33:22.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.231+0000 7f8760ff9640 1 -- 172.21.15.47:0/2124599622 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f875c00ce50 con 0x7f876415a780 2024-04-01T22:33:22.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.231+0000 7f8760ff9640 1 -- 172.21.15.47:0/2124599622 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f875c003970 con 0x7f876415a780 2024-04-01T22:33:22.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.231+0000 7f876a765640 1 -- 172.21.15.47:0/2124599622 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8764149eb0 con 0x7f876415a780 2024-04-01T22:33:22.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.231+0000 7f876a765640 1 -- 172.21.15.47:0/2124599622 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8764148470 con 0x7f876415a780 2024-04-01T22:33:22.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.232+0000 7f876a765640 1 -- 172.21.15.47:0/2124599622 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8764068210 con 0x7f876415a780 2024-04-01T22:33:22.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.503+0000 7f8760ff9640 1 -- 172.21.15.47:0/2124599622 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f875c003b10 con 0x7f876415a780 2024-04-01T22:33:22.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.504+0000 7f8760ff9640 1 --2- 172.21.15.47:0/2124599622 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f874406b9e0 0x7f874406dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:22.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.504+0000 7f8763fff640 1 --2- 172.21.15.47:0/2124599622 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f874406b9e0 0x7f874406dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:22.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.504+0000 7f8763fff640 1 --2- 172.21.15.47:0/2124599622 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f874406b9e0 0x7f874406dea0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f874c0011e0 tx=0x7f874c007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:22.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.518+0000 7f8760ff9640 1 -- 172.21.15.47:0/2124599622 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f875c05fd10 con 0x7f876415a780 2024-04-01T22:33:22.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.518+0000 7f8760ff9640 1 -- 172.21.15.47:0/2124599622 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f875c020020 con 0x7f876415a780 2024-04-01T22:33:22.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.737+0000 7f876a765640 1 -- 172.21.15.47:0/2124599622 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f87640c93a0 con 0x7f876415a780 2024-04-01T22:33:22.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.763+0000 7f8760ff9640 1 -- 172.21.15.47:0/2124599622 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5521 (secure 0 0 0) 0x7f875c059780 con 0x7f876415a780 2024-04-01T22:33:22.763 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:33:22.763 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4222,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/1297694239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1297694239},{"type":"v1","addr":"172.21.15.181:6835","nonce":1297694239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4225,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/2435310452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":2435310452},{"type":"v1","addr":"172.21.15.181:6837","nonce":2435310452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4228,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1974242436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1974242436},{"type":"v1","addr":"172.21.15.47:6839","nonce":1974242436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/4251771217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":4251771217},{"type":"v1","addr":"172.21.15.47:6837","nonce":4251771217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/1534194215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1534194215},{"type":"v1","addr":"172.21.15.181:6833","nonce":1534194215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/1610100855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":1610100855},{"type":"v1","addr":"172.21.15.47:6835","nonce":1610100855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-01T22:33:22.763 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 3 2024-04-01T22:33:22.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.765+0000 7f876a765640 1 -- 172.21.15.47:0/2124599622 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f874406b9e0 msgr2=0x7f874406dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:22.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.765+0000 7f876a765640 1 --2- 172.21.15.47:0/2124599622 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f874406b9e0 0x7f874406dea0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f874c0011e0 tx=0x7f874c007d30 comp rx=0 tx=0).stop 2024-04-01T22:33:22.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.765+0000 7f876a765640 1 -- 172.21.15.47:0/2124599622 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f876415a780 msgr2=0x7f8764146490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:22.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.765+0000 7f876a765640 1 --2- 172.21.15.47:0/2124599622 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f876415a780 0x7f8764146490 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f875c00c740 tx=0x7f875c00cc00 comp rx=0 tx=0).stop 2024-04-01T22:33:22.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.765+0000 7f876a765640 1 -- 172.21.15.47:0/2124599622 shutdown_connections 2024-04-01T22:33:22.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.765+0000 7f876a765640 1 --2- 172.21.15.47:0/2124599622 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f874406b9e0 0x7f874406dea0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:22.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.765+0000 7f876a765640 1 --2- 172.21.15.47:0/2124599622 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f876415a780 0x7f8764146490 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:22.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.765+0000 7f876a765640 1 --2- 172.21.15.47:0/2124599622 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87641544a0 0x7f8764157330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:22.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.765+0000 7f876a765640 1 --2- 172.21.15.47:0/2124599622 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f87640c3a60 0x7f8764156df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:22.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.765+0000 7f876a765640 1 -- 172.21.15.47:0/2124599622 >> 172.21.15.47:0/2124599622 conn(0x7f87640715a0 msgr2=0x7f87640c8690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:22.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.765+0000 7f876a765640 1 -- 172.21.15.47:0/2124599622 shutdown_connections 2024-04-01T22:33:22.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.765+0000 7f876a765640 1 -- 172.21.15.47:0/2124599622 wait complete. 2024-04-01T22:33:22.775 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T22:33:22.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.877+0000 7f29c8464640 1 Processor -- start 2024-04-01T22:33:22.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.877+0000 7f29c8464640 1 -- start start 2024-04-01T22:33:22.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.878+0000 7f29c8464640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f29c0154760 0x7f29c015e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:22.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.878+0000 7f29c8464640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29c00cdb00 con 0x7f29c00cf170 2024-04-01T22:33:22.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.878+0000 7f29c8464640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29c00cdde0 con 0x7f29c00ced90 2024-04-01T22:33:22.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.878+0000 7f29c8464640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f29c00cd8b0 con 0x7f29c0154760 2024-04-01T22:33:22.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.879+0000 7f29c6a01640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f29c0154760 0x7f29c015e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:22.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.879+0000 7f29c6200640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f29c00ced90 0x7f29c006c230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.47:38872/0 (socket says 172.21.15.47:38872) 2024-04-01T22:33:22.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.879+0000 7f29c6200640 1 -- 172.21.15.47:0/4078096502 learned_addr learned my addr 172.21.15.47:0/4078096502 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T22:33:22.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.881+0000 7f29c51fe640 1 -- 172.21.15.47:0/4078096502 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2737975698 0 0) 0x7f29c00cdde0 con 0x7f29c00ced90 2024-04-01T22:33:22.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.881+0000 7f29c51fe640 1 -- 172.21.15.47:0/4078096502 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29ac003520 con 0x7f29c00ced90 2024-04-01T22:33:22.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.882+0000 7f29c6a01640 1 -- 172.21.15.47:0/4078096502 >> v1:172.21.15.181:6789/0 conn(0x7f29c00ced90 legacy=0x7f29c006c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:22.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.882+0000 7f29c6a01640 1 -- 172.21.15.47:0/4078096502 >> v1:172.21.15.47:6789/0 conn(0x7f29c00cf170 legacy=0x7f29c0154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:22.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.882+0000 7f29c6a01640 1 -- 172.21.15.47:0/4078096502 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29c00ce0c0 con 0x7f29c0154760 2024-04-01T22:33:22.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.885+0000 7f29c6a01640 1 --2- 172.21.15.47:0/4078096502 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29c0154760 0x7f29c015e290 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f29c00cda30 tx=0x7f29b802b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7d0e033851ef9b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:22.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.889+0000 7f29c51fe640 1 -- 172.21.15.47:0/4078096502 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b8035020 con 0x7f29c0154760 2024-04-01T22:33:22.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.889+0000 7f29c51fe640 1 -- 172.21.15.47:0/4078096502 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29b8031890 con 0x7f29c0154760 2024-04-01T22:33:22.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.889+0000 7f29c51fe640 1 -- 172.21.15.47:0/4078096502 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b8031c60 con 0x7f29c0154760 2024-04-01T22:33:22.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.890+0000 7f29c8464640 1 -- 172.21.15.47:0/4078096502 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29c0154760 msgr2=0x7f29c015e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:22.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.890+0000 7f29c8464640 1 --2- 172.21.15.47:0/4078096502 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29c0154760 0x7f29c015e290 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f29c00cda30 tx=0x7f29b802b930 comp rx=0 tx=0).stop 2024-04-01T22:33:22.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.890+0000 7f29c8464640 1 -- 172.21.15.47:0/4078096502 shutdown_connections 2024-04-01T22:33:22.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.890+0000 7f29c8464640 1 --2- 172.21.15.47:0/4078096502 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29c0154760 0x7f29c015e290 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:22.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.890+0000 7f29c8464640 1 -- 172.21.15.47:0/4078096502 >> 172.21.15.47:0/4078096502 conn(0x7f29c00b1840 msgr2=0x7f29c00b1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:22.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.890+0000 7f29c8464640 1 -- 172.21.15.47:0/4078096502 shutdown_connections 2024-04-01T22:33:22.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.890+0000 7f29c8464640 1 -- 172.21.15.47:0/4078096502 wait complete. 2024-04-01T22:33:22.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.891+0000 7f29c8464640 1 Processor -- start 2024-04-01T22:33:22.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.891+0000 7f29c8464640 1 -- start start 2024-04-01T22:33:22.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.892+0000 7f29c8464640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f29c00ced90 0x7f29c01590b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:22.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.892+0000 7f29c8464640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29c00cf170 0x7f29c01e7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:22.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.892+0000 7f29c8464640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29c0154760 0x7f29c00c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:22.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.892+0000 7f29c8464640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f29c006c940 con 0x7f29c00cf170 2024-04-01T22:33:22.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.892+0000 7f29c8464640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f29c00ce710 con 0x7f29c0154760 2024-04-01T22:33:22.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.892+0000 7f29c8464640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f29c006cac0 con 0x7f29c00ced90 2024-04-01T22:33:22.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.892+0000 7f29c59ff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29c00cf170 0x7f29c01e7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:22.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.892+0000 7f29c6a01640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29c0154760 0x7f29c00c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:22.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.893+0000 7f29c6200640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f29c00ced90 0x7f29c01590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:22.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.893+0000 7f29c59ff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29c00cf170 0x7f29c01e7010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49156/0 (socket says 172.21.15.47:49156) 2024-04-01T22:33:22.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.893+0000 7f29c59ff640 1 -- 172.21.15.47:0/881179593 learned_addr learned my addr 172.21.15.47:0/881179593 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:22.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.896+0000 7f29c59ff640 1 -- 172.21.15.47:0/881179593 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f29c00ced90 msgr2=0x7f29c01590b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:22.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.896+0000 7f29c59ff640 1 --2- 172.21.15.47:0/881179593 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f29c00ced90 0x7f29c01590b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:22.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.896+0000 7f29c59ff640 1 -- 172.21.15.47:0/881179593 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29c0154760 msgr2=0x7f29c00c96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:22.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.896+0000 7f29c59ff640 1 --2- 172.21.15.47:0/881179593 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29c0154760 0x7f29c00c96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:22.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.896+0000 7f29c59ff640 1 -- 172.21.15.47:0/881179593 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29c01595f0 con 0x7f29c00cf170 2024-04-01T22:33:22.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.898+0000 7f29c59ff640 1 --2- 172.21.15.47:0/881179593 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29c00cf170 0x7f29c01e7010 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f29b000c440 tx=0x7f29b0001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:22.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.902+0000 7f29b6ffd640 1 -- 172.21.15.47:0/881179593 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b00052d0 con 0x7f29c00cf170 2024-04-01T22:33:22.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.902+0000 7f29b6ffd640 1 -- 172.21.15.47:0/881179593 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29b0005470 con 0x7f29c00cf170 2024-04-01T22:33:22.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.902+0000 7f29b6ffd640 1 -- 172.21.15.47:0/881179593 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b0007240 con 0x7f29c00cf170 2024-04-01T22:33:22.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.902+0000 7f29c8464640 1 -- 172.21.15.47:0/881179593 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29c0156e40 con 0x7f29c00cf170 2024-04-01T22:33:22.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.902+0000 7f29c8464640 1 -- 172.21.15.47:0/881179593 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29c01eff20 con 0x7f29c00cf170 2024-04-01T22:33:22.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:22.903+0000 7f29c8464640 1 -- 172.21.15.47:0/881179593 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29c0068210 con 0x7f29c00cf170 2024-04-01T22:33:23.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.171+0000 7f29b6ffd640 1 -- 172.21.15.47:0/881179593 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f29b00073e0 con 0x7f29c00cf170 2024-04-01T22:33:23.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.171+0000 7f29b6ffd640 1 --2- 172.21.15.47:0/881179593 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f29a406b9e0 0x7f29a406dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:23.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.171+0000 7f29c6200640 1 --2- 172.21.15.47:0/881179593 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f29a406b9e0 0x7f29a406dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:23.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.172+0000 7f29c6200640 1 --2- 172.21.15.47:0/881179593 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f29a406b9e0 0x7f29a406dea0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f29bc005c00 tx=0x7f29bc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:23.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.188+0000 7f29b6ffd640 1 -- 172.21.15.47:0/881179593 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f29b00567e0 con 0x7f29c00cf170 2024-04-01T22:33:23.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.188+0000 7f29b6ffd640 1 -- 172.21.15.47:0/881179593 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f29b0058740 con 0x7f29c00cf170 2024-04-01T22:33:23.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.380+0000 7f29c8464640 1 -- 172.21.15.47:0/881179593 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f29c00cf5f0 con 0x7f29c00cf170 2024-04-01T22:33:23.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.466+0000 7f29b6ffd640 1 -- 172.21.15.47:0/881179593 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12896 (secure 0 0 0) 0x7f29b005c7e0 con 0x7f29c00cf170 2024-04-01T22:33:23.466 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:33:23.466 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":17,"fsid":"a6998a48-38bc-4e42-b0d9-04f2fb5c3c87","created":"2024-04-01T22:32:57.112033+0000","modified":"2024-04-01T22:33:16.630188+0000","last_up_change":"2024-04-01T22:33:11.141073+0000","last_in_change":"2024-04-01T22:33:02.650459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T22:33:13.356568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7bd3f25d-e3a5-4932-b381-53dcbb464dde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6811","nonce":3827395709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6813","nonce":3827395709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6817","nonce":3827395709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6815","nonce":3827395709}]},"public_addr":"172.21.15.47:6811/3827395709","cluster_addr":"172.21.15.47:6813/3827395709","heartbeat_back_addr":"172.21.15.47:6817/3827395709","heartbeat_front_addr":"172.21.15.47:6815/3827395709","state":["exists","up"]},{"osd":1,"uuid":"2aa60ba2-67ff-43c7-96c4-82ae2f3855ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6827","nonce":3152157503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6829","nonce":3152157503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6833","nonce":3152157503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6831","nonce":3152157503}]},"public_addr":"172.21.15.47:6827/3152157503","cluster_addr":"172.21.15.47:6829/3152157503","heartbeat_back_addr":"172.21.15.47:6833/3152157503","heartbeat_front_addr":"172.21.15.47:6831/3152157503","state":["exists","up"]},{"osd":2,"uuid":"d83f8a98-6db8-42b7-9ef6-5b16eb9a3492","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6803","nonce":1003968856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6805","nonce":1003968856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6809","nonce":1003968856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6807","nonce":1003968856}]},"public_addr":"172.21.15.47:6803/1003968856","cluster_addr":"172.21.15.47:6805/1003968856","heartbeat_back_addr":"172.21.15.47:6809/1003968856","heartbeat_front_addr":"172.21.15.47:6807/1003968856","state":["exists","up"]},{"osd":3,"uuid":"edc02ed5-d25c-4dc9-a0c3-7a26f20fae07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6819","nonce":2845699561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6821","nonce":2845699561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6825","nonce":2845699561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6823","nonce":2845699561}]},"public_addr":"172.21.15.47:6819/2845699561","cluster_addr":"172.21.15.47:6821/2845699561","heartbeat_back_addr":"172.21.15.47:6825/2845699561","heartbeat_front_addr":"172.21.15.47:6823/2845699561","state":["exists","up"]},{"osd":4,"uuid":"b3d67e74-f51e-4474-9c62-dd0daa60c728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6809","nonce":2961538461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6811","nonce":2961538461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6815","nonce":2961538461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6813","nonce":2961538461}]},"public_addr":"172.21.15.181:6809/2961538461","cluster_addr":"172.21.15.181:6811/2961538461","heartbeat_back_addr":"172.21.15.181:6815/2961538461","heartbeat_front_addr":"172.21.15.181:6813/2961538461","state":["exists","up"]},{"osd":5,"uuid":"d86e8f7a-99f4-4457-9949-cf2cb853e79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6817","nonce":2161566540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6819","nonce":2161566540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6823","nonce":2161566540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6821","nonce":2161566540}]},"public_addr":"172.21.15.181:6817/2161566540","cluster_addr":"172.21.15.181:6819/2161566540","heartbeat_back_addr":"172.21.15.181:6823/2161566540","heartbeat_front_addr":"172.21.15.181:6821/2161566540","state":["exists","up"]},{"osd":6,"uuid":"aa08266c-1719-4abd-afb9-e7e8ac593658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6801","nonce":3792144865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6803","nonce":3792144865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6807","nonce":3792144865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6805","nonce":3792144865}]},"public_addr":"172.21.15.181:6801/3792144865","cluster_addr":"172.21.15.181:6803/3792144865","heartbeat_back_addr":"172.21.15.181:6807/3792144865","heartbeat_front_addr":"172.21.15.181:6805/3792144865","state":["exists","up"]},{"osd":7,"uuid":"6e509762-24c8-46c3-93a1-4c50b11ebcf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6825","nonce":1760995885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6827","nonce":1760995885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6831","nonce":1760995885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6829","nonce":1760995885}]},"public_addr":"172.21.15.181:6825/1760995885","cluster_addr":"172.21.15.181:6827/1760995885","heartbeat_back_addr":"172.21.15.181:6831/1760995885","heartbeat_front_addr":"172.21.15.181:6829/1760995885","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.202426+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.255318+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.170288+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.290065+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.214871+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.176432+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.139940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.299546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T22:33:23.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.468+0000 7f29c8464640 1 -- 172.21.15.47:0/881179593 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f29a406b9e0 msgr2=0x7f29a406dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:23.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.468+0000 7f29c8464640 1 --2- 172.21.15.47:0/881179593 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f29a406b9e0 0x7f29a406dea0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f29bc005c00 tx=0x7f29bc009040 comp rx=0 tx=0).stop 2024-04-01T22:33:23.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.468+0000 7f29c8464640 1 -- 172.21.15.47:0/881179593 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29c00cf170 msgr2=0x7f29c01e7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:23.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.468+0000 7f29c8464640 1 --2- 172.21.15.47:0/881179593 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29c00cf170 0x7f29c01e7010 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f29b000c440 tx=0x7f29b0001e70 comp rx=0 tx=0).stop 2024-04-01T22:33:23.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.468+0000 7f29c8464640 1 -- 172.21.15.47:0/881179593 shutdown_connections 2024-04-01T22:33:23.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.468+0000 7f29c8464640 1 --2- 172.21.15.47:0/881179593 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f29a406b9e0 0x7f29a406dea0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:23.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.468+0000 7f29c8464640 1 --2- 172.21.15.47:0/881179593 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29c0154760 0x7f29c00c96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:23.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.468+0000 7f29c8464640 1 --2- 172.21.15.47:0/881179593 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29c00cf170 0x7f29c01e7010 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:23.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.468+0000 7f29c8464640 1 --2- 172.21.15.47:0/881179593 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f29c00ced90 0x7f29c01590b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:23.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.468+0000 7f29c8464640 1 -- 172.21.15.47:0/881179593 >> 172.21.15.47:0/881179593 conn(0x7f29c00b1840 msgr2=0x7f29c00b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:23.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.468+0000 7f29c8464640 1 -- 172.21.15.47:0/881179593 shutdown_connections 2024-04-01T22:33:23.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.468+0000 7f29c8464640 1 -- 172.21.15.47:0/881179593 wait complete. 2024-04-01T22:33:23.479 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-01T22:33:13.356568+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-01T22:33:23.479 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-01T22:33:23.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.584+0000 7fa44c640640 1 Processor -- start 2024-04-01T22:33:23.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.585+0000 7fa44c640640 1 -- start start 2024-04-01T22:33:23.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.585+0000 7fa44c640640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa44406c230 0x7fa44406c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:23.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.585+0000 7fa44c640640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4440cf580 con 0x7fa44415aec0 2024-04-01T22:33:23.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.585+0000 7fa44c640640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4440cda50 con 0x7fa4440ca790 2024-04-01T22:33:23.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.585+0000 7fa44c640640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fa4440cdd30 con 0x7fa44406c230 2024-04-01T22:33:23.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.586+0000 7fa44a3dc640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa44406c230 0x7fa44406c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:23.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.586+0000 7fa44abdd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fa4440ca790 0x7fa4440cabc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.47:38876/0 (socket says 172.21.15.47:38876) 2024-04-01T22:33:23.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.586+0000 7fa44abdd640 1 -- 172.21.15.47:0/3951228843 learned_addr learned my addr 172.21.15.47:0/3951228843 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T22:33:23.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.588+0000 7fa4493da640 1 -- 172.21.15.47:0/3951228843 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1967972170 0 0) 0x7fa4440cda50 con 0x7fa4440ca790 2024-04-01T22:33:23.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.589+0000 7fa4493da640 1 -- 172.21.15.47:0/3951228843 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa42c003520 con 0x7fa4440ca790 2024-04-01T22:33:23.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.591+0000 7fa44a3dc640 1 -- 172.21.15.47:0/3951228843 >> v1:172.21.15.181:6789/0 conn(0x7fa4440ca790 legacy=0x7fa4440cabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:23.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.591+0000 7fa44a3dc640 1 -- 172.21.15.47:0/3951228843 >> v1:172.21.15.47:6789/0 conn(0x7fa44415aec0 legacy=0x7fa4440cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:23.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.591+0000 7fa44a3dc640 1 -- 172.21.15.47:0/3951228843 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4440ce010 con 0x7fa44406c230 2024-04-01T22:33:23.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.594+0000 7fa44a3dc640 1 --2- 172.21.15.47:0/3951228843 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa44406c230 0x7fa44406c610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa43c0097a0 tx=0x7fa43c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a12b62bbca3652 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:23.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.598+0000 7fa4493da640 1 -- 172.21.15.47:0/3951228843 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43c035020 con 0x7fa44406c230 2024-04-01T22:33:23.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.598+0000 7fa4493da640 1 -- 172.21.15.47:0/3951228843 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa43c031830 con 0x7fa44406c230 2024-04-01T22:33:23.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.598+0000 7fa4493da640 1 -- 172.21.15.47:0/3951228843 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43c031c00 con 0x7fa44406c230 2024-04-01T22:33:23.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.599+0000 7fa44c640640 1 -- 172.21.15.47:0/3951228843 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa44406c230 msgr2=0x7fa44406c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:23.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.599+0000 7fa44c640640 1 --2- 172.21.15.47:0/3951228843 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa44406c230 0x7fa44406c610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa43c0097a0 tx=0x7fa43c02b8d0 comp rx=0 tx=0).stop 2024-04-01T22:33:23.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.599+0000 7fa44c640640 1 -- 172.21.15.47:0/3951228843 shutdown_connections 2024-04-01T22:33:23.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.599+0000 7fa44c640640 1 --2- 172.21.15.47:0/3951228843 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa44406c230 0x7fa44406c610 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:23.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.599+0000 7fa44c640640 1 -- 172.21.15.47:0/3951228843 >> 172.21.15.47:0/3951228843 conn(0x7fa4440cfdb0 msgr2=0x7fa4440d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:23.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.599+0000 7fa44c640640 1 -- 172.21.15.47:0/3951228843 shutdown_connections 2024-04-01T22:33:23.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.599+0000 7fa44c640640 1 -- 172.21.15.47:0/3951228843 wait complete. 2024-04-01T22:33:23.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.600+0000 7fa44c640640 1 Processor -- start 2024-04-01T22:33:23.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.600+0000 7fa44c640640 1 -- start start 2024-04-01T22:33:23.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.601+0000 7fa44c640640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa44406c230 0x7fa4441580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:23.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.601+0000 7fa44c640640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4440ca790 0x7fa444151b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:23.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.601+0000 7fa44c640640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa44415aec0 0x7fa4441f4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:23.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.601+0000 7fa44c640640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa44415b330 con 0x7fa4440ca790 2024-04-01T22:33:23.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.601+0000 7fa44c640640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa4440ce5d0 con 0x7fa44406c230 2024-04-01T22:33:23.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.601+0000 7fa44c640640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fa4440c9740 con 0x7fa44415aec0 2024-04-01T22:33:23.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.601+0000 7fa449bdb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4440ca790 0x7fa444151b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:23.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.602+0000 7fa449bdb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4440ca790 0x7fa444151b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49164/0 (socket says 172.21.15.47:49164) 2024-04-01T22:33:23.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.602+0000 7fa449bdb640 1 -- 172.21.15.47:0/1389944902 learned_addr learned my addr 172.21.15.47:0/1389944902 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:23.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.602+0000 7fa44abdd640 1 --2- 172.21.15.47:0/1389944902 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa44415aec0 0x7fa4441f4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:23.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.602+0000 7fa44a3dc640 1 --2- 172.21.15.47:0/1389944902 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa44406c230 0x7fa4441580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:23.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.605+0000 7fa449bdb640 1 -- 172.21.15.47:0/1389944902 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa44415aec0 msgr2=0x7fa4441f4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:23.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.605+0000 7fa449bdb640 1 --2- 172.21.15.47:0/1389944902 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa44415aec0 0x7fa4441f4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:23.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.605+0000 7fa449bdb640 1 -- 172.21.15.47:0/1389944902 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa44406c230 msgr2=0x7fa4441580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:23.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.605+0000 7fa449bdb640 1 --2- 172.21.15.47:0/1389944902 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa44406c230 0x7fa4441580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:23.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.605+0000 7fa449bdb640 1 -- 172.21.15.47:0/1389944902 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4441585e0 con 0x7fa4440ca790 2024-04-01T22:33:23.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.607+0000 7fa449bdb640 1 --2- 172.21.15.47:0/1389944902 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4440ca790 0x7fa444151b70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa43800c400 tx=0x7fa43800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:23.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.611+0000 7fa442ffd640 1 -- 172.21.15.47:0/1389944902 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4380052d0 con 0x7fa4440ca790 2024-04-01T22:33:23.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.611+0000 7fa442ffd640 1 -- 172.21.15.47:0/1389944902 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa438005490 con 0x7fa4440ca790 2024-04-01T22:33:23.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.611+0000 7fa442ffd640 1 -- 172.21.15.47:0/1389944902 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa438007260 con 0x7fa4440ca790 2024-04-01T22:33:23.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.611+0000 7fa44c640640 1 -- 172.21.15.47:0/1389944902 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4441e49c0 con 0x7fa4440ca790 2024-04-01T22:33:23.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.611+0000 7fa44c640640 1 -- 172.21.15.47:0/1389944902 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa444155130 con 0x7fa4440ca790 2024-04-01T22:33:23.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.612+0000 7fa44c640640 1 -- 172.21.15.47:0/1389944902 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa444155740 con 0x7fa4440ca790 2024-04-01T22:33:23.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.878+0000 7fa442ffd640 1 -- 172.21.15.47:0/1389944902 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7fa438007400 con 0x7fa4440ca790 2024-04-01T22:33:23.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.878+0000 7fa442ffd640 1 --2- 172.21.15.47:0/1389944902 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fa43006b9e0 0x7fa43006dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:23.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.878+0000 7fa44a3dc640 1 --2- 172.21.15.47:0/1389944902 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fa43006b9e0 0x7fa43006dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:23.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.878+0000 7fa44a3dc640 1 --2- 172.21.15.47:0/1389944902 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fa43006b9e0 0x7fa43006dea0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa43c036000 tx=0x7fa43c03c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:23.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.891+0000 7fa442ffd640 1 -- 172.21.15.47:0/1389944902 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fa438056810 con 0x7fa4440ca790 2024-04-01T22:33:23.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:23.891+0000 7fa442ffd640 1 -- 172.21.15.47:0/1389944902 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fa4440cf580 con 0x7fa4440ca790 2024-04-01T22:33:24.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.073+0000 7fa44c640640 1 -- 172.21.15.47:0/1389944902 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa444154b70 con 0x7fa4440ca790 2024-04-01T22:33:24.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.095+0000 7fa442ffd640 1 -- 172.21.15.47:0/1389944902 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7fa444154b70 con 0x7fa4440ca790 2024-04-01T22:33:24.095 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-01T22:33:24.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.097+0000 7fa44c640640 1 -- 172.21.15.47:0/1389944902 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fa43006b9e0 msgr2=0x7fa43006dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:24.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.097+0000 7fa44c640640 1 --2- 172.21.15.47:0/1389944902 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fa43006b9e0 0x7fa43006dea0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa43c036000 tx=0x7fa43c03c040 comp rx=0 tx=0).stop 2024-04-01T22:33:24.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.097+0000 7fa44c640640 1 -- 172.21.15.47:0/1389944902 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4440ca790 msgr2=0x7fa444151b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:24.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.097+0000 7fa44c640640 1 --2- 172.21.15.47:0/1389944902 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4440ca790 0x7fa444151b70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa43800c400 tx=0x7fa43800c8c0 comp rx=0 tx=0).stop 2024-04-01T22:33:24.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.097+0000 7fa44c640640 1 -- 172.21.15.47:0/1389944902 shutdown_connections 2024-04-01T22:33:24.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.097+0000 7fa44c640640 1 --2- 172.21.15.47:0/1389944902 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fa43006b9e0 0x7fa43006dea0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:24.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.097+0000 7fa44c640640 1 --2- 172.21.15.47:0/1389944902 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa44415aec0 0x7fa4441f4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:24.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.097+0000 7fa44c640640 1 --2- 172.21.15.47:0/1389944902 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4440ca790 0x7fa444151b70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:24.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.097+0000 7fa44c640640 1 --2- 172.21.15.47:0/1389944902 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa44406c230 0x7fa4441580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:24.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.097+0000 7fa44c640640 1 -- 172.21.15.47:0/1389944902 >> 172.21.15.47:0/1389944902 conn(0x7fa4440cfdb0 msgr2=0x7fa4440c7640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:24.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.097+0000 7fa44c640640 1 -- 172.21.15.47:0/1389944902 shutdown_connections 2024-04-01T22:33:24.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.097+0000 7fa44c640640 1 -- 172.21.15.47:0/1389944902 wait complete. 2024-04-01T22:33:24.107 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-01T22:33:24.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.211+0000 7feee929a640 1 Processor -- start 2024-04-01T22:33:24.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.211+0000 7feee929a640 1 -- start start 2024-04-01T22:33:24.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.212+0000 7feee929a640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7feee415e520 0x7feee4143530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:24.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.212+0000 7feee929a640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7feee40cd9f0 0x7feee4071160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:24.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.212+0000 7feee929a640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feee415da80 con 0x7feee41545f0 2024-04-01T22:33:24.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.212+0000 7feee929a640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7feee40ce910 con 0x7feee40cd9f0 2024-04-01T22:33:24.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.212+0000 7feee929a640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7feee40ce350 con 0x7feee415e520 2024-04-01T22:33:24.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.213+0000 7feee37fe640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7feee40cd9f0 0x7feee4071160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:24.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.213+0000 7feee27fc640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7feee415e520 0x7feee4143530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:24.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.213+0000 7feee37fe640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7feee40cd9f0 0x7feee4071160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49174/0 (socket says 172.21.15.47:49174) 2024-04-01T22:33:24.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.213+0000 7feee37fe640 1 -- 172.21.15.47:0/3109207000 learned_addr learned my addr 172.21.15.47:0/3109207000 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:24.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.215+0000 7feee27fc640 1 -- 172.21.15.47:0/3109207000 >> v2:172.21.15.47:3300/0 conn(0x7feee40cd9f0 msgr2=0x7feee4071160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:24.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.215+0000 7feee27fc640 1 --2- 172.21.15.47:0/3109207000 >> v2:172.21.15.47:3300/0 conn(0x7feee40cd9f0 0x7feee4071160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:24.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.215+0000 7feee27fc640 1 -- 172.21.15.47:0/3109207000 >> v1:172.21.15.47:6789/0 conn(0x7feee41545f0 legacy=0x7feee415a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:24.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.215+0000 7feee27fc640 1 -- 172.21.15.47:0/3109207000 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee40ce630 con 0x7feee415e520 2024-04-01T22:33:24.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.217+0000 7feee27fc640 1 --2- 172.21.15.47:0/3109207000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feee415e520 0x7feee4143530 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7feee40ceb40 tx=0x7feecc02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b15c5340034c939e server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:24.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.221+0000 7feee1ffb640 1 -- 172.21.15.47:0/3109207000 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feecc035020 con 0x7feee415e520 2024-04-01T22:33:24.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.221+0000 7feee1ffb640 1 -- 172.21.15.47:0/3109207000 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feecc031830 con 0x7feee415e520 2024-04-01T22:33:24.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.221+0000 7feee1ffb640 1 -- 172.21.15.47:0/3109207000 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feecc031c00 con 0x7feee415e520 2024-04-01T22:33:24.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.222+0000 7feee929a640 1 -- 172.21.15.47:0/3109207000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feee415e520 msgr2=0x7feee4143530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:24.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.222+0000 7feee929a640 1 --2- 172.21.15.47:0/3109207000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feee415e520 0x7feee4143530 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7feee40ceb40 tx=0x7feecc02b8d0 comp rx=0 tx=0).stop 2024-04-01T22:33:24.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.222+0000 7feee929a640 1 -- 172.21.15.47:0/3109207000 shutdown_connections 2024-04-01T22:33:24.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.222+0000 7feee929a640 1 --2- 172.21.15.47:0/3109207000 >> v2:172.21.15.47:3300/0 conn(0x7feee40cd9f0 0x7feee4071160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:24.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.222+0000 7feee929a640 1 --2- 172.21.15.47:0/3109207000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feee415e520 0x7feee4143530 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:24.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.222+0000 7feee929a640 1 -- 172.21.15.47:0/3109207000 >> 172.21.15.47:0/3109207000 conn(0x7feee40707a0 msgr2=0x7feee406f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:24.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.222+0000 7feee929a640 1 -- 172.21.15.47:0/3109207000 shutdown_connections 2024-04-01T22:33:24.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.222+0000 7feee929a640 1 -- 172.21.15.47:0/3109207000 wait complete. 2024-04-01T22:33:24.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.223+0000 7feee929a640 1 Processor -- start 2024-04-01T22:33:24.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.223+0000 7feee929a640 1 -- start start 2024-04-01T22:33:24.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.224+0000 7feee929a640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feee40cd9f0 0x7feee41e5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:24.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.224+0000 7feee929a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feee41545f0 0x7feee40b1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:24.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.224+0000 7feee929a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feee415e520 0x7feee40b1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:24.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.224+0000 7feee929a640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7feee41549d0 con 0x7feee41545f0 2024-04-01T22:33:24.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.224+0000 7feee929a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7feee415e000 con 0x7feee415e520 2024-04-01T22:33:24.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.224+0000 7feee929a640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7feee4143a70 con 0x7feee40cd9f0 2024-04-01T22:33:24.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.224+0000 7feee27fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feee41545f0 0x7feee40b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:24.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.224+0000 7feee37fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feee415e520 0x7feee40b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:24.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.224+0000 7feee2ffd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feee40cd9f0 0x7feee41e5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:24.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.225+0000 7feee27fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feee41545f0 0x7feee40b1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49176/0 (socket says 172.21.15.47:49176) 2024-04-01T22:33:24.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.225+0000 7feee27fc640 1 -- 172.21.15.47:0/1967884267 learned_addr learned my addr 172.21.15.47:0/1967884267 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:24.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.228+0000 7feee37fe640 1 -- 172.21.15.47:0/1967884267 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feee40cd9f0 msgr2=0x7feee41e5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:24.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.228+0000 7feee37fe640 1 --2- 172.21.15.47:0/1967884267 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feee40cd9f0 0x7feee41e5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:24.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.228+0000 7feee37fe640 1 -- 172.21.15.47:0/1967884267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feee41545f0 msgr2=0x7feee40b1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:24.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.228+0000 7feee37fe640 1 --2- 172.21.15.47:0/1967884267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feee41545f0 0x7feee40b1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:24.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.228+0000 7feee37fe640 1 -- 172.21.15.47:0/1967884267 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee40af470 con 0x7feee415e520 2024-04-01T22:33:24.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.230+0000 7feee37fe640 1 --2- 172.21.15.47:0/1967884267 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feee415e520 0x7feee40b1940 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7feed400eba0 tx=0x7feed400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:24.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.234+0000 7feedb7fe640 1 -- 172.21.15.47:0/1967884267 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed400cb20 con 0x7feee415e520 2024-04-01T22:33:24.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.234+0000 7feedb7fe640 1 -- 172.21.15.47:0/1967884267 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feed400ccc0 con 0x7feee415e520 2024-04-01T22:33:24.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.234+0000 7feedb7fe640 1 -- 172.21.15.47:0/1967884267 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed4003bb0 con 0x7feee415e520 2024-04-01T22:33:24.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.234+0000 7feee929a640 1 -- 172.21.15.47:0/1967884267 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feee40af750 con 0x7feee415e520 2024-04-01T22:33:24.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.234+0000 7feee929a640 1 -- 172.21.15.47:0/1967884267 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feee41e6500 con 0x7feee415e520 2024-04-01T22:33:24.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.235+0000 7feee929a640 1 -- 172.21.15.47:0/1967884267 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feee40b09f0 con 0x7feee415e520 2024-04-01T22:33:24.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.484+0000 7feedb7fe640 1 -- 172.21.15.47:0/1967884267 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7feed4005d10 con 0x7feee415e520 2024-04-01T22:33:24.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.484+0000 7feedb7fe640 1 --2- 172.21.15.47:0/1967884267 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7feec406ba10 0x7feec406ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:24.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.484+0000 7feee2ffd640 1 --2- 172.21.15.47:0/1967884267 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7feec406ba10 0x7feec406ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:24.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.485+0000 7feee2ffd640 1 --2- 172.21.15.47:0/1967884267 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7feec406ba10 0x7feec406ded0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7feedc001780 tx=0x7feedc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:24.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.486+0000 7feedb7fe640 1 -- 172.21.15.47:0/1967884267 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7feed4060370 con 0x7feee415e520 2024-04-01T22:33:24.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.497+0000 7feedb7fe640 1 -- 172.21.15.47:0/1967884267 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7feed4010040 con 0x7feee415e520 2024-04-01T22:33:24.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.686+0000 7feee929a640 1 -- 172.21.15.47:0/1967884267 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7feee40af920 con 0x7feee415e520 2024-04-01T22:33:24.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.692+0000 7feedb7fe640 1 -- 172.21.15.47:0/1967884267 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7feee40af920 con 0x7feee415e520 2024-04-01T22:33:24.691 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:33:24.692 INFO:teuthology.orchestra.run.smithi047.stdout:[ 2024-04-01T22:33:24.692 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-01T22:33:24.692 INFO:teuthology.orchestra.run.smithi047.stdout: "poolnum": 1, 2024-04-01T22:33:24.692 INFO:teuthology.orchestra.run.smithi047.stdout: "poolname": ".mgr" 2024-04-01T22:33:24.692 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-01T22:33:24.692 INFO:teuthology.orchestra.run.smithi047.stdout:] 2024-04-01T22:33:24.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.694+0000 7feee929a640 1 -- 172.21.15.47:0/1967884267 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7feec406ba10 msgr2=0x7feec406ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:24.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.694+0000 7feee929a640 1 --2- 172.21.15.47:0/1967884267 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7feec406ba10 0x7feec406ded0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7feedc001780 tx=0x7feedc009040 comp rx=0 tx=0).stop 2024-04-01T22:33:24.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.694+0000 7feee929a640 1 -- 172.21.15.47:0/1967884267 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feee415e520 msgr2=0x7feee40b1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:24.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.694+0000 7feee929a640 1 --2- 172.21.15.47:0/1967884267 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feee415e520 0x7feee40b1940 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7feed400eba0 tx=0x7feed400c490 comp rx=0 tx=0).stop 2024-04-01T22:33:24.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.694+0000 7feee929a640 1 -- 172.21.15.47:0/1967884267 shutdown_connections 2024-04-01T22:33:24.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.694+0000 7feee929a640 1 --2- 172.21.15.47:0/1967884267 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7feec406ba10 0x7feec406ded0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:24.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.694+0000 7feee929a640 1 --2- 172.21.15.47:0/1967884267 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feee415e520 0x7feee40b1940 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:24.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.694+0000 7feee929a640 1 --2- 172.21.15.47:0/1967884267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feee41545f0 0x7feee40b1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:24.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.694+0000 7feee929a640 1 --2- 172.21.15.47:0/1967884267 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7feee40cd9f0 0x7feee41e5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:24.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.694+0000 7feee929a640 1 -- 172.21.15.47:0/1967884267 >> 172.21.15.47:0/1967884267 conn(0x7feee40707a0 msgr2=0x7feee406f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:24.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.694+0000 7feee929a640 1 -- 172.21.15.47:0/1967884267 shutdown_connections 2024-04-01T22:33:24.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.694+0000 7feee929a640 1 -- 172.21.15.47:0/1967884267 wait complete. 2024-04-01T22:33:24.704 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-01T22:33:24.704 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-01T22:33:24.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.811+0000 7f4afe654640 1 Processor -- start 2024-04-01T22:33:24.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.811+0000 7f4afe654640 1 -- start start 2024-04-01T22:33:24.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.812+0000 7f4afe654640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4af8150d50 0x7f4af80c7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:24.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.812+0000 7f4afe654640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4af80ca2a0 con 0x7f4af80c9e10 2024-04-01T22:33:24.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.812+0000 7f4afe654640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4af81549a0 con 0x7f4af815ad60 2024-04-01T22:33:24.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.812+0000 7f4afe654640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f4af80737a0 con 0x7f4af8150d50 2024-04-01T22:33:24.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.812+0000 7f4af7fff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4af8150d50 0x7f4af80c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:24.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.812+0000 7f4af77fe640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f4af80c9e10 0x7f4af80cc8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:42370/0 (socket says 172.21.15.47:42370) 2024-04-01T22:33:24.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.812+0000 7f4af77fe640 1 -- 172.21.15.47:0/952206240 learned_addr learned my addr 172.21.15.47:0/952206240 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T22:33:24.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.815+0000 7f4af6ffd640 1 -- 172.21.15.47:0/952206240 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 38400408 0 0) 0x7f4af80ca2a0 con 0x7f4af80c9e10 2024-04-01T22:33:24.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.815+0000 7f4af6ffd640 1 -- 172.21.15.47:0/952206240 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ae4003520 con 0x7f4af80c9e10 2024-04-01T22:33:24.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.816+0000 7f4af7fff640 1 -- 172.21.15.47:0/952206240 >> v1:172.21.15.181:6789/0 conn(0x7f4af815ad60 legacy=0x7f4af8164c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:24.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.816+0000 7f4af7fff640 1 -- 172.21.15.47:0/952206240 >> v1:172.21.15.47:6789/0 conn(0x7f4af80c9e10 legacy=0x7f4af80cc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:24.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.816+0000 7f4af7fff640 1 -- 172.21.15.47:0/952206240 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af8151130 con 0x7f4af8150d50 2024-04-01T22:33:24.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.819+0000 7f4af7fff640 1 --2- 172.21.15.47:0/952206240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4af8150d50 0x7f4af80c7360 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4ae80097a0 tx=0x7f4ae802b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f79a79221ea739f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:24.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.823+0000 7f4af6ffd640 1 -- 172.21.15.47:0/952206240 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae802f810 con 0x7f4af8150d50 2024-04-01T22:33:24.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.823+0000 7f4af6ffd640 1 -- 172.21.15.47:0/952206240 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ae802f9b0 con 0x7f4af8150d50 2024-04-01T22:33:24.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.823+0000 7f4af6ffd640 1 -- 172.21.15.47:0/952206240 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae802fd80 con 0x7f4af8150d50 2024-04-01T22:33:24.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.824+0000 7f4afe654640 1 -- 172.21.15.47:0/952206240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4af8150d50 msgr2=0x7f4af80c7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:24.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.824+0000 7f4afe654640 1 --2- 172.21.15.47:0/952206240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4af8150d50 0x7f4af80c7360 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4ae80097a0 tx=0x7f4ae802b9f0 comp rx=0 tx=0).stop 2024-04-01T22:33:24.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.824+0000 7f4afe654640 1 -- 172.21.15.47:0/952206240 shutdown_connections 2024-04-01T22:33:24.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.824+0000 7f4afe654640 1 --2- 172.21.15.47:0/952206240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4af8150d50 0x7f4af80c7360 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:24.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.824+0000 7f4afe654640 1 -- 172.21.15.47:0/952206240 >> 172.21.15.47:0/952206240 conn(0x7f4af806c220 msgr2=0x7f4af806c600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:24.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.824+0000 7f4afe654640 1 -- 172.21.15.47:0/952206240 shutdown_connections 2024-04-01T22:33:24.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.824+0000 7f4afe654640 1 -- 172.21.15.47:0/952206240 wait complete. 2024-04-01T22:33:24.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.825+0000 7f4afe654640 1 Processor -- start 2024-04-01T22:33:24.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.825+0000 7f4afe654640 1 -- start start 2024-04-01T22:33:24.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.826+0000 7f4afe654640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4af80c9e10 0x7f4af815d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:24.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.826+0000 7f4afe654640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4af8150d50 0x7f4af81f00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:24.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.826+0000 7f4afe654640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4af815ad60 0x7f4af81f0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:24.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.826+0000 7f4afe654640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4af80c9330 con 0x7f4af815ad60 2024-04-01T22:33:24.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.826+0000 7f4afe654640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4af80734c0 con 0x7f4af80c9e10 2024-04-01T22:33:24.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.826+0000 7f4afe654640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f4af80c9610 con 0x7f4af8150d50 2024-04-01T22:33:24.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.826+0000 7f4afcbf1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4af815ad60 0x7f4af81f0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:24.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.826+0000 7f4af7fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4af80c9e10 0x7f4af815d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:24.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.826+0000 7f4af77fe640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4af8150d50 0x7f4af81f00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:24.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.826+0000 7f4afcbf1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4af815ad60 0x7f4af81f0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49188/0 (socket says 172.21.15.47:49188) 2024-04-01T22:33:24.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.826+0000 7f4afcbf1640 1 -- 172.21.15.47:0/4232418052 learned_addr learned my addr 172.21.15.47:0/4232418052 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:24.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.830+0000 7f4afcbf1640 1 -- 172.21.15.47:0/4232418052 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4af8150d50 msgr2=0x7f4af81f00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:24.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.830+0000 7f4afcbf1640 1 --2- 172.21.15.47:0/4232418052 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4af8150d50 0x7f4af81f00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:24.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.830+0000 7f4afcbf1640 1 -- 172.21.15.47:0/4232418052 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4af80c9e10 msgr2=0x7f4af815d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:24.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.830+0000 7f4afcbf1640 1 --2- 172.21.15.47:0/4232418052 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4af80c9e10 0x7f4af815d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:24.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.830+0000 7f4afcbf1640 1 -- 172.21.15.47:0/4232418052 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af815b640 con 0x7f4af815ad60 2024-04-01T22:33:24.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.832+0000 7f4afcbf1640 1 --2- 172.21.15.47:0/4232418052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4af815ad60 0x7f4af81f0610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4af000c6e0 tx=0x7f4af000cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:24.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.836+0000 7f4af4ff9640 1 -- 172.21.15.47:0/4232418052 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af0003b70 con 0x7f4af815ad60 2024-04-01T22:33:24.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.836+0000 7f4af4ff9640 1 -- 172.21.15.47:0/4232418052 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4af0003d30 con 0x7f4af815ad60 2024-04-01T22:33:24.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.836+0000 7f4af4ff9640 1 -- 172.21.15.47:0/4232418052 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af0005310 con 0x7f4af815ad60 2024-04-01T22:33:24.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.836+0000 7f4afe654640 1 -- 172.21.15.47:0/4232418052 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4af815b920 con 0x7f4af815ad60 2024-04-01T22:33:24.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.836+0000 7f4afe654640 1 -- 172.21.15.47:0/4232418052 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4af815bee0 con 0x7f4af815ad60 2024-04-01T22:33:24.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.837+0000 7f4afe654640 1 -- 172.21.15.47:0/4232418052 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4af80cd040 con 0x7f4af815ad60 2024-04-01T22:33:24.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.856+0000 7f4af4ff9640 1 -- 172.21.15.47:0/4232418052 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f4af00054b0 con 0x7f4af815ad60 2024-04-01T22:33:24.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.857+0000 7f4af4ff9640 1 --2- 172.21.15.47:0/4232418052 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f4ad806b9e0 0x7f4ad806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:24.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.857+0000 7f4af7fff640 1 --2- 172.21.15.47:0/4232418052 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f4ad806b9e0 0x7f4ad806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:24.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.857+0000 7f4af7fff640 1 --2- 172.21.15.47:0/4232418052 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f4ad806b9e0 0x7f4ad806dea0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8036000 tx=0x7f4ae8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:24.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:24.860+0000 7f4af4ff9640 1 -- 172.21.15.47:0/4232418052 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f4af00057a0 con 0x7f4af815ad60 2024-04-01T22:33:25.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.116+0000 7f4af4ff9640 1 -- 172.21.15.47:0/4232418052 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f4af80cd040 con 0x7f4af815ad60 2024-04-01T22:33:25.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.301+0000 7f4afe654640 1 -- 172.21.15.47:0/4232418052 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f4af8068210 con 0x7f4af815ad60 2024-04-01T22:33:25.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.647+0000 7f4af4ff9640 1 -- 172.21.15.47:0/4232418052 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7f4af00595e0 con 0x7f4af815ad60 2024-04-01T22:33:25.647 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_metadata' created 2024-04-01T22:33:25.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.650+0000 7f4afe654640 1 -- 172.21.15.47:0/4232418052 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f4ad806b9e0 msgr2=0x7f4ad806dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:25.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.650+0000 7f4afe654640 1 --2- 172.21.15.47:0/4232418052 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f4ad806b9e0 0x7f4ad806dea0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8036000 tx=0x7f4ae8008030 comp rx=0 tx=0).stop 2024-04-01T22:33:25.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.650+0000 7f4afe654640 1 -- 172.21.15.47:0/4232418052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4af815ad60 msgr2=0x7f4af81f0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:25.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.650+0000 7f4afe654640 1 --2- 172.21.15.47:0/4232418052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4af815ad60 0x7f4af81f0610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4af000c6e0 tx=0x7f4af000cba0 comp rx=0 tx=0).stop 2024-04-01T22:33:25.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.650+0000 7f4afe654640 1 -- 172.21.15.47:0/4232418052 shutdown_connections 2024-04-01T22:33:25.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.650+0000 7f4afe654640 1 --2- 172.21.15.47:0/4232418052 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f4ad806b9e0 0x7f4ad806dea0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:25.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.650+0000 7f4afe654640 1 --2- 172.21.15.47:0/4232418052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4af815ad60 0x7f4af81f0610 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:25.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.650+0000 7f4afe654640 1 --2- 172.21.15.47:0/4232418052 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4af8150d50 0x7f4af81f00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:25.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.650+0000 7f4afe654640 1 --2- 172.21.15.47:0/4232418052 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4af80c9e10 0x7f4af815d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:25.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.650+0000 7f4afe654640 1 -- 172.21.15.47:0/4232418052 >> 172.21.15.47:0/4232418052 conn(0x7f4af806c220 msgr2=0x7f4af80cb5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:25.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.650+0000 7f4afe654640 1 -- 172.21.15.47:0/4232418052 shutdown_connections 2024-04-01T22:33:25.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.650+0000 7f4afe654640 1 -- 172.21.15.47:0/4232418052 wait complete. 2024-04-01T22:33:25.664 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-01T22:33:25.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.778+0000 7f4b30054640 1 Processor -- start 2024-04-01T22:33:25.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.779+0000 7f4b30054640 1 -- start start 2024-04-01T22:33:25.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.779+0000 7f4b30054640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4b28071470 0x7f4b28158c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:25.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.779+0000 7f4b30054640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4b280c8560 0x7f4b28151db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:25.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.779+0000 7f4b30054640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b2815c6a0 con 0x7f4b28071850 2024-04-01T22:33:25.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.779+0000 7f4b30054640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f4b28159170 con 0x7f4b280c8560 2024-04-01T22:33:25.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.779+0000 7f4b30054640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f4b2815b840 con 0x7f4b28071470 2024-04-01T22:33:25.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.780+0000 7f4b2d5ef640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4b280c8560 0x7f4b28151db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:25.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.780+0000 7f4b2ddf0640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4b28071470 0x7f4b28158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:25.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.781+0000 7f4b2ddf0640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4b28071470 0x7f4b28158c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:33496/0 (socket says 172.21.15.47:33496) 2024-04-01T22:33:25.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.781+0000 7f4b2ddf0640 1 -- 172.21.15.47:0/602815358 learned_addr learned my addr 172.21.15.47:0/602815358 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:25.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.783+0000 7f4b2ddf0640 1 -- 172.21.15.47:0/602815358 >> v2:172.21.15.181:3300/0 conn(0x7f4b280c8560 msgr2=0x7f4b28151db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:25.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.783+0000 7f4b2ddf0640 1 --2- 172.21.15.47:0/602815358 >> v2:172.21.15.181:3300/0 conn(0x7f4b280c8560 0x7f4b28151db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:25.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.783+0000 7f4b2ddf0640 1 -- 172.21.15.47:0/602815358 >> v1:172.21.15.181:6789/0 conn(0x7f4b28071850 legacy=0x7f4b280c2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:25.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.783+0000 7f4b2ddf0640 1 -- 172.21.15.47:0/602815358 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b2815bb20 con 0x7f4b28071470 2024-04-01T22:33:25.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.786+0000 7f4b2ddf0640 1 --2- 172.21.15.47:0/602815358 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4b28071470 0x7f4b28158c30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4b24009870 tx=0x7f4b2402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29817f67c3a1784a server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:25.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.789+0000 7f4b2cdee640 1 -- 172.21.15.47:0/602815358 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b24034070 con 0x7f4b28071470 2024-04-01T22:33:25.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.789+0000 7f4b2cdee640 1 -- 172.21.15.47:0/602815358 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b24030840 con 0x7f4b28071470 2024-04-01T22:33:25.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.789+0000 7f4b2cdee640 1 -- 172.21.15.47:0/602815358 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b24030c10 con 0x7f4b28071470 2024-04-01T22:33:25.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.790+0000 7f4b30054640 1 -- 172.21.15.47:0/602815358 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4b28071470 msgr2=0x7f4b28158c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:25.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.790+0000 7f4b30054640 1 --2- 172.21.15.47:0/602815358 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4b28071470 0x7f4b28158c30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4b24009870 tx=0x7f4b2402b980 comp rx=0 tx=0).stop 2024-04-01T22:33:25.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.790+0000 7f4b30054640 1 -- 172.21.15.47:0/602815358 shutdown_connections 2024-04-01T22:33:25.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.790+0000 7f4b30054640 1 --2- 172.21.15.47:0/602815358 >> v2:172.21.15.181:3300/0 conn(0x7f4b280c8560 0x7f4b28151db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:25.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.790+0000 7f4b30054640 1 --2- 172.21.15.47:0/602815358 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4b28071470 0x7f4b28158c30 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:25.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.790+0000 7f4b30054640 1 -- 172.21.15.47:0/602815358 >> 172.21.15.47:0/602815358 conn(0x7f4b2806b500 msgr2=0x7f4b2806f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:25.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.790+0000 7f4b30054640 1 -- 172.21.15.47:0/602815358 shutdown_connections 2024-04-01T22:33:25.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.790+0000 7f4b30054640 1 -- 172.21.15.47:0/602815358 wait complete. 2024-04-01T22:33:25.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.791+0000 7f4b30054640 1 Processor -- start 2024-04-01T22:33:25.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.791+0000 7f4b30054640 1 -- start start 2024-04-01T22:33:25.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.792+0000 7f4b30054640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4b28071470 0x7f4b281f1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:25.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.792+0000 7f4b30054640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b28071850 0x7f4b280b2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:25.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.792+0000 7f4b30054640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4b280c8560 0x7f4b281459d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:25.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.792+0000 7f4b30054640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2815c3c0 con 0x7f4b28071850 2024-04-01T22:33:25.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.792+0000 7f4b30054640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2815c0e0 con 0x7f4b280c8560 2024-04-01T22:33:25.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.792+0000 7f4b30054640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f4b280c3500 con 0x7f4b28071470 2024-04-01T22:33:25.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.792+0000 7f4b2ddf0640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4b28071470 0x7f4b281f1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:25.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.792+0000 7f4b2d5ef640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b28071850 0x7f4b280b2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:25.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.792+0000 7f4b2e5f1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4b280c8560 0x7f4b281459d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:25.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.793+0000 7f4b2d5ef640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b28071850 0x7f4b280b2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49200/0 (socket says 172.21.15.47:49200) 2024-04-01T22:33:25.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.793+0000 7f4b2d5ef640 1 -- 172.21.15.47:0/2731754609 learned_addr learned my addr 172.21.15.47:0/2731754609 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:25.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.796+0000 7f4b2d5ef640 1 -- 172.21.15.47:0/2731754609 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4b28071470 msgr2=0x7f4b281f1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:25.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.796+0000 7f4b2d5ef640 1 --2- 172.21.15.47:0/2731754609 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4b28071470 0x7f4b281f1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:25.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.796+0000 7f4b2d5ef640 1 -- 172.21.15.47:0/2731754609 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4b280c8560 msgr2=0x7f4b281459d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:25.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.796+0000 7f4b2d5ef640 1 --2- 172.21.15.47:0/2731754609 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4b280c8560 0x7f4b281459d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:25.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.796+0000 7f4b2d5ef640 1 -- 172.21.15.47:0/2731754609 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b280b1da0 con 0x7f4b28071850 2024-04-01T22:33:25.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.799+0000 7f4b2d5ef640 1 --2- 172.21.15.47:0/2731754609 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b28071850 0x7f4b280b2330 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4b1800e870 tx=0x7f4b1800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:25.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.802+0000 7f4b1e7fc640 1 -- 172.21.15.47:0/2731754609 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b18017070 con 0x7f4b28071850 2024-04-01T22:33:25.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.802+0000 7f4b1e7fc640 1 -- 172.21.15.47:0/2731754609 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b1800c940 con 0x7f4b28071850 2024-04-01T22:33:25.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.802+0000 7f4b1e7fc640 1 -- 172.21.15.47:0/2731754609 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1800cd30 con 0x7f4b28071850 2024-04-01T22:33:25.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.802+0000 7f4b30054640 1 -- 172.21.15.47:0/2731754609 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b28149fc0 con 0x7f4b28071850 2024-04-01T22:33:25.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.802+0000 7f4b30054640 1 -- 172.21.15.47:0/2731754609 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b2814a580 con 0x7f4b28071850 2024-04-01T22:33:25.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.803+0000 7f4b30054640 1 -- 172.21.15.47:0/2731754609 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b28068920 con 0x7f4b28071850 2024-04-01T22:33:25.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.822+0000 7f4b1e7fc640 1 -- 172.21.15.47:0/2731754609 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f4b1801a070 con 0x7f4b28071850 2024-04-01T22:33:25.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.822+0000 7f4b1e7fc640 1 --2- 172.21.15.47:0/2731754609 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f4b0c06b9e0 0x7f4b0c06dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:25.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.823+0000 7f4b2ddf0640 1 --2- 172.21.15.47:0/2731754609 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f4b0c06b9e0 0x7f4b0c06dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:25.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.823+0000 7f4b2ddf0640 1 --2- 172.21.15.47:0/2731754609 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f4b0c06b9e0 0x7f4b0c06dea0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4b24036000 tx=0x7f4b24008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:25.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:25.826+0000 7f4b1e7fc640 1 -- 172.21.15.47:0/2731754609 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7f4b18057470 con 0x7f4b28071850 2024-04-01T22:33:26.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.079+0000 7f4b1e7fc640 1 -- 172.21.15.47:0/2731754609 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f4b280b1da0 con 0x7f4b28071850 2024-04-01T22:33:26.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.261+0000 7f4b30054640 1 -- 172.21.15.47:0/2731754609 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f4b280c8f60 con 0x7f4b28071850 2024-04-01T22:33:26.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.813+0000 7f4b1e7fc640 1 -- 172.21.15.47:0/2731754609 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) ==== 171+0+0 (secure 0 0 0) 0x7f4b180593d0 con 0x7f4b28071850 2024-04-01T22:33:26.812 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_data' created 2024-04-01T22:33:26.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.815+0000 7f4b30054640 1 -- 172.21.15.47:0/2731754609 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f4b0c06b9e0 msgr2=0x7f4b0c06dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:26.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.815+0000 7f4b30054640 1 --2- 172.21.15.47:0/2731754609 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f4b0c06b9e0 0x7f4b0c06dea0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4b24036000 tx=0x7f4b24008030 comp rx=0 tx=0).stop 2024-04-01T22:33:26.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.815+0000 7f4b30054640 1 -- 172.21.15.47:0/2731754609 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b28071850 msgr2=0x7f4b280b2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:26.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.815+0000 7f4b30054640 1 --2- 172.21.15.47:0/2731754609 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b28071850 0x7f4b280b2330 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4b1800e870 tx=0x7f4b1800ed30 comp rx=0 tx=0).stop 2024-04-01T22:33:26.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.815+0000 7f4b30054640 1 -- 172.21.15.47:0/2731754609 shutdown_connections 2024-04-01T22:33:26.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.815+0000 7f4b30054640 1 --2- 172.21.15.47:0/2731754609 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f4b0c06b9e0 0x7f4b0c06dea0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:26.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.815+0000 7f4b30054640 1 --2- 172.21.15.47:0/2731754609 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4b280c8560 0x7f4b281459d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:26.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.815+0000 7f4b30054640 1 --2- 172.21.15.47:0/2731754609 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b28071850 0x7f4b280b2330 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:26.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.815+0000 7f4b30054640 1 --2- 172.21.15.47:0/2731754609 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4b28071470 0x7f4b281f1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:26.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.815+0000 7f4b30054640 1 -- 172.21.15.47:0/2731754609 >> 172.21.15.47:0/2731754609 conn(0x7f4b2806b500 msgr2=0x7f4b28157950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:26.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.815+0000 7f4b30054640 1 -- 172.21.15.47:0/2731754609 shutdown_connections 2024-04-01T22:33:26.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.815+0000 7f4b30054640 1 -- 172.21.15.47:0/2731754609 wait complete. 2024-04-01T22:33:26.826 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-01T22:33:26.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.937+0000 7f4c7e647640 1 Processor -- start 2024-04-01T22:33:26.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.937+0000 7f4c7e647640 1 -- start start 2024-04-01T22:33:26.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.938+0000 7f4c7e647640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c780c2690 0x7f4c7806c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:26.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.938+0000 7f4c7e647640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4c78070490 0x7f4c780ae710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:26.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.938+0000 7f4c7e647640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c780c2bf0 con 0x7f4c781514e0 2024-04-01T22:33:26.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.938+0000 7f4c7e647640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f4c780c3490 con 0x7f4c78070490 2024-04-01T22:33:26.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.938+0000 7f4c7e647640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f4c780c2ed0 con 0x7f4c780c2690 2024-04-01T22:33:26.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.938+0000 7f4c7cbe4640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4c78070490 0x7f4c780ae710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:26.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.938+0000 7f4c777fe640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c780c2690 0x7f4c7806c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:26.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.939+0000 7f4c777fe640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c780c2690 0x7f4c7806c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:33526/0 (socket says 172.21.15.47:33526) 2024-04-01T22:33:26.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.939+0000 7f4c777fe640 1 -- 172.21.15.47:0/2440033782 learned_addr learned my addr 172.21.15.47:0/2440033782 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:26.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.941+0000 7f4c777fe640 1 -- 172.21.15.47:0/2440033782 >> v2:172.21.15.47:3300/0 conn(0x7f4c78070490 msgr2=0x7f4c780ae710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:26.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.941+0000 7f4c777fe640 1 --2- 172.21.15.47:0/2440033782 >> v2:172.21.15.47:3300/0 conn(0x7f4c78070490 0x7f4c780ae710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:26.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.941+0000 7f4c777fe640 1 -- 172.21.15.47:0/2440033782 >> v1:172.21.15.181:6789/0 conn(0x7f4c781514e0 legacy=0x7f4c78157b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:26.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.941+0000 7f4c777fe640 1 -- 172.21.15.47:0/2440033782 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c780c31b0 con 0x7f4c780c2690 2024-04-01T22:33:26.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.943+0000 7f4c777fe640 1 --2- 172.21.15.47:0/2440033782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c780c2690 0x7f4c7806c220 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4c68009870 tx=0x7f4c6802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0d2ecad6c18a9c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:26.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.946+0000 7f4c76ffd640 1 -- 172.21.15.47:0/2440033782 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c68034070 con 0x7f4c780c2690 2024-04-01T22:33:26.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.946+0000 7f4c76ffd640 1 -- 172.21.15.47:0/2440033782 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c68030840 con 0x7f4c780c2690 2024-04-01T22:33:26.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.946+0000 7f4c76ffd640 1 -- 172.21.15.47:0/2440033782 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c68030c10 con 0x7f4c780c2690 2024-04-01T22:33:26.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.947+0000 7f4c7e647640 1 -- 172.21.15.47:0/2440033782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c780c2690 msgr2=0x7f4c7806c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:26.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.947+0000 7f4c7e647640 1 --2- 172.21.15.47:0/2440033782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c780c2690 0x7f4c7806c220 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4c68009870 tx=0x7f4c6802b980 comp rx=0 tx=0).stop 2024-04-01T22:33:26.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.947+0000 7f4c7e647640 1 -- 172.21.15.47:0/2440033782 shutdown_connections 2024-04-01T22:33:26.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.947+0000 7f4c7e647640 1 --2- 172.21.15.47:0/2440033782 >> v2:172.21.15.47:3300/0 conn(0x7f4c78070490 0x7f4c780ae710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:26.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.947+0000 7f4c7e647640 1 --2- 172.21.15.47:0/2440033782 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c780c2690 0x7f4c7806c220 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:26.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.947+0000 7f4c7e647640 1 -- 172.21.15.47:0/2440033782 >> 172.21.15.47:0/2440033782 conn(0x7f4c7806e180 msgr2=0x7f4c7806f980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:26.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.947+0000 7f4c7e647640 1 -- 172.21.15.47:0/2440033782 shutdown_connections 2024-04-01T22:33:26.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.947+0000 7f4c7e647640 1 -- 172.21.15.47:0/2440033782 wait complete. 2024-04-01T22:33:26.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.948+0000 7f4c7e647640 1 Processor -- start 2024-04-01T22:33:26.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.949+0000 7f4c7e647640 1 -- start start 2024-04-01T22:33:26.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.949+0000 7f4c7e647640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c78070490 0x7f4c7814c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:26.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.949+0000 7f4c7e647640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c780c2690 0x7f4c78155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:26.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.949+0000 7f4c7e647640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c781514e0 0x7f4c78156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:26.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.949+0000 7f4c7e647640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4c781518c0 con 0x7f4c781514e0 2024-04-01T22:33:26.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.949+0000 7f4c7e647640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4c78157620 con 0x7f4c78070490 2024-04-01T22:33:26.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.949+0000 7f4c7e647640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f4c78071df0 con 0x7f4c780c2690 2024-04-01T22:33:26.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.950+0000 7f4c7cbe4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c781514e0 0x7f4c78156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:26.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.950+0000 7f4c777fe640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c780c2690 0x7f4c78155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:26.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.950+0000 7f4c7cbe4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c781514e0 0x7f4c78156460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49218/0 (socket says 172.21.15.47:49218) 2024-04-01T22:33:26.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.950+0000 7f4c7cbe4640 1 -- 172.21.15.47:0/1558296204 learned_addr learned my addr 172.21.15.47:0/1558296204 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:26.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.954+0000 7f4c7cbe4640 1 -- 172.21.15.47:0/1558296204 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c780c2690 msgr2=0x7f4c78155f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:26.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.954+0000 7f4c7cbe4640 1 --2- 172.21.15.47:0/1558296204 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c780c2690 0x7f4c78155f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:26.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.954+0000 7f4c7cbe4640 1 -- 172.21.15.47:0/1558296204 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c78070490 msgr2=0x7f4c7814c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:26.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.954+0000 7f4c7cbe4640 1 --2- 172.21.15.47:0/1558296204 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c78070490 0x7f4c7814c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:26.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.954+0000 7f4c7cbe4640 1 -- 172.21.15.47:0/1558296204 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c781e3380 con 0x7f4c781514e0 2024-04-01T22:33:26.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.956+0000 7f4c7cbe4640 1 --2- 172.21.15.47:0/1558296204 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c781514e0 0x7f4c78156460 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4c70009dd0 tx=0x7f4c7000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:26.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.978+0000 7f4c74ff9640 1 -- 172.21.15.47:0/1558296204 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c70018020 con 0x7f4c781514e0 2024-04-01T22:33:26.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.978+0000 7f4c74ff9640 1 -- 172.21.15.47:0/1558296204 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c70014480 con 0x7f4c781514e0 2024-04-01T22:33:26.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.978+0000 7f4c74ff9640 1 -- 172.21.15.47:0/1558296204 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c70014870 con 0x7f4c781514e0 2024-04-01T22:33:26.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.978+0000 7f4c7e647640 1 -- 172.21.15.47:0/1558296204 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c781e2800 con 0x7f4c781514e0 2024-04-01T22:33:26.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.978+0000 7f4c7e647640 1 -- 172.21.15.47:0/1558296204 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c781e2dc0 con 0x7f4c781514e0 2024-04-01T22:33:26.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:26.979+0000 7f4c7e647640 1 -- 172.21.15.47:0/1558296204 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c78068210 con 0x7f4c781514e0 2024-04-01T22:33:27.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:27.312+0000 7f4c74ff9640 1 -- 172.21.15.47:0/1558296204 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f4c70005d10 con 0x7f4c781514e0 2024-04-01T22:33:27.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:27.313+0000 7f4c74ff9640 1 --2- 172.21.15.47:0/1558296204 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f4c5806b9e0 0x7f4c5806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:27.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:27.313+0000 7f4c77fff640 1 --2- 172.21.15.47:0/1558296204 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f4c5806b9e0 0x7f4c5806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:27.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:27.313+0000 7f4c77fff640 1 --2- 172.21.15.47:0/1558296204 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f4c5806b9e0 0x7f4c5806dea0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4c60009650 tx=0x7f4c60006ba0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:27.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:27.332+0000 7f4c74ff9640 1 -- 172.21.15.47:0/1558296204 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7f4c70058110 con 0x7f4c781514e0 2024-04-01T22:33:27.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:27.332+0000 7f4c74ff9640 1 -- 172.21.15.47:0/1558296204 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f4c70022030 con 0x7f4c781514e0 2024-04-01T22:33:27.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:27.568+0000 7f4c7e647640 1 -- 172.21.15.47:0/1558296204 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f4c7814e0a0 con 0x7f4c781514e0 2024-04-01T22:33:28.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.020+0000 7f4c74ff9640 1 -- 172.21.15.47:0/1558296204 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f4c70010040 con 0x7f4c781514e0 2024-04-01T22:33:28.020 INFO:teuthology.orchestra.run.smithi047.stderr:new fs with metadata pool 2 and data pool 3 2024-04-01T22:33:28.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.022+0000 7f4c7e647640 1 -- 172.21.15.47:0/1558296204 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f4c5806b9e0 msgr2=0x7f4c5806dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:28.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.022+0000 7f4c7e647640 1 --2- 172.21.15.47:0/1558296204 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f4c5806b9e0 0x7f4c5806dea0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4c60009650 tx=0x7f4c60006ba0 comp rx=0 tx=0).stop 2024-04-01T22:33:28.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.022+0000 7f4c7e647640 1 -- 172.21.15.47:0/1558296204 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c781514e0 msgr2=0x7f4c78156460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:28.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.022+0000 7f4c7e647640 1 --2- 172.21.15.47:0/1558296204 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c781514e0 0x7f4c78156460 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4c70009dd0 tx=0x7f4c7000c490 comp rx=0 tx=0).stop 2024-04-01T22:33:28.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.022+0000 7f4c7e647640 1 -- 172.21.15.47:0/1558296204 shutdown_connections 2024-04-01T22:33:28.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.022+0000 7f4c7e647640 1 --2- 172.21.15.47:0/1558296204 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f4c5806b9e0 0x7f4c5806dea0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:28.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.022+0000 7f4c7e647640 1 --2- 172.21.15.47:0/1558296204 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c781514e0 0x7f4c78156460 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:28.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.022+0000 7f4c7e647640 1 --2- 172.21.15.47:0/1558296204 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c780c2690 0x7f4c78155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:28.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.022+0000 7f4c7e647640 1 --2- 172.21.15.47:0/1558296204 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c78070490 0x7f4c7814c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:28.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.022+0000 7f4c7e647640 1 -- 172.21.15.47:0/1558296204 >> 172.21.15.47:0/1558296204 conn(0x7f4c7806e180 msgr2=0x7f4c780742d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:28.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.022+0000 7f4c7e647640 1 -- 172.21.15.47:0/1558296204 shutdown_connections 2024-04-01T22:33:28.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.022+0000 7f4c7e647640 1 -- 172.21.15.47:0/1558296204 wait complete. 2024-04-01T22:33:28.036 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-01T22:33:28.038 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-01T22:33:28.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.149+0000 7f5468943640 1 Processor -- start 2024-04-01T22:33:28.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.149+0000 7f5468943640 1 -- start start 2024-04-01T22:33:28.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.150+0000 7f5468943640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54640cee30 0x7f546415afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:28.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.150+0000 7f5468943640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54640cdae0 con 0x7f54640c93f0 2024-04-01T22:33:28.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.150+0000 7f5468943640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54640c97d0 con 0x7f54640cc0d0 2024-04-01T22:33:28.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.150+0000 7f5468943640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f546415b500 con 0x7f54640cee30 2024-04-01T22:33:28.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.150+0000 7f545bfff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54640cee30 0x7f546415afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:28.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.150+0000 7f545bfff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54640cee30 0x7f546415afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:33536/0 (socket says 172.21.15.47:33536) 2024-04-01T22:33:28.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.150+0000 7f545bfff640 1 -- 172.21.15.47:0/3280251859 learned_addr learned my addr 172.21.15.47:0/3280251859 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:28.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.153+0000 7f545bfff640 1 -- 172.21.15.47:0/3280251859 >> v1:172.21.15.181:6789/0 conn(0x7f54640cc0d0 legacy=0x7f54640cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:28.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.153+0000 7f545bfff640 1 -- 172.21.15.47:0/3280251859 >> v1:172.21.15.47:6789/0 conn(0x7f54640c93f0 legacy=0x7f546406c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:28.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.153+0000 7f545bfff640 1 -- 172.21.15.47:0/3280251859 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54640cdd80 con 0x7f54640cee30 2024-04-01T22:33:28.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.155+0000 7f545bfff640 1 --2- 172.21.15.47:0/3280251859 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54640cee30 0x7f546415afc0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f544c0098a0 tx=0x7f544c02b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4ac1616090f0eff server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:28.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.157+0000 7f5461d9b640 1 -- 172.21.15.47:0/3280251859 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f544c0317c0 con 0x7f54640cee30 2024-04-01T22:33:28.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.158+0000 7f5461d9b640 1 -- 172.21.15.47:0/3280251859 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f544c037070 con 0x7f54640cee30 2024-04-01T22:33:28.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.158+0000 7f5461d9b640 1 -- 172.21.15.47:0/3280251859 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f544c031b80 con 0x7f54640cee30 2024-04-01T22:33:28.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.159+0000 7f5468943640 1 -- 172.21.15.47:0/3280251859 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54640cee30 msgr2=0x7f546415afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:28.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.159+0000 7f5468943640 1 --2- 172.21.15.47:0/3280251859 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54640cee30 0x7f546415afc0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f544c0098a0 tx=0x7f544c02b860 comp rx=0 tx=0).stop 2024-04-01T22:33:28.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.159+0000 7f5468943640 1 -- 172.21.15.47:0/3280251859 shutdown_connections 2024-04-01T22:33:28.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.159+0000 7f5468943640 1 --2- 172.21.15.47:0/3280251859 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54640cee30 0x7f546415afc0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:28.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.159+0000 7f5468943640 1 -- 172.21.15.47:0/3280251859 >> 172.21.15.47:0/3280251859 conn(0x7f54640cfdb0 msgr2=0x7f54640d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:28.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.159+0000 7f5468943640 1 -- 172.21.15.47:0/3280251859 shutdown_connections 2024-04-01T22:33:28.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.159+0000 7f5468943640 1 -- 172.21.15.47:0/3280251859 wait complete. 2024-04-01T22:33:28.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.160+0000 7f5468943640 1 Processor -- start 2024-04-01T22:33:28.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.160+0000 7f5468943640 1 -- start start 2024-04-01T22:33:28.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.161+0000 7f5468943640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54640c93f0 0x7f546414d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:28.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.161+0000 7f5468943640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54640cc0d0 0x7f546414deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:28.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.161+0000 7f5468943640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54640cee30 0x7f54641f2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:28.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.161+0000 7f5468943640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f54640ce620 con 0x7f54640cc0d0 2024-04-01T22:33:28.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.161+0000 7f5468943640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f54640ce340 con 0x7f54640cee30 2024-04-01T22:33:28.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.161+0000 7f5468943640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f54640cf430 con 0x7f54640c93f0 2024-04-01T22:33:28.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.161+0000 7f546259c640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54640c93f0 0x7f546414d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:28.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.162+0000 7f546259c640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54640c93f0 0x7f546414d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:33538/0 (socket says 172.21.15.47:33538) 2024-04-01T22:33:28.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.162+0000 7f546259c640 1 -- 172.21.15.47:0/2437147051 learned_addr learned my addr 172.21.15.47:0/2437147051 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:28.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.165+0000 7f546259c640 1 -- 172.21.15.47:0/2437147051 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54640cee30 msgr2=0x7f54641f2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:28.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.165+0000 7f546259c640 1 --2- 172.21.15.47:0/2437147051 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54640cee30 0x7f54641f2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:28.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.165+0000 7f546259c640 1 -- 172.21.15.47:0/2437147051 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54640cc0d0 msgr2=0x7f546414deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:28.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.165+0000 7f546259c640 1 --2- 172.21.15.47:0/2437147051 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54640cc0d0 0x7f546414deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:28.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.165+0000 7f546259c640 1 -- 172.21.15.47:0/2437147051 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54641f4e80 con 0x7f54640c93f0 2024-04-01T22:33:28.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.167+0000 7f546259c640 1 --2- 172.21.15.47:0/2437147051 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54640c93f0 0x7f546414d970 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f545400c410 tx=0x7f545400c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:28.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.172+0000 7f545affd640 1 -- 172.21.15.47:0/2437147051 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5454017070 con 0x7f54640c93f0 2024-04-01T22:33:28.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.172+0000 7f545affd640 1 -- 172.21.15.47:0/2437147051 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54540035f0 con 0x7f54640c93f0 2024-04-01T22:33:28.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.172+0000 7f545affd640 1 -- 172.21.15.47:0/2437147051 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5454003a20 con 0x7f54640c93f0 2024-04-01T22:33:28.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.172+0000 7f5468943640 1 -- 172.21.15.47:0/2437147051 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54641529c0 con 0x7f54640c93f0 2024-04-01T22:33:28.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.172+0000 7f5468943640 1 -- 172.21.15.47:0/2437147051 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f54641f2190 con 0x7f54640c93f0 2024-04-01T22:33:28.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.173+0000 7f5468943640 1 -- 172.21.15.47:0/2437147051 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f546415a4d0 con 0x7f54640c93f0 2024-04-01T22:33:28.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.195+0000 7f545affd640 1 -- 172.21.15.47:0/2437147051 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f545401a070 con 0x7f54640c93f0 2024-04-01T22:33:28.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.195+0000 7f545affd640 1 --2- 172.21.15.47:0/2437147051 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f544406b9e0 0x7f544406dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:28.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.195+0000 7f545bfff640 1 --2- 172.21.15.47:0/2437147051 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f544406b9e0 0x7f544406dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:28.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.196+0000 7f545bfff640 1 --2- 172.21.15.47:0/2437147051 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f544406b9e0 0x7f544406dea0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f544c036000 tx=0x7f544c030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:28.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.198+0000 7f545affd640 1 -- 172.21.15.47:0/2437147051 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5454056760 con 0x7f54640c93f0 2024-04-01T22:33:28.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.466+0000 7f545affd640 1 -- 172.21.15.47:0/2437147051 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f546415a4d0 con 0x7f54640c93f0 2024-04-01T22:33:28.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.671+0000 7f5468943640 1 -- 172.21.15.47:0/2437147051 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f546415a840 con 0x7f54640c93f0 2024-04-01T22:33:28.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.886+0000 7f545affd640 1 -- 172.21.15.47:0/2437147051 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) ==== 157+0+0 (secure 0 0 0) 0x7f5454021020 con 0x7f54640c93f0 2024-04-01T22:33:28.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.888+0000 7f5468943640 1 -- 172.21.15.47:0/2437147051 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f544406b9e0 msgr2=0x7f544406dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:28.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.888+0000 7f5468943640 1 --2- 172.21.15.47:0/2437147051 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f544406b9e0 0x7f544406dea0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f544c036000 tx=0x7f544c030000 comp rx=0 tx=0).stop 2024-04-01T22:33:28.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.888+0000 7f5468943640 1 -- 172.21.15.47:0/2437147051 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54640c93f0 msgr2=0x7f546414d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:28.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.888+0000 7f5468943640 1 --2- 172.21.15.47:0/2437147051 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54640c93f0 0x7f546414d970 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f545400c410 tx=0x7f545400c8d0 comp rx=0 tx=0).stop 2024-04-01T22:33:28.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.889+0000 7f5468943640 1 -- 172.21.15.47:0/2437147051 shutdown_connections 2024-04-01T22:33:28.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.889+0000 7f5468943640 1 --2- 172.21.15.47:0/2437147051 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f544406b9e0 0x7f544406dea0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:28.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.889+0000 7f5468943640 1 --2- 172.21.15.47:0/2437147051 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54640cee30 0x7f54641f2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:28.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.889+0000 7f5468943640 1 --2- 172.21.15.47:0/2437147051 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54640cc0d0 0x7f546414deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:28.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.889+0000 7f5468943640 1 --2- 172.21.15.47:0/2437147051 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f54640c93f0 0x7f546414d970 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:28.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.889+0000 7f5468943640 1 -- 172.21.15.47:0/2437147051 >> 172.21.15.47:0/2437147051 conn(0x7f54640cfdb0 msgr2=0x7f54641500f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:28.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.889+0000 7f5468943640 1 -- 172.21.15.47:0/2437147051 shutdown_connections 2024-04-01T22:33:28.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:28.889+0000 7f5468943640 1 -- 172.21.15.47:0/2437147051 wait complete. 2024-04-01T22:33:28.899 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-01T22:33:29.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.010+0000 7fe2ac298640 1 Processor -- start 2024-04-01T22:33:29.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.010+0000 7fe2ac298640 1 -- start start 2024-04-01T22:33:29.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.011+0000 7fe2ac298640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe2a40ca510 0x7fe2a40ca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:29.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.011+0000 7fe2ac298640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe2a40c8530 0x7fe2a406f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:29.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.011+0000 7fe2ac298640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2a40c9be0 con 0x7fe2a40c8bf0 2024-04-01T22:33:29.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.011+0000 7fe2ac298640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fe2a4154b30 con 0x7fe2a40c8530 2024-04-01T22:33:29.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.011+0000 7fe2ac298640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fe2a406ef00 con 0x7fe2a40ca510 2024-04-01T22:33:29.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.012+0000 7fe2aa034640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe2a40ca510 0x7fe2a40ca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:29.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.012+0000 7fe2aa034640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe2a40ca510 0x7fe2a40ca8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:33546/0 (socket says 172.21.15.47:33546) 2024-04-01T22:33:29.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.012+0000 7fe2aa034640 1 -- 172.21.15.47:0/4165697540 learned_addr learned my addr 172.21.15.47:0/4165697540 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:29.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.016+0000 7fe2aa034640 1 -- 172.21.15.47:0/4165697540 >> v2:172.21.15.47:3300/0 conn(0x7fe2a40c8530 msgr2=0x7fe2a406f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:29.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.016+0000 7fe2aa034640 1 --2- 172.21.15.47:0/4165697540 >> v2:172.21.15.47:3300/0 conn(0x7fe2a40c8530 0x7fe2a406f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:29.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.016+0000 7fe2aa034640 1 -- 172.21.15.47:0/4165697540 >> v1:172.21.15.47:6789/0 conn(0x7fe2a40c8bf0 legacy=0x7fe2a415d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:29.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.016+0000 7fe2aa034640 1 -- 172.21.15.47:0/4165697540 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2a415af80 con 0x7fe2a40ca510 2024-04-01T22:33:29.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.018+0000 7fe2aa034640 1 --2- 172.21.15.47:0/4165697540 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe2a40ca510 0x7fe2a40ca8f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0009870 tx=0x7fe2a002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d25ff7f3eba2f0d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:29.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.021+0000 7fe2a9032640 1 -- 172.21.15.47:0/4165697540 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a0035020 con 0x7fe2a40ca510 2024-04-01T22:33:29.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.021+0000 7fe2a9032640 1 -- 172.21.15.47:0/4165697540 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2a0031640 con 0x7fe2a40ca510 2024-04-01T22:33:29.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.021+0000 7fe2a9032640 1 -- 172.21.15.47:0/4165697540 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a002d040 con 0x7fe2a40ca510 2024-04-01T22:33:29.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.022+0000 7fe2ac298640 1 -- 172.21.15.47:0/4165697540 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe2a40ca510 msgr2=0x7fe2a40ca8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:29.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.022+0000 7fe2ac298640 1 --2- 172.21.15.47:0/4165697540 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe2a40ca510 0x7fe2a40ca8f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0009870 tx=0x7fe2a002b8f0 comp rx=0 tx=0).stop 2024-04-01T22:33:29.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.022+0000 7fe2ac298640 1 -- 172.21.15.47:0/4165697540 shutdown_connections 2024-04-01T22:33:29.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.022+0000 7fe2ac298640 1 --2- 172.21.15.47:0/4165697540 >> v2:172.21.15.47:3300/0 conn(0x7fe2a40c8530 0x7fe2a406f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:29.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.022+0000 7fe2ac298640 1 --2- 172.21.15.47:0/4165697540 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe2a40ca510 0x7fe2a40ca8f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:29.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.022+0000 7fe2ac298640 1 -- 172.21.15.47:0/4165697540 >> 172.21.15.47:0/4165697540 conn(0x7fe2a4071290 msgr2=0x7fe2a40716a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:29.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.023+0000 7fe2ac298640 1 -- 172.21.15.47:0/4165697540 shutdown_connections 2024-04-01T22:33:29.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.023+0000 7fe2ac298640 1 -- 172.21.15.47:0/4165697540 wait complete. 2024-04-01T22:33:29.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.024+0000 7fe2ac298640 1 Processor -- start 2024-04-01T22:33:29.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.024+0000 7fe2ac298640 1 -- start start 2024-04-01T22:33:29.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.026+0000 7fe2ac298640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2a40c8530 0x7fe2a41482f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:29.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.026+0000 7fe2ac298640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe2a40c8bf0 0x7fe2a4148830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:29.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.026+0000 7fe2ac298640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe2a40ca510 0x7fe2a40c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:29.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.026+0000 7fe2ac298640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a415b260 con 0x7fe2a40c8530 2024-04-01T22:33:29.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.026+0000 7fe2ac298640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a40ca160 con 0x7fe2a40c8bf0 2024-04-01T22:33:29.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.026+0000 7fe2ac298640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fe2a40c95f0 con 0x7fe2a40ca510 2024-04-01T22:33:29.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.026+0000 7fe2aa835640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe2a40ca510 0x7fe2a40c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:29.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.027+0000 7fe2aa835640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe2a40ca510 0x7fe2a40c5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:33558/0 (socket says 172.21.15.47:33558) 2024-04-01T22:33:29.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.027+0000 7fe2aa835640 1 -- 172.21.15.47:0/644852416 learned_addr learned my addr 172.21.15.47:0/644852416 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:29.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.030+0000 7fe2aa835640 1 -- 172.21.15.47:0/644852416 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe2a40c8bf0 msgr2=0x7fe2a4148830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:29.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.030+0000 7fe2aa835640 1 --2- 172.21.15.47:0/644852416 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe2a40c8bf0 0x7fe2a4148830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:29.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.030+0000 7fe2aa835640 1 -- 172.21.15.47:0/644852416 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2a40c8530 msgr2=0x7fe2a41482f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:29.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.030+0000 7fe2aa835640 1 --2- 172.21.15.47:0/644852416 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2a40c8530 0x7fe2a41482f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:29.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.030+0000 7fe2aa835640 1 -- 172.21.15.47:0/644852416 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2a40af9b0 con 0x7fe2a40ca510 2024-04-01T22:33:29.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.032+0000 7fe2aa835640 1 --2- 172.21.15.47:0/644852416 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe2a40ca510 0x7fe2a40c5f30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe29c00c780 tx=0x7fe29c00cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:29.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.036+0000 7fe29affd640 1 -- 172.21.15.47:0/644852416 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe29c017070 con 0x7fe2a40ca510 2024-04-01T22:33:29.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.036+0000 7fe29affd640 1 -- 172.21.15.47:0/644852416 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe29c003da0 con 0x7fe2a40ca510 2024-04-01T22:33:29.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.036+0000 7fe29affd640 1 -- 172.21.15.47:0/644852416 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe29c0052b0 con 0x7fe2a40ca510 2024-04-01T22:33:29.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.036+0000 7fe2ac298640 1 -- 172.21.15.47:0/644852416 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2a40afc90 con 0x7fe2a40ca510 2024-04-01T22:33:29.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.036+0000 7fe2ac298640 1 -- 172.21.15.47:0/644852416 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2a40b0250 con 0x7fe2a40ca510 2024-04-01T22:33:29.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.037+0000 7fe2ac298640 1 -- 172.21.15.47:0/644852416 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2a4068920 con 0x7fe2a40ca510 2024-04-01T22:33:29.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.056+0000 7fe29affd640 1 -- 172.21.15.47:0/644852416 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7fe29c006b10 con 0x7fe2a40ca510 2024-04-01T22:33:29.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.056+0000 7fe29affd640 1 --2- 172.21.15.47:0/644852416 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fe28806b990 0x7fe28806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:29.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.056+0000 7fe2aa034640 1 --2- 172.21.15.47:0/644852416 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fe28806b990 0x7fe28806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:29.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.056+0000 7fe2aa034640 1 --2- 172.21.15.47:0/644852416 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fe28806b990 0x7fe28806de50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0036000 tx=0x7fe2a0030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:29.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.058+0000 7fe29affd640 1 -- 172.21.15.47:0/644852416 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 6007+0+0 (secure 0 0 0) 0x7fe29c006e00 con 0x7fe2a40ca510 2024-04-01T22:33:29.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.306+0000 7fe29affd640 1 -- 172.21.15.47:0/644852416 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fe29c020080 con 0x7fe2a40ca510 2024-04-01T22:33:29.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:29.500+0000 7fe2ac298640 1 -- 172.21.15.47:0/644852416 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fe2a406c7f0 con 0x7fe2a40ca510 2024-04-01T22:33:31.178 INFO:tasks.ceph.mds.e.smithi047.stderr:2024-04-01T22:33:31.174+0000 f5f3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-01T22:33:31.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.755+0000 7fe29affd640 1 -- 172.21.15.47:0/644852416 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) ==== 228+0+0 (secure 0 0 0) 0x7fe29c058c80 con 0x7fe2a40ca510 2024-04-01T22:33:31.755 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_data_ec' created 2024-04-01T22:33:31.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.757+0000 7fe2ac298640 1 -- 172.21.15.47:0/644852416 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fe28806b990 msgr2=0x7fe28806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:31.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.757+0000 7fe2ac298640 1 --2- 172.21.15.47:0/644852416 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fe28806b990 0x7fe28806de50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0036000 tx=0x7fe2a0030000 comp rx=0 tx=0).stop 2024-04-01T22:33:31.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.757+0000 7fe2ac298640 1 -- 172.21.15.47:0/644852416 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe2a40ca510 msgr2=0x7fe2a40c5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:31.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.757+0000 7fe2ac298640 1 --2- 172.21.15.47:0/644852416 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe2a40ca510 0x7fe2a40c5f30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe29c00c780 tx=0x7fe29c00cc40 comp rx=0 tx=0).stop 2024-04-01T22:33:31.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.757+0000 7fe2ac298640 1 -- 172.21.15.47:0/644852416 shutdown_connections 2024-04-01T22:33:31.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.757+0000 7fe2ac298640 1 --2- 172.21.15.47:0/644852416 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fe28806b990 0x7fe28806de50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:31.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.757+0000 7fe2ac298640 1 --2- 172.21.15.47:0/644852416 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fe2a40ca510 0x7fe2a40c5f30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:31.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.757+0000 7fe2ac298640 1 --2- 172.21.15.47:0/644852416 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe2a40c8bf0 0x7fe2a4148830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:31.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.757+0000 7fe2ac298640 1 --2- 172.21.15.47:0/644852416 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2a40c8530 0x7fe2a41482f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:31.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.757+0000 7fe2ac298640 1 -- 172.21.15.47:0/644852416 >> 172.21.15.47:0/644852416 conn(0x7fe2a4071290 msgr2=0x7fe2a414fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:31.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.757+0000 7fe2ac298640 1 -- 172.21.15.47:0/644852416 shutdown_connections 2024-04-01T22:33:31.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.757+0000 7fe2ac298640 1 -- 172.21.15.47:0/644852416 wait complete. 2024-04-01T22:33:31.767 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-01T22:33:31.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.874+0000 7f9620ba1640 1 Processor -- start 2024-04-01T22:33:31.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.874+0000 7f9620ba1640 1 -- start start 2024-04-01T22:33:31.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.875+0000 7f9620ba1640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f961c071470 0x7f961c158c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:31.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.875+0000 7f9620ba1640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f961c0c8560 0x7f961c151db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:31.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.875+0000 7f9620ba1640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f961c15c6a0 con 0x7f961c071850 2024-04-01T22:33:31.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.875+0000 7f9620ba1640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f961c159170 con 0x7f961c071470 2024-04-01T22:33:31.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.875+0000 7f9620ba1640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f961c15b840 con 0x7f961c0c8560 2024-04-01T22:33:31.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.875+0000 7f961a59c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f961c071470 0x7f961c158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:31.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.876+0000 7f9613fff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f961c0c8560 0x7f961c151db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:31.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.876+0000 7f961a59c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f961c071470 0x7f961c158c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54102/0 (socket says 172.21.15.47:54102) 2024-04-01T22:33:31.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.876+0000 7f961a59c640 1 -- 172.21.15.47:0/871658398 learned_addr learned my addr 172.21.15.47:0/871658398 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:31.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.878+0000 7f961a59c640 1 -- 172.21.15.47:0/871658398 >> v2:172.21.15.181:3300/0 conn(0x7f961c0c8560 msgr2=0x7f961c151db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:31.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.878+0000 7f961a59c640 1 --2- 172.21.15.47:0/871658398 >> v2:172.21.15.181:3300/0 conn(0x7f961c0c8560 0x7f961c151db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:31.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.878+0000 7f961a59c640 1 -- 172.21.15.47:0/871658398 >> v1:172.21.15.181:6789/0 conn(0x7f961c071850 legacy=0x7f961c0c2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:31.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.878+0000 7f961a59c640 1 -- 172.21.15.47:0/871658398 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f961c15bb20 con 0x7f961c071470 2024-04-01T22:33:31.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.880+0000 7f961a59c640 1 --2- 172.21.15.47:0/871658398 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f961c071470 0x7f961c158c30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f961c070180 tx=0x7f960c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5ca4cd891d0ce56 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:31.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.883+0000 7f9619d9b640 1 -- 172.21.15.47:0/871658398 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f960c034070 con 0x7f961c071470 2024-04-01T22:33:31.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.883+0000 7f9619d9b640 1 -- 172.21.15.47:0/871658398 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f960c030860 con 0x7f961c071470 2024-04-01T22:33:31.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.883+0000 7f9619d9b640 1 -- 172.21.15.47:0/871658398 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f960c030c30 con 0x7f961c071470 2024-04-01T22:33:31.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.884+0000 7f9620ba1640 1 -- 172.21.15.47:0/871658398 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f961c071470 msgr2=0x7f961c158c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:31.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.884+0000 7f9620ba1640 1 --2- 172.21.15.47:0/871658398 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f961c071470 0x7f961c158c30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f961c070180 tx=0x7f960c02b9a0 comp rx=0 tx=0).stop 2024-04-01T22:33:31.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.884+0000 7f9620ba1640 1 -- 172.21.15.47:0/871658398 shutdown_connections 2024-04-01T22:33:31.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.884+0000 7f9620ba1640 1 --2- 172.21.15.47:0/871658398 >> v2:172.21.15.181:3300/0 conn(0x7f961c0c8560 0x7f961c151db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:31.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.884+0000 7f9620ba1640 1 --2- 172.21.15.47:0/871658398 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f961c071470 0x7f961c158c30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:31.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.884+0000 7f9620ba1640 1 -- 172.21.15.47:0/871658398 >> 172.21.15.47:0/871658398 conn(0x7f961c06b500 msgr2=0x7f961c06f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:31.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.884+0000 7f9620ba1640 1 -- 172.21.15.47:0/871658398 shutdown_connections 2024-04-01T22:33:31.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.884+0000 7f9620ba1640 1 -- 172.21.15.47:0/871658398 wait complete. 2024-04-01T22:33:31.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.886+0000 7f9620ba1640 1 Processor -- start 2024-04-01T22:33:31.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.886+0000 7f9620ba1640 1 -- start start 2024-04-01T22:33:31.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.886+0000 7f9620ba1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f961c071470 0x7f961c1f2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:31.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.886+0000 7f9620ba1640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f961c071850 0x7f961c0b2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:31.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.886+0000 7f9620ba1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f961c0c8560 0x7f961c146390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:31.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.886+0000 7f9620ba1640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f961c15c3c0 con 0x7f961c0c8560 2024-04-01T22:33:31.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.886+0000 7f9620ba1640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f961c15c0e0 con 0x7f961c071470 2024-04-01T22:33:31.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.886+0000 7f9620ba1640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f961c0c3500 con 0x7f961c071850 2024-04-01T22:33:31.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.887+0000 7f961ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f961c0c8560 0x7f961c146390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:31.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.887+0000 7f961a59c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f961c071470 0x7f961c1f2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:31.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.887+0000 7f961ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f961c0c8560 0x7f961c146390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54112/0 (socket says 172.21.15.47:54112) 2024-04-01T22:33:31.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.887+0000 7f961ad9d640 1 -- 172.21.15.47:0/1808025161 learned_addr learned my addr 172.21.15.47:0/1808025161 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:31.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.887+0000 7f9613fff640 1 --2- 172.21.15.47:0/1808025161 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f961c071850 0x7f961c0b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:31.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.890+0000 7f961ad9d640 1 -- 172.21.15.47:0/1808025161 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f961c071850 msgr2=0x7f961c0b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:31.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.890+0000 7f961ad9d640 1 --2- 172.21.15.47:0/1808025161 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f961c071850 0x7f961c0b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:31.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.890+0000 7f961ad9d640 1 -- 172.21.15.47:0/1808025161 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f961c071470 msgr2=0x7f961c1f2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:31.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.890+0000 7f961ad9d640 1 --2- 172.21.15.47:0/1808025161 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f961c071470 0x7f961c1f2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:31.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.890+0000 7f961ad9d640 1 -- 172.21.15.47:0/1808025161 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f961c145890 con 0x7f961c0c8560 2024-04-01T22:33:31.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.893+0000 7f961ad9d640 1 --2- 172.21.15.47:0/1808025161 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f961c0c8560 0x7f961c146390 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f961400c760 tx=0x7f961400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:31.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.896+0000 7f9612ffd640 1 -- 172.21.15.47:0/1808025161 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9614003b70 con 0x7f961c0c8560 2024-04-01T22:33:31.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.896+0000 7f9612ffd640 1 -- 172.21.15.47:0/1808025161 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9614003d10 con 0x7f961c0c8560 2024-04-01T22:33:31.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.896+0000 7f9620ba1640 1 -- 172.21.15.47:0/1808025161 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f961c15b560 con 0x7f961c0c8560 2024-04-01T22:33:31.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.896+0000 7f9612ffd640 1 -- 172.21.15.47:0/1808025161 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f961400aa90 con 0x7f961c0c8560 2024-04-01T22:33:31.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.896+0000 7f9620ba1640 1 -- 172.21.15.47:0/1808025161 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f961c1455b0 con 0x7f961c0c8560 2024-04-01T22:33:31.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.897+0000 7f9620ba1640 1 -- 172.21.15.47:0/1808025161 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f961c0c40a0 con 0x7f961c0c8560 2024-04-01T22:33:31.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.916+0000 7f9612ffd640 1 -- 172.21.15.47:0/1808025161 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f961400ac30 con 0x7f961c0c8560 2024-04-01T22:33:31.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.916+0000 7f9612ffd640 1 --2- 172.21.15.47:0/1808025161 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f95fc06b9e0 0x7f95fc06dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:31.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.917+0000 7f961a59c640 1 --2- 172.21.15.47:0/1808025161 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f95fc06b9e0 0x7f95fc06dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:31.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.917+0000 7f961a59c640 1 --2- 172.21.15.47:0/1808025161 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f95fc06b9e0 0x7f95fc06dea0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f960c036000 tx=0x7f960c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:31.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:31.920+0000 7f9612ffd640 1 -- 172.21.15.47:0/1808025161 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7f96140576e0 con 0x7f961c0c8560 2024-04-01T22:33:32.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.194+0000 7f9612ffd640 1 -- 172.21.15.47:0/1808025161 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f961c0c40a0 con 0x7f961c0c8560 2024-04-01T22:33:32.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.380+0000 7f9620ba1640 1 -- 172.21.15.47:0/1808025161 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f961c0cbf00 con 0x7f961c0c8560 2024-04-01T22:33:32.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.756+0000 7f9612ffd640 1 -- 172.21.15.47:0/1808025161 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) ==== 169+0+0 (secure 0 0 0) 0x7f961c0cbf00 con 0x7f961c0c8560 2024-04-01T22:33:32.756 INFO:teuthology.orchestra.run.smithi047.stderr:set pool 4 allow_ec_overwrites to true 2024-04-01T22:33:32.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.758+0000 7f9620ba1640 1 -- 172.21.15.47:0/1808025161 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f95fc06b9e0 msgr2=0x7f95fc06dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:32.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.758+0000 7f9620ba1640 1 --2- 172.21.15.47:0/1808025161 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f95fc06b9e0 0x7f95fc06dea0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f960c036000 tx=0x7f960c008030 comp rx=0 tx=0).stop 2024-04-01T22:33:32.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.758+0000 7f9620ba1640 1 -- 172.21.15.47:0/1808025161 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f961c0c8560 msgr2=0x7f961c146390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:32.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.758+0000 7f9620ba1640 1 --2- 172.21.15.47:0/1808025161 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f961c0c8560 0x7f961c146390 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f961400c760 tx=0x7f961400cc20 comp rx=0 tx=0).stop 2024-04-01T22:33:32.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.758+0000 7f9620ba1640 1 -- 172.21.15.47:0/1808025161 shutdown_connections 2024-04-01T22:33:32.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.758+0000 7f9620ba1640 1 --2- 172.21.15.47:0/1808025161 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f95fc06b9e0 0x7f95fc06dea0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:32.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.758+0000 7f9620ba1640 1 --2- 172.21.15.47:0/1808025161 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f961c0c8560 0x7f961c146390 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:32.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.758+0000 7f9620ba1640 1 --2- 172.21.15.47:0/1808025161 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f961c071850 0x7f961c0b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:32.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.758+0000 7f9620ba1640 1 --2- 172.21.15.47:0/1808025161 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f961c071470 0x7f961c1f2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:32.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.758+0000 7f9620ba1640 1 -- 172.21.15.47:0/1808025161 >> 172.21.15.47:0/1808025161 conn(0x7f961c06b500 msgr2=0x7f961c151b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:32.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.758+0000 7f9620ba1640 1 -- 172.21.15.47:0/1808025161 shutdown_connections 2024-04-01T22:33:32.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.758+0000 7f9620ba1640 1 -- 172.21.15.47:0/1808025161 wait complete. 2024-04-01T22:33:32.772 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-01T22:33:32.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.900+0000 7f3b17a15640 1 Processor -- start 2024-04-01T22:33:32.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.901+0000 7f3b17a15640 1 -- start start 2024-04-01T22:33:32.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.901+0000 7f3b17a15640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3b10154400 0x7f3b1015a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:32.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.901+0000 7f3b17a15640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3b10072df0 0x7f3b10073210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:32.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.901+0000 7f3b17a15640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3b100ad8c0 0x7f3b100add30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:32.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.901+0000 7f3b17a15640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f3b10073750 con 0x7f3b10072df0 2024-04-01T22:33:32.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.901+0000 7f3b17a15640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f3b1015ab90 con 0x7f3b100ad8c0 2024-04-01T22:33:32.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.901+0000 7f3b17a15640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f3b1015ae70 con 0x7f3b10154400 2024-04-01T22:33:32.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.902+0000 7f3b15fb2640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3b100ad8c0 0x7f3b100add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:32.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.902+0000 7f3b15fb2640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3b100ad8c0 0x7f3b100add30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:50924/0 (socket says 172.21.15.47:50924) 2024-04-01T22:33:32.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.902+0000 7f3b15fb2640 1 -- 172.21.15.47:0/2122135520 learned_addr learned my addr 172.21.15.47:0/2122135520 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:32.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.903+0000 7f3b157b1640 1 --2- 172.21.15.47:0/2122135520 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3b10154400 0x7f3b1015a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:32.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.904+0000 7f3b15fb2640 1 -- 172.21.15.47:0/2122135520 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3b10154400 msgr2=0x7f3b1015a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:32.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.904+0000 7f3b15fb2640 1 --2- 172.21.15.47:0/2122135520 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3b10154400 0x7f3b1015a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:32.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.904+0000 7f3b15fb2640 1 -- 172.21.15.47:0/2122135520 >> v2:172.21.15.47:3300/0 conn(0x7f3b10072df0 msgr2=0x7f3b10073210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:32.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.904+0000 7f3b15fb2640 1 --2- 172.21.15.47:0/2122135520 >> v2:172.21.15.47:3300/0 conn(0x7f3b10072df0 0x7f3b10073210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:32.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.905+0000 7f3b15fb2640 1 -- 172.21.15.47:0/2122135520 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b1015b150 con 0x7f3b100ad8c0 2024-04-01T22:33:32.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.906+0000 7f3b15fb2640 1 --2- 172.21.15.47:0/2122135520 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b100ad8c0 0x7f3b100add30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3b10062bf0 tx=0x7f3b0802bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b53b5f5b44f82a0a server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:32.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.920+0000 7f3b07fff640 1 -- 172.21.15.47:0/2122135520 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b0802cb00 con 0x7f3b100ad8c0 2024-04-01T22:33:32.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.920+0000 7f3b07fff640 1 -- 172.21.15.47:0/2122135520 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b0802cca0 con 0x7f3b100ad8c0 2024-04-01T22:33:32.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.920+0000 7f3b07fff640 1 -- 172.21.15.47:0/2122135520 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b08034610 con 0x7f3b100ad8c0 2024-04-01T22:33:32.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.920+0000 7f3b17a15640 1 -- 172.21.15.47:0/2122135520 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b100ad8c0 msgr2=0x7f3b100add30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:32.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.920+0000 7f3b17a15640 1 --2- 172.21.15.47:0/2122135520 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b100ad8c0 0x7f3b100add30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3b10062bf0 tx=0x7f3b0802bf60 comp rx=0 tx=0).stop 2024-04-01T22:33:32.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.920+0000 7f3b17a15640 1 -- 172.21.15.47:0/2122135520 shutdown_connections 2024-04-01T22:33:32.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.920+0000 7f3b17a15640 1 --2- 172.21.15.47:0/2122135520 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b100ad8c0 0x7f3b100add30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:32.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.920+0000 7f3b17a15640 1 --2- 172.21.15.47:0/2122135520 >> v2:172.21.15.47:3300/0 conn(0x7f3b10072df0 0x7f3b10073210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:32.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.920+0000 7f3b17a15640 1 --2- 172.21.15.47:0/2122135520 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3b10154400 0x7f3b1015a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:32.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.920+0000 7f3b17a15640 1 -- 172.21.15.47:0/2122135520 >> 172.21.15.47:0/2122135520 conn(0x7f3b100c8bf0 msgr2=0x7f3b100c8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:32.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.920+0000 7f3b17a15640 1 -- 172.21.15.47:0/2122135520 shutdown_connections 2024-04-01T22:33:32.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.921+0000 7f3b17a15640 1 -- 172.21.15.47:0/2122135520 wait complete. 2024-04-01T22:33:32.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.922+0000 7f3b17a15640 1 Processor -- start 2024-04-01T22:33:32.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.922+0000 7f3b17a15640 1 -- start start 2024-04-01T22:33:32.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.922+0000 7f3b17a15640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3b10072df0 0x7f3b1014bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:32.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.922+0000 7f3b17a15640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b100ad8c0 0x7f3b1014b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:32.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.922+0000 7f3b17a15640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b10154400 0x7f3b100ca560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:32.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.922+0000 7f3b17a15640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3b100728d0 con 0x7f3b10154400 2024-04-01T22:33:32.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.922+0000 7f3b17a15640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3b100725f0 con 0x7f3b100ad8c0 2024-04-01T22:33:32.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.922+0000 7f3b17a15640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f3b10062150 con 0x7f3b10072df0 2024-04-01T22:33:32.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.923+0000 7f3b157b1640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3b10072df0 0x7f3b1014bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:32.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.923+0000 7f3b157b1640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3b10072df0 0x7f3b1014bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:51210/0 (socket says 172.21.15.47:51210) 2024-04-01T22:33:32.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.923+0000 7f3b157b1640 1 -- 172.21.15.47:0/3908234992 learned_addr learned my addr 172.21.15.47:0/3908234992 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:32.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.924+0000 7f3b14fb0640 1 --2- 172.21.15.47:0/3908234992 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b100ad8c0 0x7f3b1014b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:32.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.926+0000 7f3b157b1640 1 -- 172.21.15.47:0/3908234992 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b100ad8c0 msgr2=0x7f3b1014b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:32.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.926+0000 7f3b157b1640 1 --2- 172.21.15.47:0/3908234992 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b100ad8c0 0x7f3b1014b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:32.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.926+0000 7f3b157b1640 1 -- 172.21.15.47:0/3908234992 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b10154400 msgr2=0x7f3b100ca560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:32.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.926+0000 7f3b157b1640 1 --2- 172.21.15.47:0/3908234992 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b10154400 0x7f3b100ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:32.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.926+0000 7f3b157b1640 1 -- 172.21.15.47:0/3908234992 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b1014c290 con 0x7f3b10072df0 2024-04-01T22:33:32.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.929+0000 7f3b157b1640 1 --2- 172.21.15.47:0/3908234992 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3b10072df0 0x7f3b1014bcd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c00d830 tx=0x7f3b0c00dcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:32.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.932+0000 7f3b05ffb640 1 -- 172.21.15.47:0/3908234992 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c00b6c0 con 0x7f3b10072df0 2024-04-01T22:33:32.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.932+0000 7f3b05ffb640 1 -- 172.21.15.47:0/3908234992 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b0c019070 con 0x7f3b10072df0 2024-04-01T22:33:32.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.932+0000 7f3b17a15640 1 -- 172.21.15.47:0/3908234992 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b100af1b0 con 0x7f3b10072df0 2024-04-01T22:33:32.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.932+0000 7f3b05ffb640 1 -- 172.21.15.47:0/3908234992 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c00ba80 con 0x7f3b10072df0 2024-04-01T22:33:32.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.932+0000 7f3b17a15640 1 -- 172.21.15.47:0/3908234992 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b101f0200 con 0x7f3b10072df0 2024-04-01T22:33:32.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.933+0000 7f3b17a15640 1 -- 172.21.15.47:0/3908234992 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b101547e0 con 0x7f3b10072df0 2024-04-01T22:33:32.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.951+0000 7f3b05ffb640 1 -- 172.21.15.47:0/3908234992 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f3b0c01e460 con 0x7f3b10072df0 2024-04-01T22:33:32.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.951+0000 7f3b05ffb640 1 --2- 172.21.15.47:0/3908234992 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f3af406ba10 0x7f3af406ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:32.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.951+0000 7f3b14fb0640 1 --2- 172.21.15.47:0/3908234992 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f3af406ba10 0x7f3af406ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:32.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.952+0000 7f3b14fb0640 1 --2- 172.21.15.47:0/3908234992 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f3af406ba10 0x7f3af406ded0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3b101f0d00 tx=0x7f3b00009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:32.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:32.953+0000 7f3b05ffb640 1 -- 172.21.15.47:0/3908234992 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7f3b0c015e00 con 0x7f3b10072df0 2024-04-01T22:33:33.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:33.190+0000 7f3b05ffb640 1 -- 172.21.15.47:0/3908234992 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f3b101547e0 con 0x7f3b10072df0 2024-04-01T22:33:33.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:33.424+0000 7f3b17a15640 1 -- 172.21.15.47:0/3908234992 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f3b1006c940 con 0x7f3b10072df0 2024-04-01T22:33:34.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.011+0000 7f3b05ffb640 1 -- 172.21.15.47:0/3908234992 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v6) ==== 137+0+0 (secure 0 0 0) 0x7f3b0c05d0b0 con 0x7f3b10072df0 2024-04-01T22:33:34.011 INFO:teuthology.orchestra.run.smithi047.stderr:added data pool 4 to fsmap 2024-04-01T22:33:34.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.013+0000 7f3b17a15640 1 -- 172.21.15.47:0/3908234992 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f3af406ba10 msgr2=0x7f3af406ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:34.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.013+0000 7f3b17a15640 1 --2- 172.21.15.47:0/3908234992 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f3af406ba10 0x7f3af406ded0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3b101f0d00 tx=0x7f3b00009060 comp rx=0 tx=0).stop 2024-04-01T22:33:34.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.013+0000 7f3b17a15640 1 -- 172.21.15.47:0/3908234992 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3b10072df0 msgr2=0x7f3b1014bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:34.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.013+0000 7f3b17a15640 1 --2- 172.21.15.47:0/3908234992 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3b10072df0 0x7f3b1014bcd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c00d830 tx=0x7f3b0c00dcf0 comp rx=0 tx=0).stop 2024-04-01T22:33:34.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.013+0000 7f3b17a15640 1 -- 172.21.15.47:0/3908234992 shutdown_connections 2024-04-01T22:33:34.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.013+0000 7f3b17a15640 1 --2- 172.21.15.47:0/3908234992 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f3af406ba10 0x7f3af406ded0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:34.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.013+0000 7f3b17a15640 1 --2- 172.21.15.47:0/3908234992 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b10154400 0x7f3b100ca560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:34.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.013+0000 7f3b17a15640 1 --2- 172.21.15.47:0/3908234992 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b100ad8c0 0x7f3b1014b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:34.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.013+0000 7f3b17a15640 1 --2- 172.21.15.47:0/3908234992 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3b10072df0 0x7f3b1014bcd0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:34.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.013+0000 7f3b17a15640 1 -- 172.21.15.47:0/3908234992 >> 172.21.15.47:0/3908234992 conn(0x7f3b100c8bf0 msgr2=0x7f3b100adca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:34.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.013+0000 7f3b17a15640 1 -- 172.21.15.47:0/3908234992 shutdown_connections 2024-04-01T22:33:34.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.013+0000 7f3b17a15640 1 -- 172.21.15.47:0/3908234992 wait complete. 2024-04-01T22:33:34.024 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T22:33:34.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.126+0000 7f6d86f01640 1 Processor -- start 2024-04-01T22:33:34.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.126+0000 7f6d86f01640 1 -- start start 2024-04-01T22:33:34.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.127+0000 7f6d86f01640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6d8015aec0 0x7f6d8006c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:34.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.127+0000 7f6d86f01640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6d8015bb20 0x7f6d8015bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:34.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.127+0000 7f6d86f01640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d80154b70 con 0x7f6d8006c250 2024-04-01T22:33:34.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.127+0000 7f6d86f01640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f6d800ce990 con 0x7f6d8015aec0 2024-04-01T22:33:34.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.127+0000 7f6d86f01640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6d800cdac0 con 0x7f6d8015bb20 2024-04-01T22:33:34.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.127+0000 7f6d84c9d640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f6d8006c250 0x7f6d800ceb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:47396/0 (socket says 172.21.15.47:47396) 2024-04-01T22:33:34.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.127+0000 7f6d84c9d640 1 -- 172.21.15.47:0/2551544119 learned_addr learned my addr 172.21.15.47:0/2551544119 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T22:33:34.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.127+0000 7f6d8549e640 1 --2- 172.21.15.47:0/2551544119 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6d8015bb20 0x7f6d8015bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:34.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.127+0000 7f6d7ffff640 1 --2- 172.21.15.47:0/2551544119 >> v2:172.21.15.181:3300/0 conn(0x7f6d8015aec0 0x7f6d8006c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:34.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.130+0000 7f6d7ffff640 1 -- 172.21.15.47:0/2551544119 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6d8015bb20 msgr2=0x7f6d8015bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:34.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.130+0000 7f6d7ffff640 1 --2- 172.21.15.47:0/2551544119 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6d8015bb20 0x7f6d8015bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:34.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.130+0000 7f6d7ffff640 1 -- 172.21.15.47:0/2551544119 >> v1:172.21.15.47:6789/0 conn(0x7f6d8006c250 legacy=0x7f6d800ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:34.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.130+0000 7f6d7ffff640 1 -- 172.21.15.47:0/2551544119 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d800cf2a0 con 0x7f6d8015aec0 2024-04-01T22:33:34.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.132+0000 7f6d7ffff640 1 --2- 172.21.15.47:0/2551544119 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6d8015aec0 0x7f6d8006c630 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c0097a0 tx=0x7f6d6c02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5d47f61cc9fc6a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:34.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.135+0000 7f6d7f7fe640 1 -- 172.21.15.47:0/2551544119 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c034070 con 0x7f6d8015aec0 2024-04-01T22:33:34.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.135+0000 7f6d7f7fe640 1 -- 172.21.15.47:0/2551544119 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d6c030610 con 0x7f6d8015aec0 2024-04-01T22:33:34.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.135+0000 7f6d7f7fe640 1 -- 172.21.15.47:0/2551544119 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c0309e0 con 0x7f6d8015aec0 2024-04-01T22:33:34.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.136+0000 7f6d86f01640 1 -- 172.21.15.47:0/2551544119 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6d8015aec0 msgr2=0x7f6d8006c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:34.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.136+0000 7f6d86f01640 1 --2- 172.21.15.47:0/2551544119 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6d8015aec0 0x7f6d8006c630 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c0097a0 tx=0x7f6d6c02b960 comp rx=0 tx=0).stop 2024-04-01T22:33:34.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.136+0000 7f6d86f01640 1 -- 172.21.15.47:0/2551544119 shutdown_connections 2024-04-01T22:33:34.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.136+0000 7f6d86f01640 1 --2- 172.21.15.47:0/2551544119 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6d8015aec0 0x7f6d8006c630 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:34.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.136+0000 7f6d86f01640 1 --2- 172.21.15.47:0/2551544119 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6d8015bb20 0x7f6d8015bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:34.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.136+0000 7f6d86f01640 1 -- 172.21.15.47:0/2551544119 >> 172.21.15.47:0/2551544119 conn(0x7f6d800cfdb0 msgr2=0x7f6d800d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:34.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.136+0000 7f6d86f01640 1 -- 172.21.15.47:0/2551544119 shutdown_connections 2024-04-01T22:33:34.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.136+0000 7f6d86f01640 1 -- 172.21.15.47:0/2551544119 wait complete. 2024-04-01T22:33:34.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.137+0000 7f6d86f01640 1 Processor -- start 2024-04-01T22:33:34.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.137+0000 7f6d86f01640 1 -- start start 2024-04-01T22:33:34.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.138+0000 7f6d86f01640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d8006c250 0x7f6d800b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:34.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.138+0000 7f6d86f01640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6d8015aec0 0x7f6d800b27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:34.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.138+0000 7f6d86f01640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6d8015bb20 0x7f6d800b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:34.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.138+0000 7f6d86f01640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6d800ce060 con 0x7f6d8006c250 2024-04-01T22:33:34.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.138+0000 7f6d86f01640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6d800cdd80 con 0x7f6d8015aec0 2024-04-01T22:33:34.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.138+0000 7f6d86f01640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6d800ce340 con 0x7f6d8015bb20 2024-04-01T22:33:34.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.139+0000 7f6d84c9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d8006c250 0x7f6d800b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:34.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.139+0000 7f6d7ffff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6d8015aec0 0x7f6d800b27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:34.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.139+0000 7f6d8549e640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6d8015bb20 0x7f6d800b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:34.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.139+0000 7f6d84c9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d8006c250 0x7f6d800b1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54148/0 (socket says 172.21.15.47:54148) 2024-04-01T22:33:34.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.139+0000 7f6d84c9d640 1 -- 172.21.15.47:0/2053329024 learned_addr learned my addr 172.21.15.47:0/2053329024 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:34.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.142+0000 7f6d84c9d640 1 -- 172.21.15.47:0/2053329024 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6d8015bb20 msgr2=0x7f6d800b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:34.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.142+0000 7f6d84c9d640 1 --2- 172.21.15.47:0/2053329024 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6d8015bb20 0x7f6d800b2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:34.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.142+0000 7f6d84c9d640 1 -- 172.21.15.47:0/2053329024 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6d8015aec0 msgr2=0x7f6d800b27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:34.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.142+0000 7f6d84c9d640 1 --2- 172.21.15.47:0/2053329024 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6d8015aec0 0x7f6d800b27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:34.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.142+0000 7f6d84c9d640 1 -- 172.21.15.47:0/2053329024 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d800689b0 con 0x7f6d8006c250 2024-04-01T22:33:34.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.142+0000 7f6d8549e640 1 --2- 172.21.15.47:0/2053329024 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6d8015bb20 0x7f6d800b2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T22:33:34.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.142+0000 7f6d7ffff640 1 --2- 172.21.15.47:0/2053329024 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6d8015aec0 0x7f6d800b27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T22:33:34.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.145+0000 7f6d84c9d640 1 --2- 172.21.15.47:0/2053329024 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d8006c250 0x7f6d800b1e80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6d7400c400 tx=0x7f6d7400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:34.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.148+0000 7f6d7d7fa640 1 -- 172.21.15.47:0/2053329024 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d74017070 con 0x7f6d8006c250 2024-04-01T22:33:34.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.148+0000 7f6d7d7fa640 1 -- 172.21.15.47:0/2053329024 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d74005ce0 con 0x7f6d8006c250 2024-04-01T22:33:34.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.149+0000 7f6d7d7fa640 1 -- 172.21.15.47:0/2053329024 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d740072f0 con 0x7f6d8006c250 2024-04-01T22:33:34.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.149+0000 7f6d86f01640 1 -- 172.21.15.47:0/2053329024 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d801f05b0 con 0x7f6d8006c250 2024-04-01T22:33:34.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.149+0000 7f6d86f01640 1 -- 172.21.15.47:0/2053329024 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d801f0830 con 0x7f6d8006c250 2024-04-01T22:33:34.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.150+0000 7f6d86f01640 1 -- 172.21.15.47:0/2053329024 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d8006da30 con 0x7f6d8006c250 2024-04-01T22:33:34.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.417+0000 7f6d7d7fa640 1 -- 172.21.15.47:0/2053329024 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f6d7401a070 con 0x7f6d8006c250 2024-04-01T22:33:34.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.417+0000 7f6d7d7fa640 1 --2- 172.21.15.47:0/2053329024 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f6d6406b990 0x7f6d6406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:34.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.417+0000 7f6d7ffff640 1 --2- 172.21.15.47:0/2053329024 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f6d6406b990 0x7f6d6406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:34.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.418+0000 7f6d7ffff640 1 --2- 172.21.15.47:0/2053329024 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f6d6406b990 0x7f6d6406de50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c036000 tx=0x7f6d6c03b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:34.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.431+0000 7f6d7d7fa640 1 -- 172.21.15.47:0/2053329024 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6d74056670 con 0x7f6d8006c250 2024-04-01T22:33:34.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.431+0000 7f6d7d7fa640 1 -- 172.21.15.47:0/2053329024 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f6d8006da30 con 0x7f6d8006c250 2024-04-01T22:33:34.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.651+0000 7f6d86f01640 1 -- 172.21.15.47:0/2053329024 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6d80068210 con 0x7f6d8006c250 2024-04-01T22:33:34.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.673+0000 7f6d7d7fa640 1 -- 172.21.15.47:0/2053329024 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+6834 (secure 0 0 0) 0x7f6d74021020 con 0x7f6d8006c250 2024-04-01T22:33:34.673 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:33:34.673 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4222,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/1297694239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1297694239},{"type":"v1","addr":"172.21.15.181:6835","nonce":1297694239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4225,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/2435310452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":2435310452},{"type":"v1","addr":"172.21.15.181:6837","nonce":2435310452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4228,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1974242436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1974242436},{"type":"v1","addr":"172.21.15.47:6839","nonce":1974242436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/4251771217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":4251771217},{"type":"v1","addr":"172.21.15.47:6837","nonce":4251771217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/1534194215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1534194215},{"type":"v1","addr":"172.21.15.181:6833","nonce":1534194215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-01T22:33:27.610692+0000","modified":"2024-04-01T22:33:33.452988+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.47:6835/1610100855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":1610100855},{"type":"v1","addr":"172.21.15.47:6835","nonce":1610100855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4254,"qdb_cluster":[4254]},"id":1}]} 2024-04-01T22:33:34.674 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 6 2024-04-01T22:33:34.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.676+0000 7f6d86f01640 1 -- 172.21.15.47:0/2053329024 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f6d6406b990 msgr2=0x7f6d6406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:34.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.676+0000 7f6d86f01640 1 --2- 172.21.15.47:0/2053329024 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f6d6406b990 0x7f6d6406de50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c036000 tx=0x7f6d6c03b040 comp rx=0 tx=0).stop 2024-04-01T22:33:34.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.676+0000 7f6d86f01640 1 -- 172.21.15.47:0/2053329024 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d8006c250 msgr2=0x7f6d800b1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:34.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.676+0000 7f6d86f01640 1 --2- 172.21.15.47:0/2053329024 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d8006c250 0x7f6d800b1e80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6d7400c400 tx=0x7f6d7400c8c0 comp rx=0 tx=0).stop 2024-04-01T22:33:34.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.676+0000 7f6d86f01640 1 -- 172.21.15.47:0/2053329024 shutdown_connections 2024-04-01T22:33:34.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.676+0000 7f6d86f01640 1 --2- 172.21.15.47:0/2053329024 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f6d6406b990 0x7f6d6406de50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:34.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.676+0000 7f6d86f01640 1 --2- 172.21.15.47:0/2053329024 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6d8015bb20 0x7f6d800b2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:34.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.676+0000 7f6d86f01640 1 --2- 172.21.15.47:0/2053329024 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6d8015aec0 0x7f6d800b27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:34.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.676+0000 7f6d86f01640 1 --2- 172.21.15.47:0/2053329024 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d8006c250 0x7f6d800b1e80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:34.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.676+0000 7f6d86f01640 1 -- 172.21.15.47:0/2053329024 >> 172.21.15.47:0/2053329024 conn(0x7f6d800cfdb0 msgr2=0x7f6d80153fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:34.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.676+0000 7f6d86f01640 1 -- 172.21.15.47:0/2053329024 shutdown_connections 2024-04-01T22:33:34.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.676+0000 7f6d86f01640 1 -- 172.21.15.47:0/2053329024 wait complete. 2024-04-01T22:33:34.686 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T22:33:34.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.801+0000 7f1cee53e640 1 Processor -- start 2024-04-01T22:33:34.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.801+0000 7f1cee53e640 1 -- start start 2024-04-01T22:33:34.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.802+0000 7f1cee53e640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1ce806c250 0x7f1ce815aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:34.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.802+0000 7f1cee53e640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ce8154b70 con 0x7f1ce806c630 2024-04-01T22:33:34.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.802+0000 7f1cee53e640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ce80cdac0 con 0x7f1ce815bb20 2024-04-01T22:33:34.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.802+0000 7f1cee53e640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f1ce80ce990 con 0x7f1ce806c250 2024-04-01T22:33:34.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.802+0000 7f1ce7fff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1ce806c250 0x7f1ce815aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:34.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.803+0000 7f1ce7fff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1ce806c250 0x7f1ce815aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:50968/0 (socket says 172.21.15.47:50968) 2024-04-01T22:33:34.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.803+0000 7f1ce7fff640 1 -- 172.21.15.47:0/365593565 learned_addr learned my addr 172.21.15.47:0/365593565 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:34.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.805+0000 7f1ce7fff640 1 -- 172.21.15.47:0/365593565 >> v1:172.21.15.181:6789/0 conn(0x7f1ce815bb20 legacy=0x7f1ce815bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:34.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.805+0000 7f1ce7fff640 1 -- 172.21.15.47:0/365593565 >> v1:172.21.15.47:6789/0 conn(0x7f1ce806c630 legacy=0x7f1ce80ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:34.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.805+0000 7f1ce7fff640 1 -- 172.21.15.47:0/365593565 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce80cf2a0 con 0x7f1ce806c250 2024-04-01T22:33:34.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.809+0000 7f1ce7fff640 1 --2- 172.21.15.47:0/365593565 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ce806c250 0x7f1ce815aec0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8009870 tx=0x7f1cd802b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b72481379eaf8997 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:34.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.812+0000 7f1ce6ffd640 1 -- 172.21.15.47:0/365593565 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8034070 con 0x7f1ce806c250 2024-04-01T22:33:34.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.812+0000 7f1ce6ffd640 1 -- 172.21.15.47:0/365593565 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd8030860 con 0x7f1ce806c250 2024-04-01T22:33:34.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.812+0000 7f1ce6ffd640 1 -- 172.21.15.47:0/365593565 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8030c30 con 0x7f1ce806c250 2024-04-01T22:33:34.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.813+0000 7f1cee53e640 1 -- 172.21.15.47:0/365593565 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ce806c250 msgr2=0x7f1ce815aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:34.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.813+0000 7f1cee53e640 1 --2- 172.21.15.47:0/365593565 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ce806c250 0x7f1ce815aec0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8009870 tx=0x7f1cd802b9a0 comp rx=0 tx=0).stop 2024-04-01T22:33:34.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.813+0000 7f1cee53e640 1 -- 172.21.15.47:0/365593565 shutdown_connections 2024-04-01T22:33:34.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.813+0000 7f1cee53e640 1 --2- 172.21.15.47:0/365593565 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ce806c250 0x7f1ce815aec0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:34.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.813+0000 7f1cee53e640 1 -- 172.21.15.47:0/365593565 >> 172.21.15.47:0/365593565 conn(0x7f1ce80cfdb0 msgr2=0x7f1ce80d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:34.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.813+0000 7f1cee53e640 1 -- 172.21.15.47:0/365593565 shutdown_connections 2024-04-01T22:33:34.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.813+0000 7f1cee53e640 1 -- 172.21.15.47:0/365593565 wait complete. 2024-04-01T22:33:34.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.814+0000 7f1cee53e640 1 Processor -- start 2024-04-01T22:33:34.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.814+0000 7f1cee53e640 1 -- start start 2024-04-01T22:33:34.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.815+0000 7f1cee53e640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ce806c250 0x7f1ce80c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:34.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.815+0000 7f1cee53e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ce806c630 0x7f1ce81f1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:34.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.815+0000 7f1cee53e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ce815bb20 0x7f1ce81e5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:34.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.815+0000 7f1cee53e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce80ce340 con 0x7f1ce815bb20 2024-04-01T22:33:34.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.815+0000 7f1cee53e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce80ce060 con 0x7f1ce806c630 2024-04-01T22:33:34.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.815+0000 7f1cee53e640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f1ce80ce620 con 0x7f1ce806c250 2024-04-01T22:33:34.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.816+0000 7f1ce77fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ce806c630 0x7f1ce81f1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:34.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.816+0000 7f1cecadb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ce815bb20 0x7f1ce81e5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:34.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.816+0000 7f1ce7fff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ce806c250 0x7f1ce80c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:34.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.816+0000 7f1cecadb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ce815bb20 0x7f1ce81e5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54150/0 (socket says 172.21.15.47:54150) 2024-04-01T22:33:34.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.816+0000 7f1cecadb640 1 -- 172.21.15.47:0/4167458084 learned_addr learned my addr 172.21.15.47:0/4167458084 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:34.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.820+0000 7f1cecadb640 1 -- 172.21.15.47:0/4167458084 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ce806c250 msgr2=0x7f1ce80c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:34.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.820+0000 7f1cecadb640 1 --2- 172.21.15.47:0/4167458084 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ce806c250 0x7f1ce80c8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:34.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.820+0000 7f1cecadb640 1 -- 172.21.15.47:0/4167458084 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ce806c630 msgr2=0x7f1ce81f1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:34.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.820+0000 7f1cecadb640 1 --2- 172.21.15.47:0/4167458084 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ce806c630 0x7f1ce81f1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:34.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.820+0000 7f1cecadb640 1 -- 172.21.15.47:0/4167458084 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce80cbaa0 con 0x7f1ce815bb20 2024-04-01T22:33:34.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.822+0000 7f1cecadb640 1 --2- 172.21.15.47:0/4167458084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ce815bb20 0x7f1ce81e5610 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1ce000b970 tx=0x7f1ce000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:34.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.825+0000 7f1ce4ff9640 1 -- 172.21.15.47:0/4167458084 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0019070 con 0x7f1ce815bb20 2024-04-01T22:33:34.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.825+0000 7f1cee53e640 1 -- 172.21.15.47:0/4167458084 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ce81f1550 con 0x7f1ce815bb20 2024-04-01T22:33:34.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.825+0000 7f1cee53e640 1 -- 172.21.15.47:0/4167458084 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ce80c85e0 con 0x7f1ce815bb20 2024-04-01T22:33:34.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.826+0000 7f1cee53e640 1 -- 172.21.15.47:0/4167458084 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ce8074850 con 0x7f1ce815bb20 2024-04-01T22:33:34.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.827+0000 7f1ce4ff9640 1 -- 172.21.15.47:0/4167458084 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ce000cb40 con 0x7f1ce815bb20 2024-04-01T22:33:34.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:34.827+0000 7f1ce4ff9640 1 -- 172.21.15.47:0/4167458084 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0003970 con 0x7f1ce815bb20 2024-04-01T22:33:35.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.100+0000 7f1ce4ff9640 1 -- 172.21.15.47:0/4167458084 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f1ce001c070 con 0x7f1ce815bb20 2024-04-01T22:33:35.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.101+0000 7f1ce4ff9640 1 --2- 172.21.15.47:0/4167458084 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f1cd406b990 0x7f1cd406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:35.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.101+0000 7f1ce7fff640 1 --2- 172.21.15.47:0/4167458084 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f1cd406b990 0x7f1cd406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:35.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.101+0000 7f1ce7fff640 1 --2- 172.21.15.47:0/4167458084 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f1cd406b990 0x7f1cd406de50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8036000 tx=0x7f1cd8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:35.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.138+0000 7f1ce4ff9640 1 -- 172.21.15.47:0/4167458084 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1ce0057030 con 0x7f1ce815bb20 2024-04-01T22:33:35.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.138+0000 7f1ce4ff9640 1 -- 172.21.15.47:0/4167458084 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f1ce8074850 con 0x7f1ce815bb20 2024-04-01T22:33:35.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.332+0000 7f1cee53e640 1 -- 172.21.15.47:0/4167458084 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1ce8068210 con 0x7f1ce815bb20 2024-04-01T22:33:35.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.385+0000 7f1ce4ff9640 1 -- 172.21.15.47:0/4167458084 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18526 (secure 0 0 0) 0x7f1ce0023070 con 0x7f1ce815bb20 2024-04-01T22:33:35.385 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:33:35.385 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"fsid":"a6998a48-38bc-4e42-b0d9-04f2fb5c3c87","created":"2024-04-01T22:32:57.112033+0000","modified":"2024-04-01T22:33:33.448062+0000","last_up_change":"2024-04-01T22:33:11.141073+0000","last_in_change":"2024-04-01T22:33:02.650459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T22:33:13.356568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T22:33:25.309421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T22:33:26.268050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-01T22:33:30.588103+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7bd3f25d-e3a5-4932-b381-53dcbb464dde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6811","nonce":3827395709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6813","nonce":3827395709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6817","nonce":3827395709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6815","nonce":3827395709}]},"public_addr":"172.21.15.47:6811/3827395709","cluster_addr":"172.21.15.47:6813/3827395709","heartbeat_back_addr":"172.21.15.47:6817/3827395709","heartbeat_front_addr":"172.21.15.47:6815/3827395709","state":["exists","up"]},{"osd":1,"uuid":"2aa60ba2-67ff-43c7-96c4-82ae2f3855ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6827","nonce":3152157503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6829","nonce":3152157503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6833","nonce":3152157503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6831","nonce":3152157503}]},"public_addr":"172.21.15.47:6827/3152157503","cluster_addr":"172.21.15.47:6829/3152157503","heartbeat_back_addr":"172.21.15.47:6833/3152157503","heartbeat_front_addr":"172.21.15.47:6831/3152157503","state":["exists","up"]},{"osd":2,"uuid":"d83f8a98-6db8-42b7-9ef6-5b16eb9a3492","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6803","nonce":1003968856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6805","nonce":1003968856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6809","nonce":1003968856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6807","nonce":1003968856}]},"public_addr":"172.21.15.47:6803/1003968856","cluster_addr":"172.21.15.47:6805/1003968856","heartbeat_back_addr":"172.21.15.47:6809/1003968856","heartbeat_front_addr":"172.21.15.47:6807/1003968856","state":["exists","up"]},{"osd":3,"uuid":"edc02ed5-d25c-4dc9-a0c3-7a26f20fae07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6819","nonce":2845699561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6821","nonce":2845699561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6825","nonce":2845699561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6823","nonce":2845699561}]},"public_addr":"172.21.15.47:6819/2845699561","cluster_addr":"172.21.15.47:6821/2845699561","heartbeat_back_addr":"172.21.15.47:6825/2845699561","heartbeat_front_addr":"172.21.15.47:6823/2845699561","state":["exists","up"]},{"osd":4,"uuid":"b3d67e74-f51e-4474-9c62-dd0daa60c728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6809","nonce":2961538461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6811","nonce":2961538461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6815","nonce":2961538461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6813","nonce":2961538461}]},"public_addr":"172.21.15.181:6809/2961538461","cluster_addr":"172.21.15.181:6811/2961538461","heartbeat_back_addr":"172.21.15.181:6815/2961538461","heartbeat_front_addr":"172.21.15.181:6813/2961538461","state":["exists","up"]},{"osd":5,"uuid":"d86e8f7a-99f4-4457-9949-cf2cb853e79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6817","nonce":2161566540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6819","nonce":2161566540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6823","nonce":2161566540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6821","nonce":2161566540}]},"public_addr":"172.21.15.181:6817/2161566540","cluster_addr":"172.21.15.181:6819/2161566540","heartbeat_back_addr":"172.21.15.181:6823/2161566540","heartbeat_front_addr":"172.21.15.181:6821/2161566540","state":["exists","up"]},{"osd":6,"uuid":"aa08266c-1719-4abd-afb9-e7e8ac593658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6801","nonce":3792144865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6803","nonce":3792144865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6807","nonce":3792144865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6805","nonce":3792144865}]},"public_addr":"172.21.15.181:6801/3792144865","cluster_addr":"172.21.15.181:6803/3792144865","heartbeat_back_addr":"172.21.15.181:6807/3792144865","heartbeat_front_addr":"172.21.15.181:6805/3792144865","state":["exists","up"]},{"osd":7,"uuid":"6e509762-24c8-46c3-93a1-4c50b11ebcf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6825","nonce":1760995885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6827","nonce":1760995885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6831","nonce":1760995885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6829","nonce":1760995885}]},"public_addr":"172.21.15.181:6825/1760995885","cluster_addr":"172.21.15.181:6827/1760995885","heartbeat_back_addr":"172.21.15.181:6831/1760995885","heartbeat_front_addr":"172.21.15.181:6829/1760995885","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.202426+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.255318+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.170288+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.290065+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.214871+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.176432+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.139940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.299546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T22:33:35.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.387+0000 7f1cee53e640 1 -- 172.21.15.47:0/4167458084 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f1cd406b990 msgr2=0x7f1cd406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:35.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.387+0000 7f1cee53e640 1 --2- 172.21.15.47:0/4167458084 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f1cd406b990 0x7f1cd406de50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8036000 tx=0x7f1cd8008030 comp rx=0 tx=0).stop 2024-04-01T22:33:35.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.387+0000 7f1cee53e640 1 -- 172.21.15.47:0/4167458084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ce815bb20 msgr2=0x7f1ce81e5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:35.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.387+0000 7f1cee53e640 1 --2- 172.21.15.47:0/4167458084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ce815bb20 0x7f1ce81e5610 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1ce000b970 tx=0x7f1ce000be30 comp rx=0 tx=0).stop 2024-04-01T22:33:35.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.387+0000 7f1cee53e640 1 -- 172.21.15.47:0/4167458084 shutdown_connections 2024-04-01T22:33:35.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.387+0000 7f1cee53e640 1 --2- 172.21.15.47:0/4167458084 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f1cd406b990 0x7f1cd406de50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:35.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.387+0000 7f1cee53e640 1 --2- 172.21.15.47:0/4167458084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ce815bb20 0x7f1ce81e5610 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:35.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.387+0000 7f1cee53e640 1 --2- 172.21.15.47:0/4167458084 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ce806c630 0x7f1ce81f1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:35.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.387+0000 7f1cee53e640 1 --2- 172.21.15.47:0/4167458084 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ce806c250 0x7f1ce80c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:35.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.387+0000 7f1cee53e640 1 -- 172.21.15.47:0/4167458084 >> 172.21.15.47:0/4167458084 conn(0x7f1ce80cfdb0 msgr2=0x7f1ce8153ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:35.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.387+0000 7f1cee53e640 1 -- 172.21.15.47:0/4167458084 shutdown_connections 2024-04-01T22:33:35.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.387+0000 7f1cee53e640 1 -- 172.21.15.47:0/4167458084 wait complete. 2024-04-01T22:33:35.398 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T22:33:35.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.501+0000 7f87c7498640 1 Processor -- start 2024-04-01T22:33:35.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.501+0000 7f87c7498640 1 -- start start 2024-04-01T22:33:35.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.502+0000 7f87c7498640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f87c006c250 0x7f87c015aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:35.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.502+0000 7f87c7498640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f87c015bb20 0x7f87c015bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:35.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.502+0000 7f87c7498640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87c0154b70 con 0x7f87c006c630 2024-04-01T22:33:35.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.502+0000 7f87c7498640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f87c00ce990 con 0x7f87c015bb20 2024-04-01T22:33:35.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.502+0000 7f87c7498640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f87c015c4b0 con 0x7f87c006c250 2024-04-01T22:33:35.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.503+0000 7f87c5a35640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f87c015bb20 0x7f87c015bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:35.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.503+0000 7f87c5234640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f87c006c250 0x7f87c015aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:35.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.503+0000 7f87c4a33640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f87c006c630 0x7f87c00ceb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:47414/0 (socket says 172.21.15.47:47414) 2024-04-01T22:33:35.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.503+0000 7f87c4a33640 1 -- 172.21.15.47:0/416121104 learned_addr learned my addr 172.21.15.47:0/416121104 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T22:33:35.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.505+0000 7f87c5234640 1 -- 172.21.15.47:0/416121104 >> v2:172.21.15.47:3300/0 conn(0x7f87c015bb20 msgr2=0x7f87c015bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:35.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.505+0000 7f87c5234640 1 --2- 172.21.15.47:0/416121104 >> v2:172.21.15.47:3300/0 conn(0x7f87c015bb20 0x7f87c015bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:35.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.505+0000 7f87c5234640 1 -- 172.21.15.47:0/416121104 >> v1:172.21.15.47:6789/0 conn(0x7f87c006c630 legacy=0x7f87c00ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:35.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.505+0000 7f87c5234640 1 -- 172.21.15.47:0/416121104 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87c00cdac0 con 0x7f87c006c250 2024-04-01T22:33:35.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.507+0000 7f87c5234640 1 --2- 172.21.15.47:0/416121104 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f87c006c250 0x7f87c015aec0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f87bc0097a0 tx=0x7f87bc02b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db384b5d2cdce51 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:35.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.511+0000 7f87b7fff640 1 -- 172.21.15.47:0/416121104 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87bc034070 con 0x7f87c006c250 2024-04-01T22:33:35.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.511+0000 7f87b7fff640 1 -- 172.21.15.47:0/416121104 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87bc030610 con 0x7f87c006c250 2024-04-01T22:33:35.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.511+0000 7f87b7fff640 1 -- 172.21.15.47:0/416121104 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87bc0309e0 con 0x7f87c006c250 2024-04-01T22:33:35.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.512+0000 7f87c7498640 1 -- 172.21.15.47:0/416121104 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f87c006c250 msgr2=0x7f87c015aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:35.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.512+0000 7f87c7498640 1 --2- 172.21.15.47:0/416121104 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f87c006c250 0x7f87c015aec0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f87bc0097a0 tx=0x7f87bc02b960 comp rx=0 tx=0).stop 2024-04-01T22:33:35.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.512+0000 7f87c7498640 1 -- 172.21.15.47:0/416121104 shutdown_connections 2024-04-01T22:33:35.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.512+0000 7f87c7498640 1 --2- 172.21.15.47:0/416121104 >> v2:172.21.15.47:3300/0 conn(0x7f87c015bb20 0x7f87c015bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:35.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.512+0000 7f87c7498640 1 --2- 172.21.15.47:0/416121104 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f87c006c250 0x7f87c015aec0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:35.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.512+0000 7f87c7498640 1 -- 172.21.15.47:0/416121104 >> 172.21.15.47:0/416121104 conn(0x7f87c00cfdb0 msgr2=0x7f87c00d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:35.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.512+0000 7f87c7498640 1 -- 172.21.15.47:0/416121104 shutdown_connections 2024-04-01T22:33:35.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.512+0000 7f87c7498640 1 -- 172.21.15.47:0/416121104 wait complete. 2024-04-01T22:33:35.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.513+0000 7f87c7498640 1 Processor -- start 2024-04-01T22:33:35.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.513+0000 7f87c7498640 1 -- start start 2024-04-01T22:33:35.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.514+0000 7f87c7498640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87c006c250 0x7f87c01f0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:35.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.514+0000 7f87c7498640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87c006c630 0x7f87c00cb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:35.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.514+0000 7f87c7498640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f87c015bb20 0x7f87c0156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:35.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.514+0000 7f87c7498640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f87c00ce060 con 0x7f87c006c250 2024-04-01T22:33:35.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.514+0000 7f87c7498640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f87c00cdd80 con 0x7f87c006c630 2024-04-01T22:33:35.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.514+0000 7f87c7498640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f87c00ce340 con 0x7f87c015bb20 2024-04-01T22:33:35.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.514+0000 7f87c5234640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87c006c250 0x7f87c01f0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:35.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.515+0000 7f87c5234640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87c006c250 0x7f87c01f0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54174/0 (socket says 172.21.15.47:54174) 2024-04-01T22:33:35.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.515+0000 7f87c5234640 1 -- 172.21.15.47:0/604728013 learned_addr learned my addr 172.21.15.47:0/604728013 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:35.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.515+0000 7f87c5a35640 1 --2- 172.21.15.47:0/604728013 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f87c015bb20 0x7f87c0156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:35.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.515+0000 7f87c4a33640 1 --2- 172.21.15.47:0/604728013 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87c006c630 0x7f87c00cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:35.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.518+0000 7f87c5234640 1 -- 172.21.15.47:0/604728013 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f87c015bb20 msgr2=0x7f87c0156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:35.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.518+0000 7f87c5234640 1 --2- 172.21.15.47:0/604728013 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f87c015bb20 0x7f87c0156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:35.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.518+0000 7f87c5234640 1 -- 172.21.15.47:0/604728013 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87c006c630 msgr2=0x7f87c00cb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:35.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.518+0000 7f87c5234640 1 --2- 172.21.15.47:0/604728013 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87c006c630 0x7f87c00cb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:35.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.518+0000 7f87c5234640 1 -- 172.21.15.47:0/604728013 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87c0155cd0 con 0x7f87c006c250 2024-04-01T22:33:35.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.520+0000 7f87c5234640 1 --2- 172.21.15.47:0/604728013 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87c006c250 0x7f87c01f0700 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f87bc02bf70 tx=0x7f87bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:35.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.524+0000 7f87b5ffb640 1 -- 172.21.15.47:0/604728013 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87bc034040 con 0x7f87c006c250 2024-04-01T22:33:35.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.524+0000 7f87b5ffb640 1 -- 172.21.15.47:0/604728013 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87bc039990 con 0x7f87c006c250 2024-04-01T22:33:35.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.524+0000 7f87c7498640 1 -- 172.21.15.47:0/604728013 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87c0154de0 con 0x7f87c006c250 2024-04-01T22:33:35.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.524+0000 7f87b5ffb640 1 -- 172.21.15.47:0/604728013 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87bc039da0 con 0x7f87c006c250 2024-04-01T22:33:35.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.525+0000 7f87c7498640 1 -- 172.21.15.47:0/604728013 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87c01553a0 con 0x7f87c006c250 2024-04-01T22:33:35.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.525+0000 7f87c7498640 1 -- 172.21.15.47:0/604728013 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87c006d140 con 0x7f87c006c250 2024-04-01T22:33:35.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.545+0000 7f87b5ffb640 1 -- 172.21.15.47:0/604728013 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f87bc037070 con 0x7f87c006c250 2024-04-01T22:33:35.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.545+0000 7f87b5ffb640 1 --2- 172.21.15.47:0/604728013 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f87a406b9c0 0x7f87a406de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:35.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.545+0000 7f87c4a33640 1 --2- 172.21.15.47:0/604728013 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f87a406b9c0 0x7f87a406de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:35.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.546+0000 7f87c4a33640 1 --2- 172.21.15.47:0/604728013 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f87a406b9c0 0x7f87a406de80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f87c00ca8a0 tx=0x7f87b0007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:35.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.808+0000 7f87b5ffb640 1 -- 172.21.15.47:0/604728013 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f87bc079780 con 0x7f87c006c250 2024-04-01T22:33:35.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.808+0000 7f87b5ffb640 1 -- 172.21.15.47:0/604728013 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f87c006d140 con 0x7f87c006c250 2024-04-01T22:33:35.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:35.992+0000 7f87c7498640 1 -- 172.21.15.47:0/604728013 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f87c00af310 con 0x7f87c006c250 2024-04-01T22:33:36.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.035+0000 7f87b5ffb640 1 -- 172.21.15.47:0/604728013 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18526 (secure 0 0 0) 0x7f87bc07b6e0 con 0x7f87c006c250 2024-04-01T22:33:36.035 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:33:36.035 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"fsid":"a6998a48-38bc-4e42-b0d9-04f2fb5c3c87","created":"2024-04-01T22:32:57.112033+0000","modified":"2024-04-01T22:33:33.448062+0000","last_up_change":"2024-04-01T22:33:11.141073+0000","last_in_change":"2024-04-01T22:33:02.650459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T22:33:13.356568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T22:33:25.309421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T22:33:26.268050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-01T22:33:30.588103+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7bd3f25d-e3a5-4932-b381-53dcbb464dde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6811","nonce":3827395709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6813","nonce":3827395709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6817","nonce":3827395709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6815","nonce":3827395709}]},"public_addr":"172.21.15.47:6811/3827395709","cluster_addr":"172.21.15.47:6813/3827395709","heartbeat_back_addr":"172.21.15.47:6817/3827395709","heartbeat_front_addr":"172.21.15.47:6815/3827395709","state":["exists","up"]},{"osd":1,"uuid":"2aa60ba2-67ff-43c7-96c4-82ae2f3855ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6827","nonce":3152157503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6829","nonce":3152157503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6833","nonce":3152157503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6831","nonce":3152157503}]},"public_addr":"172.21.15.47:6827/3152157503","cluster_addr":"172.21.15.47:6829/3152157503","heartbeat_back_addr":"172.21.15.47:6833/3152157503","heartbeat_front_addr":"172.21.15.47:6831/3152157503","state":["exists","up"]},{"osd":2,"uuid":"d83f8a98-6db8-42b7-9ef6-5b16eb9a3492","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6803","nonce":1003968856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6805","nonce":1003968856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6809","nonce":1003968856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6807","nonce":1003968856}]},"public_addr":"172.21.15.47:6803/1003968856","cluster_addr":"172.21.15.47:6805/1003968856","heartbeat_back_addr":"172.21.15.47:6809/1003968856","heartbeat_front_addr":"172.21.15.47:6807/1003968856","state":["exists","up"]},{"osd":3,"uuid":"edc02ed5-d25c-4dc9-a0c3-7a26f20fae07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6819","nonce":2845699561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6821","nonce":2845699561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6825","nonce":2845699561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6823","nonce":2845699561}]},"public_addr":"172.21.15.47:6819/2845699561","cluster_addr":"172.21.15.47:6821/2845699561","heartbeat_back_addr":"172.21.15.47:6825/2845699561","heartbeat_front_addr":"172.21.15.47:6823/2845699561","state":["exists","up"]},{"osd":4,"uuid":"b3d67e74-f51e-4474-9c62-dd0daa60c728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6809","nonce":2961538461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6811","nonce":2961538461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6815","nonce":2961538461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6813","nonce":2961538461}]},"public_addr":"172.21.15.181:6809/2961538461","cluster_addr":"172.21.15.181:6811/2961538461","heartbeat_back_addr":"172.21.15.181:6815/2961538461","heartbeat_front_addr":"172.21.15.181:6813/2961538461","state":["exists","up"]},{"osd":5,"uuid":"d86e8f7a-99f4-4457-9949-cf2cb853e79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6817","nonce":2161566540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6819","nonce":2161566540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6823","nonce":2161566540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6821","nonce":2161566540}]},"public_addr":"172.21.15.181:6817/2161566540","cluster_addr":"172.21.15.181:6819/2161566540","heartbeat_back_addr":"172.21.15.181:6823/2161566540","heartbeat_front_addr":"172.21.15.181:6821/2161566540","state":["exists","up"]},{"osd":6,"uuid":"aa08266c-1719-4abd-afb9-e7e8ac593658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6801","nonce":3792144865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6803","nonce":3792144865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6807","nonce":3792144865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6805","nonce":3792144865}]},"public_addr":"172.21.15.181:6801/3792144865","cluster_addr":"172.21.15.181:6803/3792144865","heartbeat_back_addr":"172.21.15.181:6807/3792144865","heartbeat_front_addr":"172.21.15.181:6805/3792144865","state":["exists","up"]},{"osd":7,"uuid":"6e509762-24c8-46c3-93a1-4c50b11ebcf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6825","nonce":1760995885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6827","nonce":1760995885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6831","nonce":1760995885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6829","nonce":1760995885}]},"public_addr":"172.21.15.181:6825/1760995885","cluster_addr":"172.21.15.181:6827/1760995885","heartbeat_back_addr":"172.21.15.181:6831/1760995885","heartbeat_front_addr":"172.21.15.181:6829/1760995885","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.202426+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.255318+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.170288+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.290065+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.214871+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.176432+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.139940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.299546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T22:33:36.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.037+0000 7f87c7498640 1 -- 172.21.15.47:0/604728013 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f87a406b9c0 msgr2=0x7f87a406de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:36.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.037+0000 7f87c7498640 1 --2- 172.21.15.47:0/604728013 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f87a406b9c0 0x7f87a406de80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f87c00ca8a0 tx=0x7f87b0007e80 comp rx=0 tx=0).stop 2024-04-01T22:33:36.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.037+0000 7f87c7498640 1 -- 172.21.15.47:0/604728013 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87c006c250 msgr2=0x7f87c01f0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:36.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.037+0000 7f87c7498640 1 --2- 172.21.15.47:0/604728013 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87c006c250 0x7f87c01f0700 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f87bc02bf70 tx=0x7f87bc0046c0 comp rx=0 tx=0).stop 2024-04-01T22:33:36.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.037+0000 7f87c7498640 1 -- 172.21.15.47:0/604728013 shutdown_connections 2024-04-01T22:33:36.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.037+0000 7f87c7498640 1 --2- 172.21.15.47:0/604728013 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f87a406b9c0 0x7f87a406de80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:36.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.037+0000 7f87c7498640 1 --2- 172.21.15.47:0/604728013 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f87c015bb20 0x7f87c0156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:36.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.037+0000 7f87c7498640 1 --2- 172.21.15.47:0/604728013 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87c006c630 0x7f87c00cb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:36.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.037+0000 7f87c7498640 1 --2- 172.21.15.47:0/604728013 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87c006c250 0x7f87c01f0700 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:36.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.037+0000 7f87c7498640 1 -- 172.21.15.47:0/604728013 >> 172.21.15.47:0/604728013 conn(0x7f87c00cfdb0 msgr2=0x7f87c015a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:36.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.037+0000 7f87c7498640 1 -- 172.21.15.47:0/604728013 shutdown_connections 2024-04-01T22:33:36.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.037+0000 7f87c7498640 1 -- 172.21.15.47:0/604728013 wait complete. 2024-04-01T22:33:36.062 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T22:33:36.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.165+0000 7f96853bc640 1 Processor -- start 2024-04-01T22:33:36.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.165+0000 7f96853bc640 1 -- start start 2024-04-01T22:33:36.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.166+0000 7f96853bc640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f968006c250 0x7f968015aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:36.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.166+0000 7f96853bc640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f968006c630 0x7f96800ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:36.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.166+0000 7f96853bc640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9680154b70 con 0x7f96800cf0d0 2024-04-01T22:33:36.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.166+0000 7f96853bc640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f96800ce990 con 0x7f968006c250 2024-04-01T22:33:36.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.166+0000 7f96853bc640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f96800cdac0 con 0x7f968006c630 2024-04-01T22:33:36.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.167+0000 7f967effd640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f968006c250 0x7f968015aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:36.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.167+0000 7f967e7fc640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f968006c630 0x7f96800ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:36.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.167+0000 7f967effd640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f968006c250 0x7f968015aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:50992/0 (socket says 172.21.15.47:50992) 2024-04-01T22:33:36.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.167+0000 7f967effd640 1 -- 172.21.15.47:0/2652879070 learned_addr learned my addr 172.21.15.47:0/2652879070 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:36.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.169+0000 7f967effd640 1 -- 172.21.15.47:0/2652879070 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f968006c630 msgr2=0x7f96800ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:36.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.169+0000 7f967effd640 1 --2- 172.21.15.47:0/2652879070 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f968006c630 0x7f96800ceb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:36.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.169+0000 7f967effd640 1 -- 172.21.15.47:0/2652879070 >> v1:172.21.15.47:6789/0 conn(0x7f96800cf0d0 legacy=0x7f968015bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:36.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.169+0000 7f967effd640 1 -- 172.21.15.47:0/2652879070 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96800cdd80 con 0x7f968006c250 2024-04-01T22:33:36.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.174+0000 7f967effd640 1 --2- 172.21.15.47:0/2652879070 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f968006c250 0x7f968015aec0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9670009870 tx=0x7f967002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a567a47d592439fc server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:36.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.231+0000 7f967dffb640 1 -- 172.21.15.47:0/2652879070 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9670034070 con 0x7f968006c250 2024-04-01T22:33:36.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.231+0000 7f967dffb640 1 -- 172.21.15.47:0/2652879070 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9670030840 con 0x7f968006c250 2024-04-01T22:33:36.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.231+0000 7f967dffb640 1 -- 172.21.15.47:0/2652879070 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9670030c10 con 0x7f968006c250 2024-04-01T22:33:36.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.232+0000 7f96853bc640 1 -- 172.21.15.47:0/2652879070 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f968006c250 msgr2=0x7f968015aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:36.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.232+0000 7f96853bc640 1 --2- 172.21.15.47:0/2652879070 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f968006c250 0x7f968015aec0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9670009870 tx=0x7f967002b980 comp rx=0 tx=0).stop 2024-04-01T22:33:36.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.232+0000 7f96853bc640 1 -- 172.21.15.47:0/2652879070 shutdown_connections 2024-04-01T22:33:36.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.232+0000 7f96853bc640 1 --2- 172.21.15.47:0/2652879070 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f968006c630 0x7f96800ceb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:36.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.232+0000 7f96853bc640 1 --2- 172.21.15.47:0/2652879070 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f968006c250 0x7f968015aec0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:36.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.232+0000 7f96853bc640 1 -- 172.21.15.47:0/2652879070 >> 172.21.15.47:0/2652879070 conn(0x7f96800cfdb0 msgr2=0x7f96800d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:36.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.232+0000 7f96853bc640 1 -- 172.21.15.47:0/2652879070 shutdown_connections 2024-04-01T22:33:36.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.232+0000 7f96853bc640 1 -- 172.21.15.47:0/2652879070 wait complete. 2024-04-01T22:33:36.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.234+0000 7f96853bc640 1 Processor -- start 2024-04-01T22:33:36.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.234+0000 7f96853bc640 1 -- start start 2024-04-01T22:33:36.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.235+0000 7f96853bc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f968006c250 0x7f96800b2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:36.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.235+0000 7f96853bc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f968006c630 0x7f9680157820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:36.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.235+0000 7f96853bc640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f96800cabe0 0x7f96801f3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:36.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.235+0000 7f96853bc640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f96800ce620 con 0x7f968006c250 2024-04-01T22:33:36.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.235+0000 7f96853bc640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f96800ce340 con 0x7f968006c630 2024-04-01T22:33:36.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.235+0000 7f96853bc640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f968006ca30 con 0x7f96800cabe0 2024-04-01T22:33:36.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.235+0000 7f967f7fe640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f96800cabe0 0x7f96801f3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:36.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.236+0000 7f967f7fe640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f96800cabe0 0x7f96801f3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:51274/0 (socket says 172.21.15.47:51274) 2024-04-01T22:33:36.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.236+0000 7f967f7fe640 1 -- 172.21.15.47:0/4124455944 learned_addr learned my addr 172.21.15.47:0/4124455944 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:36.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.236+0000 7f967effd640 1 --2- 172.21.15.47:0/4124455944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f968006c250 0x7f96800b2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:36.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.238+0000 7f967e7fc640 1 --2- 172.21.15.47:0/4124455944 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f968006c630 0x7f9680157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:36.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.239+0000 7f967f7fe640 1 -- 172.21.15.47:0/4124455944 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f968006c630 msgr2=0x7f9680157820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:36.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.239+0000 7f967f7fe640 1 --2- 172.21.15.47:0/4124455944 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f968006c630 0x7f9680157820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:36.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.239+0000 7f967f7fe640 1 -- 172.21.15.47:0/4124455944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f968006c250 msgr2=0x7f96800b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:36.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.239+0000 7f967f7fe640 1 --2- 172.21.15.47:0/4124455944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f968006c250 0x7f96800b2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:36.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.239+0000 7f967f7fe640 1 -- 172.21.15.47:0/4124455944 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96801f06a0 con 0x7f96800cabe0 2024-04-01T22:33:36.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.242+0000 7f967f7fe640 1 --2- 172.21.15.47:0/4124455944 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f96800cabe0 0x7f96801f3dc0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f967800ba10 tx=0x7f967800bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:36.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.246+0000 7f96677fe640 1 -- 172.21.15.47:0/4124455944 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9678019070 con 0x7f96800cabe0 2024-04-01T22:33:36.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.246+0000 7f96677fe640 1 -- 172.21.15.47:0/4124455944 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f967800cba0 con 0x7f96800cabe0 2024-04-01T22:33:36.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.246+0000 7f96853bc640 1 -- 172.21.15.47:0/4124455944 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96801f0980 con 0x7f96800cabe0 2024-04-01T22:33:36.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.246+0000 7f96677fe640 1 -- 172.21.15.47:0/4124455944 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9678014440 con 0x7f96800cabe0 2024-04-01T22:33:36.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.246+0000 7f96853bc640 1 -- 172.21.15.47:0/4124455944 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f96801f0f40 con 0x7f96800cabe0 2024-04-01T22:33:36.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.247+0000 7f96853bc640 1 -- 172.21.15.47:0/4124455944 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9680068210 con 0x7f96800cabe0 2024-04-01T22:33:36.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.490+0000 7f96677fe640 1 -- 172.21.15.47:0/4124455944 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f967801c070 con 0x7f96800cabe0 2024-04-01T22:33:36.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.490+0000 7f96677fe640 1 --2- 172.21.15.47:0/4124455944 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f966c06b9e0 0x7f966c06dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:36.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.490+0000 7f967effd640 1 --2- 172.21.15.47:0/4124455944 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f966c06b9e0 0x7f966c06dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:36.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.491+0000 7f967effd640 1 --2- 172.21.15.47:0/4124455944 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f966c06b9e0 0x7f966c06dea0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9670036000 tx=0x7f9670008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:36.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.495+0000 7f96677fe640 1 -- 172.21.15.47:0/4124455944 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9678056f80 con 0x7f96800cabe0 2024-04-01T22:33:36.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.504+0000 7f96677fe640 1 -- 172.21.15.47:0/4124455944 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f9678023020 con 0x7f96800cabe0 2024-04-01T22:33:36.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.730+0000 7f96853bc640 1 -- 172.21.15.47:0/4124455944 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f96800af310 con 0x7f96800cabe0 2024-04-01T22:33:36.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.753+0000 7f96677fe640 1 -- 172.21.15.47:0/4124455944 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+6834 (secure 0 0 0) 0x7f9678058ee0 con 0x7f96800cabe0 2024-04-01T22:33:36.753 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:33:36.753 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4222,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/1297694239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1297694239},{"type":"v1","addr":"172.21.15.181:6835","nonce":1297694239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4225,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/2435310452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":2435310452},{"type":"v1","addr":"172.21.15.181:6837","nonce":2435310452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4228,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1974242436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1974242436},{"type":"v1","addr":"172.21.15.47:6839","nonce":1974242436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/4251771217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":4251771217},{"type":"v1","addr":"172.21.15.47:6837","nonce":4251771217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/1534194215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1534194215},{"type":"v1","addr":"172.21.15.181:6833","nonce":1534194215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-01T22:33:27.610692+0000","modified":"2024-04-01T22:33:33.452988+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.47:6835/1610100855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":1610100855},{"type":"v1","addr":"172.21.15.47:6835","nonce":1610100855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4254,"qdb_cluster":[4254]},"id":1}]} 2024-04-01T22:33:36.753 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 6 2024-04-01T22:33:36.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.755+0000 7f96853bc640 1 -- 172.21.15.47:0/4124455944 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f966c06b9e0 msgr2=0x7f966c06dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:36.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.755+0000 7f96853bc640 1 --2- 172.21.15.47:0/4124455944 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f966c06b9e0 0x7f966c06dea0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9670036000 tx=0x7f9670008030 comp rx=0 tx=0).stop 2024-04-01T22:33:36.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.755+0000 7f96853bc640 1 -- 172.21.15.47:0/4124455944 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f96800cabe0 msgr2=0x7f96801f3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:36.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.755+0000 7f96853bc640 1 --2- 172.21.15.47:0/4124455944 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f96800cabe0 0x7f96801f3dc0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f967800ba10 tx=0x7f967800bed0 comp rx=0 tx=0).stop 2024-04-01T22:33:36.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.755+0000 7f96853bc640 1 -- 172.21.15.47:0/4124455944 shutdown_connections 2024-04-01T22:33:36.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.755+0000 7f96853bc640 1 --2- 172.21.15.47:0/4124455944 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f966c06b9e0 0x7f966c06dea0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:36.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.755+0000 7f96853bc640 1 --2- 172.21.15.47:0/4124455944 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f96800cabe0 0x7f96801f3dc0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:36.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.755+0000 7f96853bc640 1 --2- 172.21.15.47:0/4124455944 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f968006c630 0x7f9680157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:36.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.755+0000 7f96853bc640 1 --2- 172.21.15.47:0/4124455944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f968006c250 0x7f96800b2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:36.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.755+0000 7f96853bc640 1 -- 172.21.15.47:0/4124455944 >> 172.21.15.47:0/4124455944 conn(0x7f96800cfdb0 msgr2=0x7f968015c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:36.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.755+0000 7f96853bc640 1 -- 172.21.15.47:0/4124455944 shutdown_connections 2024-04-01T22:33:36.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.755+0000 7f96853bc640 1 -- 172.21.15.47:0/4124455944 wait complete. 2024-04-01T22:33:36.766 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T22:33:36.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.869+0000 7fc273ed4640 1 Processor -- start 2024-04-01T22:33:36.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.870+0000 7fc273ed4640 1 -- start start 2024-04-01T22:33:36.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.870+0000 7fc273ed4640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc26c06c250 0x7fc26c15aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:36.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.870+0000 7fc273ed4640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc26c154b70 con 0x7fc26c06c630 2024-04-01T22:33:36.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.870+0000 7fc273ed4640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc26c0cdac0 con 0x7fc26c15bb20 2024-04-01T22:33:36.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.870+0000 7fc273ed4640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fc26c0ce990 con 0x7fc26c06c250 2024-04-01T22:33:36.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.871+0000 7fc271c70640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc26c06c250 0x7fc26c15aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:36.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.871+0000 7fc27146f640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fc26c06c630 0x7fc26c0ceb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:47420/0 (socket says 172.21.15.47:47420) 2024-04-01T22:33:36.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.871+0000 7fc27146f640 1 -- 172.21.15.47:0/3245141952 learned_addr learned my addr 172.21.15.47:0/3245141952 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T22:33:36.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.873+0000 7fc270c6e640 1 -- 172.21.15.47:0/3245141952 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1309534769 0 0) 0x7fc26c154b70 con 0x7fc26c06c630 2024-04-01T22:33:36.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.874+0000 7fc270c6e640 1 -- 172.21.15.47:0/3245141952 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc258003520 con 0x7fc26c06c630 2024-04-01T22:33:36.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.874+0000 7fc271c70640 1 -- 172.21.15.47:0/3245141952 >> v1:172.21.15.181:6789/0 conn(0x7fc26c15bb20 legacy=0x7fc26c15bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:36.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.874+0000 7fc271c70640 1 -- 172.21.15.47:0/3245141952 >> v1:172.21.15.47:6789/0 conn(0x7fc26c06c630 legacy=0x7fc26c0ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:36.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.874+0000 7fc271c70640 1 -- 172.21.15.47:0/3245141952 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc26c0cf2a0 con 0x7fc26c06c250 2024-04-01T22:33:36.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.878+0000 7fc271c70640 1 --2- 172.21.15.47:0/3245141952 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc26c06c250 0x7fc26c15aec0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc2600097a0 tx=0x7fc26002b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4495996160bc45fc server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:36.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.882+0000 7fc270c6e640 1 -- 172.21.15.47:0/3245141952 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26002f810 con 0x7fc26c06c250 2024-04-01T22:33:36.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.882+0000 7fc270c6e640 1 -- 172.21.15.47:0/3245141952 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc26002f9b0 con 0x7fc26c06c250 2024-04-01T22:33:36.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.882+0000 7fc270c6e640 1 -- 172.21.15.47:0/3245141952 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26002fd80 con 0x7fc26c06c250 2024-04-01T22:33:36.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.883+0000 7fc273ed4640 1 -- 172.21.15.47:0/3245141952 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc26c06c250 msgr2=0x7fc26c15aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:36.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.883+0000 7fc273ed4640 1 --2- 172.21.15.47:0/3245141952 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc26c06c250 0x7fc26c15aec0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc2600097a0 tx=0x7fc26002b9f0 comp rx=0 tx=0).stop 2024-04-01T22:33:36.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.883+0000 7fc273ed4640 1 -- 172.21.15.47:0/3245141952 shutdown_connections 2024-04-01T22:33:36.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.883+0000 7fc273ed4640 1 --2- 172.21.15.47:0/3245141952 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc26c06c250 0x7fc26c15aec0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:36.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.883+0000 7fc273ed4640 1 -- 172.21.15.47:0/3245141952 >> 172.21.15.47:0/3245141952 conn(0x7fc26c0cfdb0 msgr2=0x7fc26c0d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:36.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.883+0000 7fc273ed4640 1 -- 172.21.15.47:0/3245141952 shutdown_connections 2024-04-01T22:33:36.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.883+0000 7fc273ed4640 1 -- 172.21.15.47:0/3245141952 wait complete. 2024-04-01T22:33:36.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.884+0000 7fc273ed4640 1 Processor -- start 2024-04-01T22:33:36.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.884+0000 7fc273ed4640 1 -- start start 2024-04-01T22:33:36.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.885+0000 7fc273ed4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc26c06c250 0x7fc26c0c6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:36.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.885+0000 7fc273ed4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc26c06c630 0x7fc26c0cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:36.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.885+0000 7fc273ed4640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc26c15bb20 0x7fc26c1f0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:36.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.885+0000 7fc273ed4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc26c0ce340 con 0x7fc26c06c630 2024-04-01T22:33:36.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.885+0000 7fc273ed4640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc26c0ce060 con 0x7fc26c06c250 2024-04-01T22:33:36.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.885+0000 7fc273ed4640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fc26c0ce620 con 0x7fc26c15bb20 2024-04-01T22:33:36.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.886+0000 7fc27146f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc26c06c630 0x7fc26c0cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:36.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.886+0000 7fc271c70640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc26c06c250 0x7fc26c0c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:36.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.886+0000 7fc272471640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc26c15bb20 0x7fc26c1f0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:36.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.886+0000 7fc27146f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc26c06c630 0x7fc26c0cb0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54184/0 (socket says 172.21.15.47:54184) 2024-04-01T22:33:36.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.886+0000 7fc27146f640 1 -- 172.21.15.47:0/1880120265 learned_addr learned my addr 172.21.15.47:0/1880120265 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:36.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.889+0000 7fc27146f640 1 -- 172.21.15.47:0/1880120265 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc26c15bb20 msgr2=0x7fc26c1f0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:36.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.889+0000 7fc27146f640 1 --2- 172.21.15.47:0/1880120265 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc26c15bb20 0x7fc26c1f0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:36.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.889+0000 7fc27146f640 1 -- 172.21.15.47:0/1880120265 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc26c06c250 msgr2=0x7fc26c0c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:36.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.889+0000 7fc27146f640 1 --2- 172.21.15.47:0/1880120265 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc26c06c250 0x7fc26c0c6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:36.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.889+0000 7fc27146f640 1 -- 172.21.15.47:0/1880120265 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc26c0b2960 con 0x7fc26c06c630 2024-04-01T22:33:36.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.891+0000 7fc27146f640 1 --2- 172.21.15.47:0/1880120265 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc26c06c630 0x7fc26c0cb0b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc26800c460 tx=0x7fc26800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:36.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.895+0000 7fc25e7fc640 1 -- 172.21.15.47:0/1880120265 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc268017070 con 0x7fc26c06c630 2024-04-01T22:33:36.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.895+0000 7fc25e7fc640 1 -- 172.21.15.47:0/1880120265 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc268005ce0 con 0x7fc26c06c630 2024-04-01T22:33:36.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.895+0000 7fc273ed4640 1 -- 172.21.15.47:0/1880120265 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc26c0b2c40 con 0x7fc26c06c630 2024-04-01T22:33:36.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.895+0000 7fc25e7fc640 1 -- 172.21.15.47:0/1880120265 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc268007290 con 0x7fc26c06c630 2024-04-01T22:33:36.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.895+0000 7fc273ed4640 1 -- 172.21.15.47:0/1880120265 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc26c0b3200 con 0x7fc26c06c630 2024-04-01T22:33:36.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:36.897+0000 7fc273ed4640 1 -- 172.21.15.47:0/1880120265 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc26c068210 con 0x7fc26c06c630 2024-04-01T22:33:37.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:37.164+0000 7fc25e7fc640 1 -- 172.21.15.47:0/1880120265 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7fc26801a070 con 0x7fc26c06c630 2024-04-01T22:33:37.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:37.164+0000 7fc25e7fc640 1 --2- 172.21.15.47:0/1880120265 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fc25006ba10 0x7fc25006ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:37.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:37.164+0000 7fc271c70640 1 --2- 172.21.15.47:0/1880120265 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fc25006ba10 0x7fc25006ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:37.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:37.165+0000 7fc271c70640 1 --2- 172.21.15.47:0/1880120265 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fc25006ba10 0x7fc25006ded0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc260036000 tx=0x7fc260008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:37.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:37.179+0000 7fc25e7fc640 1 -- 172.21.15.47:0/1880120265 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc268056460 con 0x7fc26c06c630 2024-04-01T22:33:37.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:37.179+0000 7fc25e7fc640 1 -- 172.21.15.47:0/1880120265 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc268021080 con 0x7fc26c06c630 2024-04-01T22:33:37.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:37.369+0000 7fc273ed4640 1 -- 172.21.15.47:0/1880120265 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc26c1598b0 con 0x7fc26c06c630 2024-04-01T22:33:37.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:37.412+0000 7fc25e7fc640 1 -- 172.21.15.47:0/1880120265 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18526 (secure 0 0 0) 0x7fc2680583c0 con 0x7fc26c06c630 2024-04-01T22:33:37.412 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:33:37.412 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"fsid":"a6998a48-38bc-4e42-b0d9-04f2fb5c3c87","created":"2024-04-01T22:32:57.112033+0000","modified":"2024-04-01T22:33:33.448062+0000","last_up_change":"2024-04-01T22:33:11.141073+0000","last_in_change":"2024-04-01T22:33:02.650459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T22:33:13.356568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T22:33:25.309421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T22:33:26.268050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-01T22:33:30.588103+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7bd3f25d-e3a5-4932-b381-53dcbb464dde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6811","nonce":3827395709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6813","nonce":3827395709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6817","nonce":3827395709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6815","nonce":3827395709}]},"public_addr":"172.21.15.47:6811/3827395709","cluster_addr":"172.21.15.47:6813/3827395709","heartbeat_back_addr":"172.21.15.47:6817/3827395709","heartbeat_front_addr":"172.21.15.47:6815/3827395709","state":["exists","up"]},{"osd":1,"uuid":"2aa60ba2-67ff-43c7-96c4-82ae2f3855ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6827","nonce":3152157503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6829","nonce":3152157503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6833","nonce":3152157503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6831","nonce":3152157503}]},"public_addr":"172.21.15.47:6827/3152157503","cluster_addr":"172.21.15.47:6829/3152157503","heartbeat_back_addr":"172.21.15.47:6833/3152157503","heartbeat_front_addr":"172.21.15.47:6831/3152157503","state":["exists","up"]},{"osd":2,"uuid":"d83f8a98-6db8-42b7-9ef6-5b16eb9a3492","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6803","nonce":1003968856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6805","nonce":1003968856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6809","nonce":1003968856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6807","nonce":1003968856}]},"public_addr":"172.21.15.47:6803/1003968856","cluster_addr":"172.21.15.47:6805/1003968856","heartbeat_back_addr":"172.21.15.47:6809/1003968856","heartbeat_front_addr":"172.21.15.47:6807/1003968856","state":["exists","up"]},{"osd":3,"uuid":"edc02ed5-d25c-4dc9-a0c3-7a26f20fae07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6819","nonce":2845699561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6821","nonce":2845699561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6825","nonce":2845699561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6823","nonce":2845699561}]},"public_addr":"172.21.15.47:6819/2845699561","cluster_addr":"172.21.15.47:6821/2845699561","heartbeat_back_addr":"172.21.15.47:6825/2845699561","heartbeat_front_addr":"172.21.15.47:6823/2845699561","state":["exists","up"]},{"osd":4,"uuid":"b3d67e74-f51e-4474-9c62-dd0daa60c728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6809","nonce":2961538461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6811","nonce":2961538461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6815","nonce":2961538461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6813","nonce":2961538461}]},"public_addr":"172.21.15.181:6809/2961538461","cluster_addr":"172.21.15.181:6811/2961538461","heartbeat_back_addr":"172.21.15.181:6815/2961538461","heartbeat_front_addr":"172.21.15.181:6813/2961538461","state":["exists","up"]},{"osd":5,"uuid":"d86e8f7a-99f4-4457-9949-cf2cb853e79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6817","nonce":2161566540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6819","nonce":2161566540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6823","nonce":2161566540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6821","nonce":2161566540}]},"public_addr":"172.21.15.181:6817/2161566540","cluster_addr":"172.21.15.181:6819/2161566540","heartbeat_back_addr":"172.21.15.181:6823/2161566540","heartbeat_front_addr":"172.21.15.181:6821/2161566540","state":["exists","up"]},{"osd":6,"uuid":"aa08266c-1719-4abd-afb9-e7e8ac593658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6801","nonce":3792144865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6803","nonce":3792144865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6807","nonce":3792144865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6805","nonce":3792144865}]},"public_addr":"172.21.15.181:6801/3792144865","cluster_addr":"172.21.15.181:6803/3792144865","heartbeat_back_addr":"172.21.15.181:6807/3792144865","heartbeat_front_addr":"172.21.15.181:6805/3792144865","state":["exists","up"]},{"osd":7,"uuid":"6e509762-24c8-46c3-93a1-4c50b11ebcf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6825","nonce":1760995885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6827","nonce":1760995885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6831","nonce":1760995885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6829","nonce":1760995885}]},"public_addr":"172.21.15.181:6825/1760995885","cluster_addr":"172.21.15.181:6827/1760995885","heartbeat_back_addr":"172.21.15.181:6831/1760995885","heartbeat_front_addr":"172.21.15.181:6829/1760995885","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.202426+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.255318+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.170288+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.290065+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.214871+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.176432+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.139940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.299546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T22:33:37.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:37.415+0000 7fc273ed4640 1 -- 172.21.15.47:0/1880120265 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fc25006ba10 msgr2=0x7fc25006ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:37.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:37.415+0000 7fc273ed4640 1 --2- 172.21.15.47:0/1880120265 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fc25006ba10 0x7fc25006ded0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc260036000 tx=0x7fc260008030 comp rx=0 tx=0).stop 2024-04-01T22:33:37.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:37.415+0000 7fc273ed4640 1 -- 172.21.15.47:0/1880120265 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc26c06c630 msgr2=0x7fc26c0cb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:37.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:37.415+0000 7fc273ed4640 1 --2- 172.21.15.47:0/1880120265 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc26c06c630 0x7fc26c0cb0b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc26800c460 tx=0x7fc26800c920 comp rx=0 tx=0).stop 2024-04-01T22:33:37.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:37.415+0000 7fc273ed4640 1 -- 172.21.15.47:0/1880120265 shutdown_connections 2024-04-01T22:33:37.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:37.415+0000 7fc273ed4640 1 --2- 172.21.15.47:0/1880120265 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fc25006ba10 0x7fc25006ded0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:37.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:37.415+0000 7fc273ed4640 1 --2- 172.21.15.47:0/1880120265 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc26c15bb20 0x7fc26c1f0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:37.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:37.415+0000 7fc273ed4640 1 --2- 172.21.15.47:0/1880120265 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc26c06c630 0x7fc26c0cb0b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:37.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:37.415+0000 7fc273ed4640 1 --2- 172.21.15.47:0/1880120265 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc26c06c250 0x7fc26c0c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:37.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:37.415+0000 7fc273ed4640 1 -- 172.21.15.47:0/1880120265 >> 172.21.15.47:0/1880120265 conn(0x7fc26c0cfdb0 msgr2=0x7fc26c15a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:37.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:37.416+0000 7fc273ed4640 1 -- 172.21.15.47:0/1880120265 shutdown_connections 2024-04-01T22:33:37.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:37.416+0000 7fc273ed4640 1 -- 172.21.15.47:0/1880120265 wait complete. 2024-04-01T22:33:38.031 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-01T22:33:27.610692+0000', 'modified': '2024-04-01T22:33:33.452988+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4254}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4254': {'gid': 4254, 'name': 'e', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.47:6835/1610100855', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6834', 'nonce': 1610100855}, {'type': 'v1', 'addr': '172.21.15.47:6835', 'nonce': 1610100855}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4254, 'qdb_cluster': [4254]} 2024-04-01T22:33:38.031 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-01T22:33:38.031 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-04-01T22:33:38.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.134+0000 7f6dbe97a640 1 Processor -- start 2024-04-01T22:33:38.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.134+0000 7f6dbe97a640 1 -- start start 2024-04-01T22:33:38.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.135+0000 7f6dbe97a640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6db80c93f0 0x7f6db80cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:38.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.135+0000 7f6dbe97a640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6db80cc0d0 0x7f6db80cc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:38.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.135+0000 7f6dbe97a640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6db80ccaa0 con 0x7f6db815afc0 2024-04-01T22:33:38.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.135+0000 7f6dbe97a640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f6db80cdae0 con 0x7f6db80cc0d0 2024-04-01T22:33:38.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.135+0000 7f6dbe97a640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6db80c97d0 con 0x7f6db80c93f0 2024-04-01T22:33:38.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.136+0000 7f6dbcf17640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6db80cc0d0 0x7f6db80cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:38.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.136+0000 7f6db7fff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6db80c93f0 0x7f6db80cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:38.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.136+0000 7f6dbcf17640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6db80cc0d0 0x7f6db80cc560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54194/0 (socket says 172.21.15.47:54194) 2024-04-01T22:33:38.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.136+0000 7f6dbcf17640 1 -- 172.21.15.47:0/1842590812 learned_addr learned my addr 172.21.15.47:0/1842590812 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:38.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.139+0000 7f6db7fff640 1 -- 172.21.15.47:0/1842590812 >> v2:172.21.15.47:3300/0 conn(0x7f6db80cc0d0 msgr2=0x7f6db80cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:38.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.139+0000 7f6db7fff640 1 --2- 172.21.15.47:0/1842590812 >> v2:172.21.15.47:3300/0 conn(0x7f6db80cc0d0 0x7f6db80cc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:38.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.139+0000 7f6db7fff640 1 -- 172.21.15.47:0/1842590812 >> v1:172.21.15.47:6789/0 conn(0x7f6db815afc0 legacy=0x7f6db806c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:38.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.139+0000 7f6db7fff640 1 -- 172.21.15.47:0/1842590812 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6db80cdd80 con 0x7f6db80c93f0 2024-04-01T22:33:38.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.141+0000 7f6db7fff640 1 --2- 172.21.15.47:0/1842590812 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6db80c93f0 0x7f6db80cee30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0097a0 tx=0x7f6dac02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9b873097232df1f server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:38.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.144+0000 7f6db6ffd640 1 -- 172.21.15.47:0/1842590812 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dac0315a0 con 0x7f6db80c93f0 2024-04-01T22:33:38.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.144+0000 7f6db6ffd640 1 -- 172.21.15.47:0/1842590812 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dac037070 con 0x7f6db80c93f0 2024-04-01T22:33:38.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.144+0000 7f6db6ffd640 1 -- 172.21.15.47:0/1842590812 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dac031960 con 0x7f6db80c93f0 2024-04-01T22:33:38.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.145+0000 7f6dbe97a640 1 -- 172.21.15.47:0/1842590812 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6db80c93f0 msgr2=0x7f6db80cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:38.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.145+0000 7f6dbe97a640 1 --2- 172.21.15.47:0/1842590812 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6db80c93f0 0x7f6db80cee30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0097a0 tx=0x7f6dac02b840 comp rx=0 tx=0).stop 2024-04-01T22:33:38.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.145+0000 7f6dbe97a640 1 -- 172.21.15.47:0/1842590812 shutdown_connections 2024-04-01T22:33:38.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.145+0000 7f6dbe97a640 1 --2- 172.21.15.47:0/1842590812 >> v2:172.21.15.47:3300/0 conn(0x7f6db80cc0d0 0x7f6db80cc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:38.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.145+0000 7f6dbe97a640 1 --2- 172.21.15.47:0/1842590812 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6db80c93f0 0x7f6db80cee30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:38.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.145+0000 7f6dbe97a640 1 -- 172.21.15.47:0/1842590812 >> 172.21.15.47:0/1842590812 conn(0x7f6db80cfdb0 msgr2=0x7f6db80d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:38.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.145+0000 7f6dbe97a640 1 -- 172.21.15.47:0/1842590812 shutdown_connections 2024-04-01T22:33:38.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.145+0000 7f6dbe97a640 1 -- 172.21.15.47:0/1842590812 wait complete. 2024-04-01T22:33:38.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.146+0000 7f6dbe97a640 1 Processor -- start 2024-04-01T22:33:38.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.146+0000 7f6dbe97a640 1 -- start start 2024-04-01T22:33:38.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.147+0000 7f6dbe97a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6db80c93f0 0x7f6db80ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:38.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.147+0000 7f6dbe97a640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6db80cc0d0 0x7f6db8151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:38.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.147+0000 7f6dbe97a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6db815afc0 0x7f6db8152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:38.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.147+0000 7f6dbe97a640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6db80ce620 con 0x7f6db80c93f0 2024-04-01T22:33:38.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.147+0000 7f6dbe97a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6db80ce340 con 0x7f6db815afc0 2024-04-01T22:33:38.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.147+0000 7f6dbe97a640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6db815b400 con 0x7f6db80cc0d0 2024-04-01T22:33:38.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.148+0000 7f6db7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6db80c93f0 0x7f6db80ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:38.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.148+0000 7f6db77fe640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6db80cc0d0 0x7f6db8151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:38.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.148+0000 7f6dbcf17640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6db815afc0 0x7f6db8152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:38.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.148+0000 7f6db7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6db80c93f0 0x7f6db80ae2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54206/0 (socket says 172.21.15.47:54206) 2024-04-01T22:33:38.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.148+0000 7f6db7fff640 1 -- 172.21.15.47:0/3953062267 learned_addr learned my addr 172.21.15.47:0/3953062267 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:38.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.151+0000 7f6db7fff640 1 -- 172.21.15.47:0/3953062267 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6db80cc0d0 msgr2=0x7f6db8151ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:38.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.151+0000 7f6db7fff640 1 --2- 172.21.15.47:0/3953062267 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6db80cc0d0 0x7f6db8151ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:38.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.151+0000 7f6db7fff640 1 -- 172.21.15.47:0/3953062267 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6db815afc0 msgr2=0x7f6db8152420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:38.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.151+0000 7f6db7fff640 1 --2- 172.21.15.47:0/3953062267 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6db815afc0 0x7f6db8152420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:38.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.151+0000 7f6db7fff640 1 -- 172.21.15.47:0/3953062267 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6db80ab250 con 0x7f6db80c93f0 2024-04-01T22:33:38.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.154+0000 7f6db7fff640 1 --2- 172.21.15.47:0/3953062267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6db80c93f0 0x7f6db80ae2e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6dac034040 tx=0x7f6dac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:38.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.157+0000 7f6db4ff9640 1 -- 172.21.15.47:0/3953062267 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dac032840 con 0x7f6db80c93f0 2024-04-01T22:33:38.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.157+0000 7f6db4ff9640 1 -- 172.21.15.47:0/3953062267 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dac032a00 con 0x7f6db80c93f0 2024-04-01T22:33:38.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.158+0000 7f6db4ff9640 1 -- 172.21.15.47:0/3953062267 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dac032df0 con 0x7f6db80c93f0 2024-04-01T22:33:38.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.158+0000 7f6dbe97a640 1 -- 172.21.15.47:0/3953062267 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6db81f0da0 con 0x7f6db80c93f0 2024-04-01T22:33:38.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.158+0000 7f6dbe97a640 1 -- 172.21.15.47:0/3953062267 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6db80ab7d0 con 0x7f6db80c93f0 2024-04-01T22:33:38.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.160+0000 7f6dc1638740 1 Processor -- start 2024-04-01T22:33:38.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.160+0000 7f6dc1638740 1 -- start start 2024-04-01T22:33:38.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.161+0000 7f6dc1638740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56350f9a7a40 0x56350f9a84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:38.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.161+0000 7f6dc1638740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56350f964a00 0x56350f9b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:38.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.161+0000 7f6dc1638740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56350f9a7e20 0x56350f9b0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:38.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.161+0000 7f6dc1638740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56350f8caaf0 con 0x56350f9a7e20 2024-04-01T22:33:38.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.161+0000 7f6dc1638740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56350f8739d0 con 0x56350f964a00 2024-04-01T22:33:38.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.161+0000 7f6dc1638740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x56350f8c6b90 con 0x56350f9a7a40 2024-04-01T22:33:38.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.162+0000 7f6db7fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56350f964a00 0x56350f9b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:38.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.162+0000 7f6dbcf17640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56350f9a7a40 0x56350f9a84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:38.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.162+0000 7f6dbcf17640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56350f9a7a40 0x56350f9a84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:51300/0 (socket says 172.21.15.47:51300) 2024-04-01T22:33:38.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.162+0000 7f6db7fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56350f964a00 0x56350f9b0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:51054/0 (socket says 172.21.15.47:51054) 2024-04-01T22:33:38.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.162+0000 7f6dbcf17640 1 -- 172.21.15.47:0/1509496627 learned_addr learned my addr 172.21.15.47:0/1509496627 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:38.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.164+0000 7f6dbcf17640 1 -- 172.21.15.47:0/1509496627 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56350f964a00 msgr2=0x56350f9b0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:38.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.164+0000 7f6dbcf17640 1 --2- 172.21.15.47:0/1509496627 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56350f964a00 0x56350f9b0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:38.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.164+0000 7f6dbcf17640 1 -- 172.21.15.47:0/1509496627 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56350f9a7e20 msgr2=0x56350f9b0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:38.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.164+0000 7f6dbcf17640 1 --2- 172.21.15.47:0/1509496627 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56350f9a7e20 0x56350f9b0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:38.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.164+0000 7f6dbcf17640 1 -- 172.21.15.47:0/1509496627 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56350f5df2d0 con 0x56350f9a7a40 2024-04-01T22:33:38.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.166+0000 7f6dbcf17640 1 --2- 172.21.15.47:0/1509496627 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56350f9a7a40 0x56350f9a84f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6db00115e0 tx=0x7f6db0009810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=973a8738aa1fa825 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:38.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.168+0000 7f6d9dffb640 1 -- 172.21.15.47:0/1509496627 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db0019070 con 0x56350f9a7a40 2024-04-01T22:33:38.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.170+0000 7f6d9dffb640 1 -- 172.21.15.47:0/1509496627 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6db0015630 con 0x56350f9a7a40 2024-04-01T22:33:38.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.170+0000 7f6d9dffb640 1 -- 172.21.15.47:0/1509496627 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db00159e0 con 0x56350f9a7a40 2024-04-01T22:33:38.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.171+0000 7f6dc1638740 1 -- 172.21.15.47:0/1509496627 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56350f9a7a40 msgr2=0x56350f9a84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:38.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.171+0000 7f6dc1638740 1 --2- 172.21.15.47:0/1509496627 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56350f9a7a40 0x56350f9a84f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6db00115e0 tx=0x7f6db0009810 comp rx=0 tx=0).stop 2024-04-01T22:33:38.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.171+0000 7f6dc1638740 1 -- 172.21.15.47:0/1509496627 shutdown_connections 2024-04-01T22:33:38.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.171+0000 7f6dc1638740 1 --2- 172.21.15.47:0/1509496627 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56350f9a7e20 0x56350f9b0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:38.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.171+0000 7f6dc1638740 1 --2- 172.21.15.47:0/1509496627 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56350f964a00 0x56350f9b0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:38.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.171+0000 7f6dc1638740 1 --2- 172.21.15.47:0/1509496627 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56350f9a7a40 0x56350f9a84f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:38.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.171+0000 7f6dc1638740 1 -- 172.21.15.47:0/1509496627 >> 172.21.15.47:0/1509496627 conn(0x56350f9636b0 msgr2=0x56350f965fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:38.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.171+0000 7f6dc1638740 1 -- 172.21.15.47:0/1509496627 shutdown_connections 2024-04-01T22:33:38.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.171+0000 7f6dc1638740 1 -- 172.21.15.47:0/1509496627 wait complete. 2024-04-01T22:33:38.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.171+0000 7f6dc1638740 1 -- start start 2024-04-01T22:33:38.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.172+0000 7f6dc1638740 1 Processor -- start 2024-04-01T22:33:38.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.172+0000 7f6dc1638740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56350f9a7a40 0x56350f98b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:38.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.172+0000 7f6dc1638740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56350f9a7e20 0x56350f9aa1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:38.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.172+0000 7f6dc1638740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56350f98c2d0 0x56350f981190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:38.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.172+0000 7f6dc1638740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56350f966ed0 con 0x56350f98c2d0 2024-04-01T22:33:38.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.172+0000 7f6dc1638740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56350f886f70 con 0x56350f9a7a40 2024-04-01T22:33:38.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.172+0000 7f6dc1638740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x56350f967190 con 0x56350f9a7e20 2024-04-01T22:33:38.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.173+0000 7f6dc1638740 10 client.0 _ll_register_callbacks cb 0x56350f5deac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T22:33:38.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.173+0000 7f6dbcf17640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56350f9a7a40 0x56350f98b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:38.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.173+0000 7f6db7fff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56350f9a7e20 0x56350f9aa1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:38.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.174+0000 7f6db7fff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56350f9a7e20 0x56350f9aa1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:51306/0 (socket says 172.21.15.47:51306) 2024-04-01T22:33:38.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.174+0000 7f6db7fff640 1 -- 172.21.15.47:0/3475007322 learned_addr learned my addr 172.21.15.47:0/3475007322 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:38.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.177+0000 7f6db7fff640 1 -- 172.21.15.47:0/3475007322 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56350f9a7a40 msgr2=0x56350f98b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:38.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.177+0000 7f6db7fff640 1 --2- 172.21.15.47:0/3475007322 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56350f9a7a40 0x56350f98b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:38.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.177+0000 7f6db7fff640 1 -- 172.21.15.47:0/3475007322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56350f98c2d0 msgr2=0x56350f981190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:38.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.177+0000 7f6db7fff640 1 --2- 172.21.15.47:0/3475007322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56350f98c2d0 0x56350f981190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:38.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.177+0000 7f6db7fff640 1 -- 172.21.15.47:0/3475007322 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x56350f6a96b0 con 0x56350f9a7e20 2024-04-01T22:33:38.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.178+0000 7f6db4ff9640 1 -- 172.21.15.47:0/3953062267 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f6dac045400 con 0x7f6db80c93f0 2024-04-01T22:33:38.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.178+0000 7f6db4ff9640 1 --2- 172.21.15.47:0/3953062267 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f6da406b900 0x7f6da406ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:38.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.178+0000 7f6dbcf17640 1 --2- 172.21.15.47:0/3953062267 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f6da406b900 0x7f6da406ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:38.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.179+0000 7f6dbcf17640 1 --2- 172.21.15.47:0/3953062267 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f6da406b900 0x7f6da406ddc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6db0000f80 tx=0x7f6db0016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:38.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.179+0000 7f6db7fff640 1 --2- 172.21.15.47:0/3475007322 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56350f9a7e20 0x56350f9aa1d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6dac02be50 tx=0x7f6dac03d040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df070ce913a8ad42 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:38.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.179+0000 7f6d96ffd640 10 client.0 ms_handle_connect on v2:172.21.15.181:3301/0 2024-04-01T22:33:38.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.182+0000 7f6db4ff9640 1 -- 172.21.15.47:0/3953062267 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6dac02f030 con 0x7f6db80c93f0 2024-04-01T22:33:38.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.183+0000 7f6d96ffd640 1 -- 172.21.15.47:0/3475007322 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dac07ec80 con 0x56350f9a7e20 2024-04-01T22:33:38.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.183+0000 7f6d96ffd640 1 -- 172.21.15.47:0/3475007322 <== mon.2 v2:172.21.15.181:3301/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6dac07f050 con 0x56350f9a7e20 2024-04-01T22:33:38.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.183+0000 7f6dc1638740 1 -- 172.21.15.47:0/3475007322 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6db0015630 con 0x56350f9a7e20 2024-04-01T22:33:38.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.185+0000 7f6d96ffd640 1 -- 172.21.15.47:0/3475007322 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f6dac082340 con 0x56350f9a7e20 2024-04-01T22:33:38.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.185+0000 7f6dc1638740 10 client.4325 fetch_fsmap learned FSMap version 6 2024-04-01T22:33:38.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.185+0000 7f6dc1638740 1 -- 172.21.15.47:0/3475007322 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x56350f989600 con 0x56350f9a7e20 2024-04-01T22:33:38.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.200+0000 7f6d96ffd640 1 -- 172.21.15.47:0/3475007322 <== mon.2 v2:172.21.15.181:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6db0015630 con 0x56350f9a7e20 2024-04-01T22:33:38.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.200+0000 7f6d96ffd640 1 -- 172.21.15.47:0/3475007322 <== mon.2 v2:172.21.15.181:3301/0 5 ==== fsmap(e 6) ==== 4712+0+0 (secure 0 0 0) 0x7f6dac0ae060 con 0x56350f9a7e20 2024-04-01T22:33:38.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.200+0000 7f6dc1638740 10 client.4325 fetch_fsmap finished waiting for FSMap version 6 2024-04-01T22:33:38.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.200+0000 7f6dc1638740 10 client.4325 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-01T22:33:38.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.200+0000 7f6dc1638740 20 client.4325 populate_metadata read hostname 'smithi047' 2024-04-01T22:33:38.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.200+0000 7f6dc1638740 1 --2- 172.21.15.47:0/3475007322 >> [v2:172.21.15.47:6834/1610100855,v1:172.21.15.47:6835/1610100855] conn(0x56350f9c4790 0x56350f9c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:38.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.200+0000 7f6dc1638740 4 client.4325 mds_command: new command op to 4254 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T22:33:38.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.200+0000 7f6dc1638740 1 -- 172.21.15.47:0/3475007322 --> [v2:172.21.15.47:6834/1610100855,v1:172.21.15.47:6835/1610100855] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56350f8d8030 con 0x56350f9c4790 2024-04-01T22:33:38.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.209+0000 7f6db77fe640 1 --2- 172.21.15.47:0/3475007322 >> [v2:172.21.15.47:6834/1610100855,v1:172.21.15.47:6835/1610100855] conn(0x56350f9c4790 0x56350f9c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:38.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.300+0000 7f6db77fe640 1 --2- 172.21.15.47:0/3475007322 >> [v2:172.21.15.47:6834/1610100855,v1:172.21.15.47:6835/1610100855] conn(0x56350f9c4790 0x56350f9c6b80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55feab6c2d5771ac server_cookie=f6434bdf1f4ada33 in_seq=0 out_seq=0 2024-04-01T22:33:38.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.300+0000 7f6d96ffd640 10 client.4325 ms_handle_connect on v2:172.21.15.47:6834/1610100855 2024-04-01T22:33:38.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.423+0000 7f6d96ffd640 1 -- 172.21.15.47:0/3475007322 <== mds.0 v2:172.21.15.47:6834/1610100855 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56350f8d8030 con 0x56350f9c4790 2024-04-01T22:33:38.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.423+0000 7f6d96ffd640 10 client.4325 handle_command_reply: tid=0 2024-04-01T22:33:38.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.423+0000 7f6dc1638740 1 client.4325 shutdown 2024-04-01T22:33:38.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.423+0000 7f6dc1638740 1 -- 172.21.15.47:0/3475007322 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56350f9a7e20 msgr2=0x56350f9aa1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:38.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.423+0000 7f6dc1638740 1 --2- 172.21.15.47:0/3475007322 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56350f9a7e20 0x56350f9aa1d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6dac02be50 tx=0x7f6dac03d040 comp rx=0 tx=0).stop 2024-04-01T22:33:38.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.423+0000 7f6dc1638740 1 -- 172.21.15.47:0/3475007322 shutdown_connections 2024-04-01T22:33:38.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.423+0000 7f6dc1638740 1 --2- 172.21.15.47:0/3475007322 >> [v2:172.21.15.47:6834/1610100855,v1:172.21.15.47:6835/1610100855] conn(0x56350f9c4790 0x56350f9c6b80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:38.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.423+0000 7f6dc1638740 1 --2- 172.21.15.47:0/3475007322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56350f98c2d0 0x56350f981190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:38.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.423+0000 7f6dc1638740 1 --2- 172.21.15.47:0/3475007322 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56350f9a7e20 0x56350f9aa1d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:38.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.423+0000 7f6d96ffd640 0 client.4325 ms_handle_reset on v2:172.21.15.47:6834/1610100855 2024-04-01T22:33:38.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.423+0000 7f6dc1638740 1 --2- 172.21.15.47:0/3475007322 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56350f9a7a40 0x56350f98b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:38.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.423+0000 7f6dc1638740 1 -- 172.21.15.47:0/3475007322 >> 172.21.15.47:0/3475007322 conn(0x56350f964a00 msgr2=0x56350f987d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:38.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.424+0000 7f6dc1638740 1 -- 172.21.15.47:0/3475007322 shutdown_connections 2024-04-01T22:33:38.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.424+0000 7f6dc1638740 1 -- 172.21.15.47:0/3475007322 wait complete. 2024-04-01T22:33:38.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.424+0000 7f6dc1638740 20 client.4325 trim_cache size 0 max 16384 2024-04-01T22:33:38.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.443+0000 7f6dc1638740 1 Processor -- start 2024-04-01T22:33:38.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.443+0000 7f6dc1638740 1 -- start start 2024-04-01T22:33:38.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.444+0000 7f6dc1638740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56350f98c2d0 0x56350f968240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:38.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.444+0000 7f6dc1638740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56350f9a7a40 0x56350f968780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:38.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.444+0000 7f6dc1638740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56350f9a7e20 0x56350f9b77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:38.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.444+0000 7f6dc1638740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6db81fcea0 con 0x56350f98c2d0 2024-04-01T22:33:38.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.444+0000 7f6dc1638740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56350f966ed0 con 0x56350f9a7a40 2024-04-01T22:33:38.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.444+0000 7f6dc1638740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x56350f967190 con 0x56350f9a7e20 2024-04-01T22:33:38.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.444+0000 7f6db7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56350f98c2d0 0x56350f968240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:38.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.445+0000 7f6db7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56350f98c2d0 0x56350f968240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54240/0 (socket says 172.21.15.47:54240) 2024-04-01T22:33:38.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.445+0000 7f6db7fff640 1 -- 172.21.15.47:0/3861028345 learned_addr learned my addr 172.21.15.47:0/3861028345 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:38.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.445+0000 7f6db77fe640 1 --2- 172.21.15.47:0/3861028345 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56350f9a7a40 0x56350f968780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:38.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.445+0000 7f6dbcf17640 1 --2- 172.21.15.47:0/3861028345 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56350f9a7e20 0x56350f9b77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:38.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.447+0000 7f6db7fff640 1 -- 172.21.15.47:0/3861028345 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56350f9a7e20 msgr2=0x56350f9b77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:38.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.447+0000 7f6db7fff640 1 --2- 172.21.15.47:0/3861028345 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56350f9a7e20 0x56350f9b77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:38.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.447+0000 7f6db7fff640 1 -- 172.21.15.47:0/3861028345 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56350f9a7a40 msgr2=0x56350f968780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:38.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.447+0000 7f6db7fff640 1 --2- 172.21.15.47:0/3861028345 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56350f9a7a40 0x56350f968780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:38.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.447+0000 7f6db7fff640 1 -- 172.21.15.47:0/3861028345 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56350f963b80 con 0x56350f98c2d0 2024-04-01T22:33:38.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.449+0000 7f6db7fff640 1 --2- 172.21.15.47:0/3861028345 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56350f98c2d0 0x56350f968240 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6dac07ee40 tx=0x7f6dac0b4000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52f1afaf26c4b143 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:38.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.452+0000 7f6d9d7fa640 1 -- 172.21.15.47:0/3861028345 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dac082520 con 0x56350f98c2d0 2024-04-01T22:33:38.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.452+0000 7f6d9d7fa640 1 -- 172.21.15.47:0/3861028345 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dac037040 con 0x56350f98c2d0 2024-04-01T22:33:38.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.452+0000 7f6d9d7fa640 1 -- 172.21.15.47:0/3861028345 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dac0827b0 con 0x56350f98c2d0 2024-04-01T22:33:38.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.453+0000 7f6dc1638740 1 -- 172.21.15.47:0/3861028345 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56350f98c2d0 msgr2=0x56350f968240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:38.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.453+0000 7f6dc1638740 1 --2- 172.21.15.47:0/3861028345 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56350f98c2d0 0x56350f968240 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6dac07ee40 tx=0x7f6dac0b4000 comp rx=0 tx=0).stop 2024-04-01T22:33:38.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.453+0000 7f6dc1638740 1 -- 172.21.15.47:0/3861028345 shutdown_connections 2024-04-01T22:33:38.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.453+0000 7f6dc1638740 1 --2- 172.21.15.47:0/3861028345 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56350f9a7e20 0x56350f9b77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:38.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.453+0000 7f6dc1638740 1 --2- 172.21.15.47:0/3861028345 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56350f9a7a40 0x56350f968780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:38.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.453+0000 7f6dc1638740 1 --2- 172.21.15.47:0/3861028345 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56350f98c2d0 0x56350f968240 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:38.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.453+0000 7f6dc1638740 1 -- 172.21.15.47:0/3861028345 >> 172.21.15.47:0/3861028345 conn(0x56350f964a00 msgr2=0x56350f95c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:38.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.453+0000 7f6dc1638740 1 -- 172.21.15.47:0/3861028345 shutdown_connections 2024-04-01T22:33:38.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.453+0000 7f6dc1638740 1 -- 172.21.15.47:0/3861028345 wait complete. 2024-04-01T22:33:38.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.454+0000 7f6dc1638740 1 -- start start 2024-04-01T22:33:38.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.454+0000 7f6dc1638740 1 Processor -- start 2024-04-01T22:33:38.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.455+0000 7f6dc1638740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56350f98c2d0 0x56350f9cb380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:38.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.455+0000 7f6dc1638740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56350f9a7a40 0x56350f988010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:38.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.455+0000 7f6dc1638740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56350f9a7e20 0x56350f9cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:38.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.455+0000 7f6dc1638740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56350f9819b0 con 0x56350f98c2d0 2024-04-01T22:33:38.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.455+0000 7f6dc1638740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56350f9b8670 con 0x56350f9a7e20 2024-04-01T22:33:38.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.455+0000 7f6dc1638740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x56350f9bb300 con 0x56350f9a7a40 2024-04-01T22:33:38.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.455+0000 7f6dc1638740 10 client.0 _ll_register_callbacks cb 0x7f6da8007cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T22:33:38.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.455+0000 7f6db7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56350f98c2d0 0x56350f9cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:38.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.455+0000 7f6db77fe640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56350f9a7a40 0x56350f988010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:38.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.455+0000 7f6dbcf17640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56350f9a7e20 0x56350f9cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:38.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.455+0000 7f6db7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56350f98c2d0 0x56350f9cb380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54252/0 (socket says 172.21.15.47:54252) 2024-04-01T22:33:38.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.455+0000 7f6db7fff640 1 -- 172.21.15.47:0/106099444 learned_addr learned my addr 172.21.15.47:0/106099444 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:38.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.459+0000 7f6db7fff640 1 -- 172.21.15.47:0/106099444 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56350f9a7a40 msgr2=0x56350f988010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:38.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.459+0000 7f6db7fff640 1 --2- 172.21.15.47:0/106099444 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56350f9a7a40 0x56350f988010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:38.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.459+0000 7f6db7fff640 1 -- 172.21.15.47:0/106099444 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56350f9a7e20 msgr2=0x56350f9cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:38.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.459+0000 7f6db7fff640 1 --2- 172.21.15.47:0/106099444 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56350f9a7e20 0x56350f9cc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:38.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.459+0000 7f6db7fff640 1 -- 172.21.15.47:0/106099444 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56350f9cc720 con 0x56350f98c2d0 2024-04-01T22:33:38.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.461+0000 7f6db7fff640 1 --2- 172.21.15.47:0/106099444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56350f98c2d0 0x56350f9cb380 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6dac080c90 tx=0x7f6dac0b6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a29d578205458592 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:38.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.461+0000 7f6d96ffd640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-01T22:33:38.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.465+0000 7f6d96ffd640 1 -- 172.21.15.47:0/106099444 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dac0827b0 con 0x56350f98c2d0 2024-04-01T22:33:38.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.465+0000 7f6d96ffd640 1 -- 172.21.15.47:0/106099444 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6dac0abe00 con 0x56350f98c2d0 2024-04-01T22:33:38.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.465+0000 7f6dc1638740 1 -- 172.21.15.47:0/106099444 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6dac037040 con 0x56350f98c2d0 2024-04-01T22:33:38.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.466+0000 7f6d96ffd640 1 -- 172.21.15.47:0/106099444 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f6dac091050 con 0x56350f98c2d0 2024-04-01T22:33:38.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.466+0000 7f6dc1638740 10 client.4356 fetch_fsmap learned FSMap version 6 2024-04-01T22:33:38.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.466+0000 7f6dc1638740 1 -- 172.21.15.47:0/106099444 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x56350f9cc720 con 0x56350f98c2d0 2024-04-01T22:33:38.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.472+0000 7f6d96ffd640 1 -- 172.21.15.47:0/106099444 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dac037040 con 0x56350f98c2d0 2024-04-01T22:33:38.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.472+0000 7f6d96ffd640 1 -- 172.21.15.47:0/106099444 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 6) ==== 4712+0+0 (secure 0 0 0) 0x7f6dac094020 con 0x56350f98c2d0 2024-04-01T22:33:38.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.472+0000 7f6dc1638740 10 client.4356 fetch_fsmap finished waiting for FSMap version 6 2024-04-01T22:33:38.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.472+0000 7f6dc1638740 10 client.4356 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-01T22:33:38.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.472+0000 7f6dc1638740 20 client.4356 populate_metadata read hostname 'smithi047' 2024-04-01T22:33:38.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.472+0000 7f6dc1638740 1 --2- 172.21.15.47:0/106099444 >> [v2:172.21.15.47:6834/1610100855,v1:172.21.15.47:6835/1610100855] conn(0x56350fa26b80 0x56350fa2f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:38.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.472+0000 7f6dc1638740 4 client.4356 mds_command: new command op to 4254 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-01T22:33:38.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.472+0000 7f6dc1638740 1 -- 172.21.15.47:0/106099444 --> [v2:172.21.15.47:6834/1610100855,v1:172.21.15.47:6835/1610100855] -- command(tid 0: {"prefix": "status"}) -- 0x56350f8d2380 con 0x56350fa26b80 2024-04-01T22:33:38.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.473+0000 7f6db77fe640 1 --2- 172.21.15.47:0/106099444 >> [v2:172.21.15.47:6834/1610100855,v1:172.21.15.47:6835/1610100855] conn(0x56350fa26b80 0x56350fa2f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:38.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.476+0000 7f6db77fe640 1 --2- 172.21.15.47:0/106099444 >> [v2:172.21.15.47:6834/1610100855,v1:172.21.15.47:6835/1610100855] conn(0x56350fa26b80 0x56350fa2f7c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47f9118441f6ec94 server_cookie=e0743458d8642373 in_seq=0 out_seq=0 2024-04-01T22:33:38.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.476+0000 7f6d96ffd640 10 client.4356 ms_handle_connect on v2:172.21.15.47:6834/1610100855 2024-04-01T22:33:38.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.493+0000 7f6d96ffd640 1 -- 172.21.15.47:0/106099444 <== mds.0 v2:172.21.15.47:6834/1610100855 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x56350f8d2380 con 0x56350fa26b80 2024-04-01T22:33:38.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.493+0000 7f6d96ffd640 10 client.4356 handle_command_reply: tid=0 2024-04-01T22:33:38.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.493+0000 7f6dc1638740 1 client.4356 shutdown 2024-04-01T22:33:38.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.494+0000 7f6dc1638740 1 -- 172.21.15.47:0/106099444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56350f98c2d0 msgr2=0x56350f9cb380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:38.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.494+0000 7f6dc1638740 1 --2- 172.21.15.47:0/106099444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56350f98c2d0 0x56350f9cb380 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6dac080c90 tx=0x7f6dac0b6000 comp rx=0 tx=0).stop 2024-04-01T22:33:38.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.494+0000 7f6dc1638740 1 -- 172.21.15.47:0/106099444 shutdown_connections 2024-04-01T22:33:38.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.494+0000 7f6dc1638740 1 --2- 172.21.15.47:0/106099444 >> [v2:172.21.15.47:6834/1610100855,v1:172.21.15.47:6835/1610100855] conn(0x56350fa26b80 0x56350fa2f7c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:38.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.494+0000 7f6dc1638740 1 --2- 172.21.15.47:0/106099444 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56350f9a7e20 0x56350f9cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:38.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.494+0000 7f6dc1638740 1 --2- 172.21.15.47:0/106099444 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x56350f9a7a40 0x56350f988010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:38.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.494+0000 7f6d96ffd640 0 client.4356 ms_handle_reset on v2:172.21.15.47:6834/1610100855 2024-04-01T22:33:38.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.494+0000 7f6dc1638740 1 --2- 172.21.15.47:0/106099444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56350f98c2d0 0x56350f9cb380 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:38.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.494+0000 7f6dc1638740 1 -- 172.21.15.47:0/106099444 >> 172.21.15.47:0/106099444 conn(0x56350f964a00 msgr2=0x56350f9810d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:38.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.494+0000 7f6dc1638740 1 -- 172.21.15.47:0/106099444 shutdown_connections 2024-04-01T22:33:38.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.494+0000 7f6dc1638740 1 -- 172.21.15.47:0/106099444 wait complete. 2024-04-01T22:33:38.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.494+0000 7f6dc1638740 20 client.4356 trim_cache size 0 max 16384 2024-04-01T22:33:38.495 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-01T22:33:38.495 INFO:teuthology.orchestra.run.smithi047.stdout: "cluster_fsid": "a6998a48-38bc-4e42-b0d9-04f2fb5c3c87", 2024-04-01T22:33:38.495 INFO:teuthology.orchestra.run.smithi047.stdout: "whoami": 0, 2024-04-01T22:33:38.495 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 4254, 2024-04-01T22:33:38.495 INFO:teuthology.orchestra.run.smithi047.stdout: "want_state": "up:active", 2024-04-01T22:33:38.495 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "up:active", 2024-04-01T22:33:38.495 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs", 2024-04-01T22:33:38.495 INFO:teuthology.orchestra.run.smithi047.stdout: "rank_uptime": 10.389936819000001, 2024-04-01T22:33:38.495 INFO:teuthology.orchestra.run.smithi047.stdout: "mdsmap_epoch": 6, 2024-04-01T22:33:38.496 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch": 25, 2024-04-01T22:33:38.496 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch_barrier": 25, 2024-04-01T22:33:38.496 INFO:teuthology.orchestra.run.smithi047.stdout: "uptime": 19.261944847999999 2024-04-01T22:33:38.496 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-01T22:33:38.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.494+0000 7f6dbe97a640 1 -- 172.21.15.47:0/3953062267 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f6da406b900 msgr2=0x7f6da406ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:38.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.494+0000 7f6dbe97a640 1 --2- 172.21.15.47:0/3953062267 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f6da406b900 0x7f6da406ddc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6db0000f80 tx=0x7f6db0016000 comp rx=0 tx=0).stop 2024-04-01T22:33:38.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.494+0000 7f6dbe97a640 1 -- 172.21.15.47:0/3953062267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6db80c93f0 msgr2=0x7f6db80ae2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:38.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.494+0000 7f6dbe97a640 1 --2- 172.21.15.47:0/3953062267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6db80c93f0 0x7f6db80ae2e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6dac034040 tx=0x7f6dac0046c0 comp rx=0 tx=0).stop 2024-04-01T22:33:38.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.495+0000 7f6dbe97a640 1 -- 172.21.15.47:0/3953062267 shutdown_connections 2024-04-01T22:33:38.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.495+0000 7f6dbe97a640 1 --2- 172.21.15.47:0/3953062267 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f6da406b900 0x7f6da406ddc0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:38.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.495+0000 7f6dbe97a640 1 --2- 172.21.15.47:0/3953062267 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6db815afc0 0x7f6db8152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:38.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.495+0000 7f6dbe97a640 1 --2- 172.21.15.47:0/3953062267 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6db80cc0d0 0x7f6db8151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:38.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.495+0000 7f6dbe97a640 1 --2- 172.21.15.47:0/3953062267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6db80c93f0 0x7f6db80ae2e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:38.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.495+0000 7f6dbe97a640 1 -- 172.21.15.47:0/3953062267 >> 172.21.15.47:0/3953062267 conn(0x7f6db80cfdb0 msgr2=0x7f6db80b1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:38.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.495+0000 7f6dbe97a640 1 -- 172.21.15.47:0/3953062267 shutdown_connections 2024-04-01T22:33:38.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.495+0000 7f6dbe97a640 1 -- 172.21.15.47:0/3953062267 wait complete. 2024-04-01T22:33:38.505 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-01T22:33:38.505 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-01T22:33:38.506 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-01T22:33:38.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.607+0000 7f2b6d59a640 1 Processor -- start 2024-04-01T22:33:38.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.607+0000 7f2b6d59a640 1 -- start start 2024-04-01T22:33:38.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.608+0000 7f2b6d59a640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2b6815e670 0x7f2b680cda80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:38.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.608+0000 7f2b6d59a640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b6806c9d0 con 0x7f2b680ca040 2024-04-01T22:33:38.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.608+0000 7f2b6d59a640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b6815b000 con 0x7f2b681548a0 2024-04-01T22:33:38.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.608+0000 7f2b6d59a640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f2b6815dad0 con 0x7f2b6815e670 2024-04-01T22:33:38.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.609+0000 7f2b66ffd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f2b681548a0 0x7f2b6815df60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.47:57010/0 (socket says 172.21.15.47:57010) 2024-04-01T22:33:38.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.609+0000 7f2b66ffd640 1 -- 172.21.15.47:0/682410088 learned_addr learned my addr 172.21.15.47:0/682410088 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T22:33:38.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.610+0000 7f2b667fc640 1 --2- 172.21.15.47:0/682410088 >> v2:172.21.15.47:3300/0 conn(0x7f2b6815e670 0x7f2b680cda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:38.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.612+0000 7f2b65ffb640 1 -- 172.21.15.47:0/682410088 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 684369426 0 0) 0x7f2b6815b000 con 0x7f2b681548a0 2024-04-01T22:33:38.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.612+0000 7f2b65ffb640 1 -- 172.21.15.47:0/682410088 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b50003520 con 0x7f2b681548a0 2024-04-01T22:33:38.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.613+0000 7f2b667fc640 1 -- 172.21.15.47:0/682410088 >> v1:172.21.15.181:6789/0 conn(0x7f2b681548a0 legacy=0x7f2b6815df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:38.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.613+0000 7f2b667fc640 1 -- 172.21.15.47:0/682410088 >> v1:172.21.15.47:6789/0 conn(0x7f2b680ca040 legacy=0x7f2b680cdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:38.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.613+0000 7f2b667fc640 1 -- 172.21.15.47:0/682410088 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b6815b2c0 con 0x7f2b6815e670 2024-04-01T22:33:38.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.617+0000 7f2b667fc640 1 --2- 172.21.15.47:0/682410088 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b6815e670 0x7f2b680cda80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c0097a0 tx=0x7f2b5c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea9042889fc2d7b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:38.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.621+0000 7f2b65ffb640 1 -- 172.21.15.47:0/682410088 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c0315a0 con 0x7f2b6815e670 2024-04-01T22:33:38.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.621+0000 7f2b65ffb640 1 -- 172.21.15.47:0/682410088 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b5c037070 con 0x7f2b6815e670 2024-04-01T22:33:38.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.621+0000 7f2b65ffb640 1 -- 172.21.15.47:0/682410088 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c031960 con 0x7f2b6815e670 2024-04-01T22:33:38.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.621+0000 7f2b6d59a640 1 -- 172.21.15.47:0/682410088 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b6815e670 msgr2=0x7f2b680cda80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:38.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.621+0000 7f2b6d59a640 1 --2- 172.21.15.47:0/682410088 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b6815e670 0x7f2b680cda80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c0097a0 tx=0x7f2b5c02b840 comp rx=0 tx=0).stop 2024-04-01T22:33:38.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.621+0000 7f2b6d59a640 1 -- 172.21.15.47:0/682410088 shutdown_connections 2024-04-01T22:33:38.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.621+0000 7f2b6d59a640 1 --2- 172.21.15.47:0/682410088 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b6815e670 0x7f2b680cda80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:38.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.621+0000 7f2b6d59a640 1 -- 172.21.15.47:0/682410088 >> 172.21.15.47:0/682410088 conn(0x7f2b68061b90 msgr2=0x7f2b68061fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:38.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.622+0000 7f2b6d59a640 1 -- 172.21.15.47:0/682410088 shutdown_connections 2024-04-01T22:33:38.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.622+0000 7f2b6d59a640 1 -- 172.21.15.47:0/682410088 wait complete. 2024-04-01T22:33:38.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.623+0000 7f2b6d59a640 1 Processor -- start 2024-04-01T22:33:38.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.623+0000 7f2b6d59a640 1 -- start start 2024-04-01T22:33:38.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.623+0000 7f2b6d59a640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b680ca040 0x7f2b680afdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:38.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.623+0000 7f2b6d59a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b681548a0 0x7f2b68154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:38.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.623+0000 7f2b6d59a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b6815e670 0x7f2b681f3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:38.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.624+0000 7f2b6d59a640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2b680c9ac0 con 0x7f2b681548a0 2024-04-01T22:33:38.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.624+0000 7f2b6d59a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2b680c97e0 con 0x7f2b6815e670 2024-04-01T22:33:38.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.624+0000 7f2b6d59a640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f2b680ce6d0 con 0x7f2b680ca040 2024-04-01T22:33:38.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.624+0000 7f2b667fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b681548a0 0x7f2b68154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:38.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.624+0000 7f2b677fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b6815e670 0x7f2b681f3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:38.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.624+0000 7f2b66ffd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b680ca040 0x7f2b680afdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:38.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.624+0000 7f2b677fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b6815e670 0x7f2b681f3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:51088/0 (socket says 172.21.15.47:51088) 2024-04-01T22:33:38.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.624+0000 7f2b677fe640 1 -- 172.21.15.47:0/1410414985 learned_addr learned my addr 172.21.15.47:0/1410414985 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:38.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.628+0000 7f2b677fe640 1 -- 172.21.15.47:0/1410414985 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b680ca040 msgr2=0x7f2b680afdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:38.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.628+0000 7f2b677fe640 1 --2- 172.21.15.47:0/1410414985 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b680ca040 0x7f2b680afdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:38.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.628+0000 7f2b677fe640 1 -- 172.21.15.47:0/1410414985 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b681548a0 msgr2=0x7f2b68154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:38.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.628+0000 7f2b677fe640 1 --2- 172.21.15.47:0/1410414985 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b681548a0 0x7f2b68154dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:38.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.628+0000 7f2b677fe640 1 -- 172.21.15.47:0/1410414985 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b681556d0 con 0x7f2b6815e670 2024-04-01T22:33:38.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.628+0000 7f2b667fc640 1 --2- 172.21.15.47:0/1410414985 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b681548a0 0x7f2b68154dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T22:33:38.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.630+0000 7f2b677fe640 1 --2- 172.21.15.47:0/1410414985 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b6815e670 0x7f2b681f3770 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2b6000c710 tx=0x7f2b6000cbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:38.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.634+0000 7f2b4f7fe640 1 -- 172.21.15.47:0/1410414985 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b60016020 con 0x7f2b6815e670 2024-04-01T22:33:38.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.634+0000 7f2b4f7fe640 1 -- 172.21.15.47:0/1410414985 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b60006d50 con 0x7f2b6815e670 2024-04-01T22:33:38.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.634+0000 7f2b6d59a640 1 -- 172.21.15.47:0/1410414985 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b681f0310 con 0x7f2b6815e670 2024-04-01T22:33:38.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.634+0000 7f2b4f7fe640 1 -- 172.21.15.47:0/1410414985 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b60003bb0 con 0x7f2b6815e670 2024-04-01T22:33:38.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.634+0000 7f2b6d59a640 1 -- 172.21.15.47:0/1410414985 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b681f08d0 con 0x7f2b6815e670 2024-04-01T22:33:38.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.635+0000 7f2b6d59a640 1 -- 172.21.15.47:0/1410414985 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b68074c20 con 0x7f2b6815e670 2024-04-01T22:33:38.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.654+0000 7f2b4f7fe640 1 -- 172.21.15.47:0/1410414985 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f2b6000a850 con 0x7f2b6815e670 2024-04-01T22:33:38.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.654+0000 7f2b4f7fe640 1 --2- 172.21.15.47:0/1410414985 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f2b5406b9e0 0x7f2b5406dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:38.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.654+0000 7f2b66ffd640 1 --2- 172.21.15.47:0/1410414985 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f2b5406b9e0 0x7f2b5406dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:38.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.655+0000 7f2b66ffd640 1 --2- 172.21.15.47:0/1410414985 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f2b5406b9e0 0x7f2b5406dea0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2b58005880 tx=0x7f2b58009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:38.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.656+0000 7f2b4f7fe640 1 -- 172.21.15.47:0/1410414985 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2b6001cdf0 con 0x7f2b6815e670 2024-04-01T22:33:38.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:38.894+0000 7f2b4f7fe640 1 -- 172.21.15.47:0/1410414985 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f2b60020020 con 0x7f2b6815e670 2024-04-01T22:33:39.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:39.115+0000 7f2b6d59a640 1 -- 172.21.15.47:0/1410414985 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2b68068920 con 0x7f2b6815e670 2024-04-01T22:33:39.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:39.121+0000 7f2b4f7fe640 1 -- 172.21.15.47:0/1410414985 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7f2b6806c9d0 con 0x7f2b6815e670 2024-04-01T22:33:39.121 INFO:teuthology.orchestra.run.smithi047.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-01T22:33:39.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:39.123+0000 7f2b6d59a640 1 -- 172.21.15.47:0/1410414985 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f2b5406b9e0 msgr2=0x7f2b5406dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:39.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:39.123+0000 7f2b6d59a640 1 --2- 172.21.15.47:0/1410414985 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f2b5406b9e0 0x7f2b5406dea0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2b58005880 tx=0x7f2b58009040 comp rx=0 tx=0).stop 2024-04-01T22:33:39.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:39.123+0000 7f2b6d59a640 1 -- 172.21.15.47:0/1410414985 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b6815e670 msgr2=0x7f2b681f3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:39.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:39.123+0000 7f2b6d59a640 1 --2- 172.21.15.47:0/1410414985 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b6815e670 0x7f2b681f3770 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2b6000c710 tx=0x7f2b6000cbd0 comp rx=0 tx=0).stop 2024-04-01T22:33:39.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:39.123+0000 7f2b6d59a640 1 -- 172.21.15.47:0/1410414985 shutdown_connections 2024-04-01T22:33:39.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:39.123+0000 7f2b6d59a640 1 --2- 172.21.15.47:0/1410414985 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f2b5406b9e0 0x7f2b5406dea0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:39.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:39.123+0000 7f2b6d59a640 1 --2- 172.21.15.47:0/1410414985 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b6815e670 0x7f2b681f3770 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:39.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:39.123+0000 7f2b6d59a640 1 --2- 172.21.15.47:0/1410414985 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2b681548a0 0x7f2b68154dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:39.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:39.123+0000 7f2b6d59a640 1 --2- 172.21.15.47:0/1410414985 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2b680ca040 0x7f2b680afdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:39.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:39.123+0000 7f2b6d59a640 1 -- 172.21.15.47:0/1410414985 >> 172.21.15.47:0/1410414985 conn(0x7f2b68061b90 msgr2=0x7f2b6815a330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:39.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:39.124+0000 7f2b6d59a640 1 -- 172.21.15.47:0/1410414985 shutdown_connections 2024-04-01T22:33:39.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:39.124+0000 7f2b6d59a640 1 -- 172.21.15.47:0/1410414985 wait complete. 2024-04-01T22:33:39.134 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-01T22:33:39.134 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-01T22:33:39.134 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi047.front.sepia.ceph.com 2024-04-01T22:33:39.134 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-01T22:33:39.134 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-01T22:33:39.134 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-01T22:33:39.134 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-01T22:33:39.134 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-01T22:33:39.135 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-01T22:33:39.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T22:33:39.135 DEBUG:teuthology.orchestra.run.smithi047:> ip addr 2024-04-01T22:33:39.150 INFO:teuthology.orchestra.run.smithi047.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-01T22:33:39.150 INFO:teuthology.orchestra.run.smithi047.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-01T22:33:39.150 INFO:teuthology.orchestra.run.smithi047.stdout: inet 127.0.0.1/8 scope host lo 2024-04-01T22:33:39.150 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-01T22:33:39.150 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 ::1/128 scope host 2024-04-01T22:33:39.150 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-01T22:33:39.150 INFO:teuthology.orchestra.run.smithi047.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-01T22:33:39.151 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:78 brd ff:ff:ff:ff:ff:ff 2024-04-01T22:33:39.151 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f0 2024-04-01T22:33:39.151 INFO:teuthology.orchestra.run.smithi047.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-01T22:33:39.151 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:79 brd ff:ff:ff:ff:ff:ff 2024-04-01T22:33:39.151 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f1 2024-04-01T22:33:39.151 INFO:teuthology.orchestra.run.smithi047.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-01T22:33:39.151 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8e brd ff:ff:ff:ff:ff:ff 2024-04-01T22:33:39.151 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f0 2024-04-01T22:33:39.151 INFO:teuthology.orchestra.run.smithi047.stdout: inet 172.21.15.47/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-01T22:33:39.151 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft 42245sec preferred_lft 42245sec 2024-04-01T22:33:39.151 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::ec4:7aff:febd:148e/64 scope link noprefixroute 2024-04-01T22:33:39.151 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-01T22:33:39.152 INFO:teuthology.orchestra.run.smithi047.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-01T22:33:39.152 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8f brd ff:ff:ff:ff:ff:ff 2024-04-01T22:33:39.152 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f1 2024-04-01T22:33:39.152 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-01T22:33:39.152 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-01T22:33:39.153 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-04-01T22:33:39.153 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link add name ceph-brx type bridge 2024-04-01T22:33:39.153 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip addr flush dev ceph-brx 2024-04-01T22:33:39.153 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set ceph-brx up 2024-04-01T22:33:39.153 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-01T22:33:39.153 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-04-01T22:33:39.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-01T22:33:39.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-01T22:33:39.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T22:33:39.347 DEBUG:teuthology.orchestra.run.smithi047:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-01T22:33:39.374 INFO:teuthology.orchestra.run.smithi047.stdout:1 2024-04-01T22:33:39.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T22:33:39.375 DEBUG:teuthology.orchestra.run.smithi047:> route 2024-04-01T22:33:39.446 INFO:teuthology.orchestra.run.smithi047.stdout:Kernel IP routing table 2024-04-01T22:33:39.446 INFO:teuthology.orchestra.run.smithi047.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-01T22:33:39.446 INFO:teuthology.orchestra.run.smithi047.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-01T22:33:39.447 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-01T22:33:39.447 INFO:teuthology.orchestra.run.smithi047.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-01T22:33:39.447 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-01T22:33:39.447 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-04-01T22:33:39.447 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-01T22:33:39.447 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-01T22:33:39.447 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-01T22:33:39.447 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-04-01T22:33:39.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-01T22:33:39.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-01T22:33:39.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T22:33:39.797 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-04-01T22:33:39.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T22:33:39.812 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list-id 2024-04-01T22:33:39.867 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-01T22:33:39.867 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-04-01T22:33:39.867 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-01T22:33:39.867 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-01T22:33:39.867 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-04-01T22:33:39.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-01T22:33:39.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-01T22:33:39.989 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-01T22:33:39.989 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-01T22:33:39.990 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-04-01T22:33:39.990 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-01T22:33:39.990 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-01T22:33:39.990 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-01T22:33:39.990 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-01T22:33:39.990 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-01T22:33:39.990 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-04-01T22:33:40.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-01T22:33:40.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-01T22:33:40.123 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-01T22:33:40.123 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-04-01T22:33:40.123 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set brx.0 up 2024-04-01T22:33:40.123 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set dev brx.0 master ceph-brx 2024-04-01T22:33:40.123 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-04-01T22:33:40.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-01T22:33:40.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-01T22:33:40.204 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-01T22:33:40.204 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-01T22:33:40.204 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-01T22:33:40.225 INFO:teuthology.orchestra.run.smithi047.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-01T22:33:40.225 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-01T22:33:40.225 DEBUG:teuthology.orchestra.run.smithi047:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-01T22:33:40.279 DEBUG:teuthology.orchestra.run.smithi047:> sudo modprobe fuse 2024-04-01T22:33:40.347 DEBUG:teuthology.orchestra.run.smithi047:> cat /proc/self/mounts | awk '{print $2}' 2024-04-01T22:33:40.402 INFO:teuthology.orchestra.run.smithi047.stdout:/proc 2024-04-01T22:33:40.402 INFO:teuthology.orchestra.run.smithi047.stdout:/sys 2024-04-01T22:33:40.402 INFO:teuthology.orchestra.run.smithi047.stdout:/dev 2024-04-01T22:33:40.402 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/security 2024-04-01T22:33:40.402 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/shm 2024-04-01T22:33:40.403 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/pts 2024-04-01T22:33:40.403 INFO:teuthology.orchestra.run.smithi047.stdout:/run 2024-04-01T22:33:40.403 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/cgroup 2024-04-01T22:33:40.403 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/pstore 2024-04-01T22:33:40.403 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/bpf 2024-04-01T22:33:40.403 INFO:teuthology.orchestra.run.smithi047.stdout:/ 2024-04-01T22:33:40.403 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/selinux 2024-04-01T22:33:40.403 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/sys/fs/binfmt_misc 2024-04-01T22:33:40.403 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/hugepages 2024-04-01T22:33:40.403 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/mqueue 2024-04-01T22:33:40.403 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/debug 2024-04-01T22:33:40.403 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/tracing 2024-04-01T22:33:40.403 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-01T22:33:40.403 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/fuse/connections 2024-04-01T22:33:40.404 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/config 2024-04-01T22:33:40.404 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-sysctl.service 2024-04-01T22:33:40.404 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-01T22:33:40.404 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/nfs/rpc_pipefs 2024-04-01T22:33:40.404 INFO:teuthology.orchestra.run.smithi047.stdout:/run/user/1000 2024-04-01T22:33:40.404 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph 2024-04-01T22:33:40.404 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-0 2024-04-01T22:33:40.404 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-1 2024-04-01T22:33:40.404 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-2 2024-04-01T22:33:40.404 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-3 2024-04-01T22:33:40.404 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns 2024-04-01T22:33:40.404 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-01T22:33:40.404 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-01T22:33:40.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T22:33:40.405 DEBUG:teuthology.orchestra.run.smithi047:> ls /sys/fs/fuse/connections 2024-04-01T22:33:40.457 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-01T22:33:40.457 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-01T22:33:40.500 DEBUG:teuthology.orchestra.run.smithi047:> sudo modprobe fuse 2024-04-01T22:33:40.526 DEBUG:teuthology.orchestra.run.smithi047:> cat /proc/self/mounts | awk '{print $2}' 2024-04-01T22:33:40.581 INFO:teuthology.orchestra.run.smithi047.stdout:/proc 2024-04-01T22:33:40.581 INFO:teuthology.orchestra.run.smithi047.stdout:/sys 2024-04-01T22:33:40.582 INFO:teuthology.orchestra.run.smithi047.stdout:/dev 2024-04-01T22:33:40.582 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/security 2024-04-01T22:33:40.582 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/shm 2024-04-01T22:33:40.582 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/pts 2024-04-01T22:33:40.582 INFO:teuthology.orchestra.run.smithi047.stdout:/run 2024-04-01T22:33:40.582 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/cgroup 2024-04-01T22:33:40.582 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/pstore 2024-04-01T22:33:40.582 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/bpf 2024-04-01T22:33:40.582 INFO:teuthology.orchestra.run.smithi047.stdout:/ 2024-04-01T22:33:40.582 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/selinux 2024-04-01T22:33:40.582 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/sys/fs/binfmt_misc 2024-04-01T22:33:40.582 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/hugepages 2024-04-01T22:33:40.582 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/mqueue 2024-04-01T22:33:40.583 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/debug 2024-04-01T22:33:40.583 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/tracing 2024-04-01T22:33:40.583 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-01T22:33:40.583 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/fuse/connections 2024-04-01T22:33:40.583 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/config 2024-04-01T22:33:40.583 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-sysctl.service 2024-04-01T22:33:40.583 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-01T22:33:40.583 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/nfs/rpc_pipefs 2024-04-01T22:33:40.583 INFO:teuthology.orchestra.run.smithi047.stdout:/run/user/1000 2024-04-01T22:33:40.583 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph 2024-04-01T22:33:40.583 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-0 2024-04-01T22:33:40.583 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-1 2024-04-01T22:33:40.583 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-2 2024-04-01T22:33:40.583 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-3 2024-04-01T22:33:40.583 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns 2024-04-01T22:33:40.584 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-01T22:33:40.584 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-01T22:33:40.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T22:33:40.584 DEBUG:teuthology.orchestra.run.smithi047:> ls /sys/fs/fuse/connections 2024-04-01T22:33:40.597 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi047.stderr:2024-04-01T22:33:40.597+0000 7fb328638480 -1 init, newargv = 0x5564db352480 newargc=15 2024-04-01T22:33:40.597 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi047.stderr:ceph-fuse[42476]: starting ceph client 2024-04-01T22:33:40.861 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi047.stderr:ceph-fuse[42476]: starting fuse 2024-04-01T22:33:41.608 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:33:41.610 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:33:41.713 DEBUG:teuthology.orchestra.run.smithi047:> sudo modprobe fuse 2024-04-01T22:33:41.739 DEBUG:teuthology.orchestra.run.smithi047:> cat /proc/self/mounts | awk '{print $2}' 2024-04-01T22:33:41.795 INFO:teuthology.orchestra.run.smithi047.stdout:/proc 2024-04-01T22:33:41.795 INFO:teuthology.orchestra.run.smithi047.stdout:/sys 2024-04-01T22:33:41.795 INFO:teuthology.orchestra.run.smithi047.stdout:/dev 2024-04-01T22:33:41.795 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/security 2024-04-01T22:33:41.795 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/shm 2024-04-01T22:33:41.795 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/pts 2024-04-01T22:33:41.795 INFO:teuthology.orchestra.run.smithi047.stdout:/run 2024-04-01T22:33:41.795 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/cgroup 2024-04-01T22:33:41.795 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/pstore 2024-04-01T22:33:41.795 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/bpf 2024-04-01T22:33:41.795 INFO:teuthology.orchestra.run.smithi047.stdout:/ 2024-04-01T22:33:41.796 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/selinux 2024-04-01T22:33:41.796 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/sys/fs/binfmt_misc 2024-04-01T22:33:41.796 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/hugepages 2024-04-01T22:33:41.796 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/mqueue 2024-04-01T22:33:41.796 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/debug 2024-04-01T22:33:41.796 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/tracing 2024-04-01T22:33:41.796 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-01T22:33:41.796 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/fuse/connections 2024-04-01T22:33:41.796 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/config 2024-04-01T22:33:41.796 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-sysctl.service 2024-04-01T22:33:41.796 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-01T22:33:41.796 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/nfs/rpc_pipefs 2024-04-01T22:33:41.796 INFO:teuthology.orchestra.run.smithi047.stdout:/run/user/1000 2024-04-01T22:33:41.796 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph 2024-04-01T22:33:41.796 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-0 2024-04-01T22:33:41.796 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-1 2024-04-01T22:33:41.797 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-2 2024-04-01T22:33:41.797 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-3 2024-04-01T22:33:41.797 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns 2024-04-01T22:33:41.797 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-01T22:33:41.797 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-01T22:33:41.797 INFO:teuthology.orchestra.run.smithi047.stdout:/home/ubuntu/cephtest/mnt.admin 2024-04-01T22:33:41.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T22:33:41.797 DEBUG:teuthology.orchestra.run.smithi047:> ls /sys/fs/fuse/connections 2024-04-01T22:33:41.849 INFO:teuthology.orchestra.run.smithi047.stdout:43 2024-04-01T22:33:41.849 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-04-01T22:33:41.850 DEBUG:teuthology.orchestra.run.smithi047:> sudo stdin-killer -- python3 -c ' 2024-04-01T22:33:41.850 DEBUG:teuthology.orchestra.run.smithi047:> import glob 2024-04-01T22:33:41.850 DEBUG:teuthology.orchestra.run.smithi047:> import re 2024-04-01T22:33:41.850 DEBUG:teuthology.orchestra.run.smithi047:> import os 2024-04-01T22:33:41.850 DEBUG:teuthology.orchestra.run.smithi047:> import subprocess 2024-04-01T22:33:41.850 DEBUG:teuthology.orchestra.run.smithi047:> 2024-04-01T22:33:41.850 DEBUG:teuthology.orchestra.run.smithi047:> def _find_admin_socket(client_name): 2024-04-01T22:33:41.850 DEBUG:teuthology.orchestra.run.smithi047:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-01T22:33:41.850 DEBUG:teuthology.orchestra.run.smithi047:> files = glob.glob(asok_path) 2024-04-01T22:33:41.850 DEBUG:teuthology.orchestra.run.smithi047:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-01T22:33:41.850 DEBUG:teuthology.orchestra.run.smithi047:> 2024-04-01T22:33:41.850 DEBUG:teuthology.orchestra.run.smithi047:> # Given a non-glob path, it better be there 2024-04-01T22:33:41.850 DEBUG:teuthology.orchestra.run.smithi047:> if "*" not in asok_path: 2024-04-01T22:33:41.850 DEBUG:teuthology.orchestra.run.smithi047:> assert(len(files) == 1) 2024-04-01T22:33:41.851 DEBUG:teuthology.orchestra.run.smithi047:> return files[0] 2024-04-01T22:33:41.851 DEBUG:teuthology.orchestra.run.smithi047:> 2024-04-01T22:33:41.851 DEBUG:teuthology.orchestra.run.smithi047:> for f in files: 2024-04-01T22:33:41.851 DEBUG:teuthology.orchestra.run.smithi047:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-01T22:33:41.851 DEBUG:teuthology.orchestra.run.smithi047:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-01T22:33:41.851 DEBUG:teuthology.orchestra.run.smithi047:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-01T22:33:41.851 DEBUG:teuthology.orchestra.run.smithi047:> contents = proc_f.read() 2024-04-01T22:33:41.851 DEBUG:teuthology.orchestra.run.smithi047:> if mountpoint in contents: 2024-04-01T22:33:41.851 DEBUG:teuthology.orchestra.run.smithi047:> return f 2024-04-01T22:33:41.851 DEBUG:teuthology.orchestra.run.smithi047:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-01T22:33:41.851 DEBUG:teuthology.orchestra.run.smithi047:> 2024-04-01T22:33:41.851 DEBUG:teuthology.orchestra.run.smithi047:> print(_find_admin_socket("client.admin")) 2024-04-01T22:33:41.852 DEBUG:teuthology.orchestra.run.smithi047:> ' 2024-04-01T22:33:41.972 INFO:teuthology.orchestra.run.smithi047.stdout:/var/run/ceph/ceph-client.admin.42476.asok 2024-04-01T22:33:41.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-01T22:33:41.983 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.42476.asok 2024-04-01T22:33:41.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T22:33:41.983 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.42476.asok status 2024-04-01T22:33:42.122 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-01T22:33:42.123 INFO:teuthology.orchestra.run.smithi047.stdout: "metadata": { 2024-04-01T22:33:42.123 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_sha1": "1f941761d08add4455f209f0f2e36f8151f834a0", 2024-04-01T22:33:42.123 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_version": "ceph version 19.0.0-1992-g1f941761 (1f941761d08add4455f209f0f2e36f8151f834a0) squid (dev)", 2024-04-01T22:33:42.123 INFO:teuthology.orchestra.run.smithi047.stdout: "entity_id": "admin", 2024-04-01T22:33:42.123 INFO:teuthology.orchestra.run.smithi047.stdout: "hostname": "smithi047", 2024-04-01T22:33:42.123 INFO:teuthology.orchestra.run.smithi047.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-01T22:33:42.123 INFO:teuthology.orchestra.run.smithi047.stdout: "pid": "42476", 2024-04-01T22:33:42.123 INFO:teuthology.orchestra.run.smithi047.stdout: "root": "/" 2024-04-01T22:33:42.123 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-01T22:33:42.123 INFO:teuthology.orchestra.run.smithi047.stdout: "dentry_count": 0, 2024-04-01T22:33:42.123 INFO:teuthology.orchestra.run.smithi047.stdout: "dentry_pinned_count": 0, 2024-04-01T22:33:42.124 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 4340, 2024-04-01T22:33:42.124 INFO:teuthology.orchestra.run.smithi047.stdout: "inst": { 2024-04-01T22:33:42.124 INFO:teuthology.orchestra.run.smithi047.stdout: "name": { 2024-04-01T22:33:42.124 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "client", 2024-04-01T22:33:42.124 INFO:teuthology.orchestra.run.smithi047.stdout: "num": 4340 2024-04-01T22:33:42.124 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-01T22:33:42.124 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": { 2024-04-01T22:33:42.124 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v1", 2024-04-01T22:33:42.124 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "172.21.15.47:0", 2024-04-01T22:33:42.124 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 523682502 2024-04-01T22:33:42.124 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-01T22:33:42.124 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-01T22:33:42.124 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": { 2024-04-01T22:33:42.124 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v1", 2024-04-01T22:33:42.125 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "172.21.15.47:0", 2024-04-01T22:33:42.125 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 523682502 2024-04-01T22:33:42.125 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-01T22:33:42.125 INFO:teuthology.orchestra.run.smithi047.stdout: "inst_str": "client.4340 172.21.15.47:0/523682502", 2024-04-01T22:33:42.125 INFO:teuthology.orchestra.run.smithi047.stdout: "addr_str": "172.21.15.47:0/523682502", 2024-04-01T22:33:42.125 INFO:teuthology.orchestra.run.smithi047.stdout: "inode_count": 1, 2024-04-01T22:33:42.125 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_epoch": 6, 2024-04-01T22:33:42.125 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_epoch": 25, 2024-04-01T22:33:42.125 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_epoch_barrier": 0, 2024-04-01T22:33:42.125 INFO:teuthology.orchestra.run.smithi047.stdout: "blocklisted": false, 2024-04-01T22:33:42.125 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs" 2024-04-01T22:33:42.125 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-01T22:33:42.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T22:33:42.131 DEBUG:teuthology.orchestra.run.smithi047:> stat --file-system '--printf=%T 2024-04-01T22:33:42.132 DEBUG:teuthology.orchestra.run.smithi047:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-01T22:33:42.159 INFO:teuthology.orchestra.run.smithi047.stdout:fuseblk 2024-04-01T22:33:42.159 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-01T22:33:42.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T22:33:42.159 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-01T22:33:42.304 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-01T22:33:42.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-01T22:33:42.581 INFO:teuthology.orchestra.run.smithi047.stdout:# file: . 2024-04-01T22:33:42.581 INFO:teuthology.orchestra.run.smithi047.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-01T22:33:42.581 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:33:42.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-01T22:33:42.590 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-01T22:33:42.590 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-01T22:33:42.607 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T22:33:42.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.750+0000 7f0d623c7640 1 Processor -- start 2024-04-01T22:33:42.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.750+0000 7f0d623c7640 1 -- start start 2024-04-01T22:33:42.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.750+0000 7f0d623c7640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f0d5c15aec0 0x7f0d5c06c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:42.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.750+0000 7f0d623c7640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0d5c15bb20 0x7f0d5c15bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:42.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.750+0000 7f0d623c7640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d5c154b70 con 0x7f0d5c06c250 2024-04-01T22:33:42.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.750+0000 7f0d623c7640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f0d5c0ce990 con 0x7f0d5c15aec0 2024-04-01T22:33:42.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.750+0000 7f0d623c7640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f0d5c0cdac0 con 0x7f0d5c15bb20 2024-04-01T22:33:42.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.751+0000 7f0d5bfff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f0d5c06c250 0x7f0d5c0ceb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:58940/0 (socket says 172.21.15.47:58940) 2024-04-01T22:33:42.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.751+0000 7f0d5bfff640 1 -- 172.21.15.47:0/1070773991 learned_addr learned my addr 172.21.15.47:0/1070773991 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T22:33:42.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.751+0000 7f0d53fff640 1 --2- 172.21.15.47:0/1070773991 >> v2:172.21.15.181:3300/0 conn(0x7f0d5c15aec0 0x7f0d5c06c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:42.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.751+0000 7f0d60964640 1 --2- 172.21.15.47:0/1070773991 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0d5c15bb20 0x7f0d5c15bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:42.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.754+0000 7f0d60964640 1 -- 172.21.15.47:0/1070773991 >> v2:172.21.15.181:3300/0 conn(0x7f0d5c15aec0 msgr2=0x7f0d5c06c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:42.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.754+0000 7f0d60964640 1 --2- 172.21.15.47:0/1070773991 >> v2:172.21.15.181:3300/0 conn(0x7f0d5c15aec0 0x7f0d5c06c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:42.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.754+0000 7f0d60964640 1 -- 172.21.15.47:0/1070773991 >> v1:172.21.15.47:6789/0 conn(0x7f0d5c06c250 legacy=0x7f0d5c0ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:42.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.754+0000 7f0d60964640 1 -- 172.21.15.47:0/1070773991 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d5c0cf2a0 con 0x7f0d5c15bb20 2024-04-01T22:33:42.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.757+0000 7f0d60964640 1 --2- 172.21.15.47:0/1070773991 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0d5c15bb20 0x7f0d5c15bf50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0d54009d90 tx=0x7f0d5402bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0d91b2897ab4bfb server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:42.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.761+0000 7f0d5b7fe640 1 -- 172.21.15.47:0/1070773991 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d54039070 con 0x7f0d5c15bb20 2024-04-01T22:33:42.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.761+0000 7f0d5b7fe640 1 -- 172.21.15.47:0/1070773991 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d5402cce0 con 0x7f0d5c15bb20 2024-04-01T22:33:42.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.761+0000 7f0d5b7fe640 1 -- 172.21.15.47:0/1070773991 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d54034660 con 0x7f0d5c15bb20 2024-04-01T22:33:42.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.762+0000 7f0d623c7640 1 -- 172.21.15.47:0/1070773991 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0d5c15bb20 msgr2=0x7f0d5c15bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:42.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.762+0000 7f0d623c7640 1 --2- 172.21.15.47:0/1070773991 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0d5c15bb20 0x7f0d5c15bf50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0d54009d90 tx=0x7f0d5402bf30 comp rx=0 tx=0).stop 2024-04-01T22:33:42.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.762+0000 7f0d623c7640 1 -- 172.21.15.47:0/1070773991 shutdown_connections 2024-04-01T22:33:42.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.762+0000 7f0d623c7640 1 --2- 172.21.15.47:0/1070773991 >> v2:172.21.15.181:3300/0 conn(0x7f0d5c15aec0 0x7f0d5c06c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:42.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.762+0000 7f0d623c7640 1 --2- 172.21.15.47:0/1070773991 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0d5c15bb20 0x7f0d5c15bf50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:42.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.762+0000 7f0d623c7640 1 -- 172.21.15.47:0/1070773991 >> 172.21.15.47:0/1070773991 conn(0x7f0d5c0cfdb0 msgr2=0x7f0d5c0d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:42.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.762+0000 7f0d623c7640 1 -- 172.21.15.47:0/1070773991 shutdown_connections 2024-04-01T22:33:42.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.762+0000 7f0d623c7640 1 -- 172.21.15.47:0/1070773991 wait complete. 2024-04-01T22:33:42.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.763+0000 7f0d623c7640 1 Processor -- start 2024-04-01T22:33:42.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.763+0000 7f0d623c7640 1 -- start start 2024-04-01T22:33:42.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.764+0000 7f0d623c7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d5c06c250 0x7f0d5c0b4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:42.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.764+0000 7f0d623c7640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0d5c15aec0 0x7f0d5c0c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:42.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.764+0000 7f0d623c7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d5c15bb20 0x7f0d5c0cab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:42.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.764+0000 7f0d623c7640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0d5c0ce060 con 0x7f0d5c15bb20 2024-04-01T22:33:42.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.764+0000 7f0d623c7640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0d5c0cdd80 con 0x7f0d5c06c250 2024-04-01T22:33:42.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.764+0000 7f0d623c7640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f0d5c0ce340 con 0x7f0d5c15aec0 2024-04-01T22:33:42.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.764+0000 7f0d60964640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d5c15bb20 0x7f0d5c0cab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:42.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.764+0000 7f0d53fff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0d5c15aec0 0x7f0d5c0c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:42.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.764+0000 7f0d60964640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d5c15bb20 0x7f0d5c0cab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55180/0 (socket says 172.21.15.47:55180) 2024-04-01T22:33:42.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.764+0000 7f0d60964640 1 -- 172.21.15.47:0/2895886615 learned_addr learned my addr 172.21.15.47:0/2895886615 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:42.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.764+0000 7f0d5bfff640 1 --2- 172.21.15.47:0/2895886615 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d5c06c250 0x7f0d5c0b4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:42.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.768+0000 7f0d60964640 1 -- 172.21.15.47:0/2895886615 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0d5c15aec0 msgr2=0x7f0d5c0c64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:42.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.768+0000 7f0d60964640 1 --2- 172.21.15.47:0/2895886615 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0d5c15aec0 0x7f0d5c0c64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:42.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.768+0000 7f0d60964640 1 -- 172.21.15.47:0/2895886615 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d5c06c250 msgr2=0x7f0d5c0b4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:42.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.768+0000 7f0d60964640 1 --2- 172.21.15.47:0/2895886615 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d5c06c250 0x7f0d5c0b4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:42.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.768+0000 7f0d60964640 1 -- 172.21.15.47:0/2895886615 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d5c0b2860 con 0x7f0d5c15bb20 2024-04-01T22:33:42.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.770+0000 7f0d60964640 1 --2- 172.21.15.47:0/2895886615 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d5c15bb20 0x7f0d5c0cab50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0d54009eb0 tx=0x7f0d54004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:42.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.774+0000 7f0d597fa640 1 -- 172.21.15.47:0/2895886615 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d54039050 con 0x7f0d5c15bb20 2024-04-01T22:33:42.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.774+0000 7f0d597fa640 1 -- 172.21.15.47:0/2895886615 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d54045070 con 0x7f0d5c15bb20 2024-04-01T22:33:42.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.774+0000 7f0d597fa640 1 -- 172.21.15.47:0/2895886615 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d54009450 con 0x7f0d5c15bb20 2024-04-01T22:33:42.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.775+0000 7f0d623c7640 1 -- 172.21.15.47:0/2895886615 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d5c0cb740 con 0x7f0d5c15bb20 2024-04-01T22:33:42.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.775+0000 7f0d623c7640 1 -- 172.21.15.47:0/2895886615 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d5c1f0d40 con 0x7f0d5c15bb20 2024-04-01T22:33:42.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.776+0000 7f0d623c7640 1 -- 172.21.15.47:0/2895886615 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d5c06dd70 con 0x7f0d5c15bb20 2024-04-01T22:33:42.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.795+0000 7f0d597fa640 1 -- 172.21.15.47:0/2895886615 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f0d5403e850 con 0x7f0d5c15bb20 2024-04-01T22:33:42.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.796+0000 7f0d597fa640 1 --2- 172.21.15.47:0/2895886615 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f0d3c06b9e0 0x7f0d3c06dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:42.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.796+0000 7f0d5bfff640 1 --2- 172.21.15.47:0/2895886615 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f0d3c06b9e0 0x7f0d3c06dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:42.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:42.796+0000 7f0d5bfff640 1 --2- 172.21.15.47:0/2895886615 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f0d3c06b9e0 0x7f0d3c06dea0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c007fd0 tx=0x7f0d4c007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:43.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.088+0000 7f0d597fa640 1 -- 172.21.15.47:0/2895886615 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0d5407a560 con 0x7f0d5c15bb20 2024-04-01T22:33:43.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.088+0000 7f0d597fa640 1 -- 172.21.15.47:0/2895886615 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f0d5c06dd70 con 0x7f0d5c15bb20 2024-04-01T22:33:43.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.281+0000 7f0d623c7640 1 -- 172.21.15.47:0/2895886615 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0d5c15b2f0 con 0x7f0d5c15bb20 2024-04-01T22:33:43.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.345+0000 7f0d597fa640 1 -- 172.21.15.47:0/2895886615 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18526 (secure 0 0 0) 0x7f0d5c15b2f0 con 0x7f0d5c15bb20 2024-04-01T22:33:43.346 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:33:43.346 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"fsid":"a6998a48-38bc-4e42-b0d9-04f2fb5c3c87","created":"2024-04-01T22:32:57.112033+0000","modified":"2024-04-01T22:33:33.448062+0000","last_up_change":"2024-04-01T22:33:11.141073+0000","last_in_change":"2024-04-01T22:33:02.650459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T22:33:13.356568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T22:33:25.309421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T22:33:26.268050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-01T22:33:30.588103+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7bd3f25d-e3a5-4932-b381-53dcbb464dde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6811","nonce":3827395709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6813","nonce":3827395709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6817","nonce":3827395709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6815","nonce":3827395709}]},"public_addr":"172.21.15.47:6811/3827395709","cluster_addr":"172.21.15.47:6813/3827395709","heartbeat_back_addr":"172.21.15.47:6817/3827395709","heartbeat_front_addr":"172.21.15.47:6815/3827395709","state":["exists","up"]},{"osd":1,"uuid":"2aa60ba2-67ff-43c7-96c4-82ae2f3855ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6827","nonce":3152157503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6829","nonce":3152157503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6833","nonce":3152157503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6831","nonce":3152157503}]},"public_addr":"172.21.15.47:6827/3152157503","cluster_addr":"172.21.15.47:6829/3152157503","heartbeat_back_addr":"172.21.15.47:6833/3152157503","heartbeat_front_addr":"172.21.15.47:6831/3152157503","state":["exists","up"]},{"osd":2,"uuid":"d83f8a98-6db8-42b7-9ef6-5b16eb9a3492","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6803","nonce":1003968856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6805","nonce":1003968856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6809","nonce":1003968856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6807","nonce":1003968856}]},"public_addr":"172.21.15.47:6803/1003968856","cluster_addr":"172.21.15.47:6805/1003968856","heartbeat_back_addr":"172.21.15.47:6809/1003968856","heartbeat_front_addr":"172.21.15.47:6807/1003968856","state":["exists","up"]},{"osd":3,"uuid":"edc02ed5-d25c-4dc9-a0c3-7a26f20fae07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6819","nonce":2845699561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6821","nonce":2845699561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6825","nonce":2845699561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6823","nonce":2845699561}]},"public_addr":"172.21.15.47:6819/2845699561","cluster_addr":"172.21.15.47:6821/2845699561","heartbeat_back_addr":"172.21.15.47:6825/2845699561","heartbeat_front_addr":"172.21.15.47:6823/2845699561","state":["exists","up"]},{"osd":4,"uuid":"b3d67e74-f51e-4474-9c62-dd0daa60c728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6809","nonce":2961538461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6811","nonce":2961538461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6815","nonce":2961538461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6813","nonce":2961538461}]},"public_addr":"172.21.15.181:6809/2961538461","cluster_addr":"172.21.15.181:6811/2961538461","heartbeat_back_addr":"172.21.15.181:6815/2961538461","heartbeat_front_addr":"172.21.15.181:6813/2961538461","state":["exists","up"]},{"osd":5,"uuid":"d86e8f7a-99f4-4457-9949-cf2cb853e79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6817","nonce":2161566540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6819","nonce":2161566540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6823","nonce":2161566540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6821","nonce":2161566540}]},"public_addr":"172.21.15.181:6817/2161566540","cluster_addr":"172.21.15.181:6819/2161566540","heartbeat_back_addr":"172.21.15.181:6823/2161566540","heartbeat_front_addr":"172.21.15.181:6821/2161566540","state":["exists","up"]},{"osd":6,"uuid":"aa08266c-1719-4abd-afb9-e7e8ac593658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6801","nonce":3792144865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6803","nonce":3792144865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6807","nonce":3792144865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6805","nonce":3792144865}]},"public_addr":"172.21.15.181:6801/3792144865","cluster_addr":"172.21.15.181:6803/3792144865","heartbeat_back_addr":"172.21.15.181:6807/3792144865","heartbeat_front_addr":"172.21.15.181:6805/3792144865","state":["exists","up"]},{"osd":7,"uuid":"6e509762-24c8-46c3-93a1-4c50b11ebcf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6825","nonce":1760995885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6827","nonce":1760995885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6831","nonce":1760995885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6829","nonce":1760995885}]},"public_addr":"172.21.15.181:6825/1760995885","cluster_addr":"172.21.15.181:6827/1760995885","heartbeat_back_addr":"172.21.15.181:6831/1760995885","heartbeat_front_addr":"172.21.15.181:6829/1760995885","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.202426+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.255318+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.170288+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.290065+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.214871+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.176432+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.139940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.299546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T22:33:43.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.348+0000 7f0d623c7640 1 -- 172.21.15.47:0/2895886615 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f0d3c06b9e0 msgr2=0x7f0d3c06dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:43.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.348+0000 7f0d623c7640 1 --2- 172.21.15.47:0/2895886615 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f0d3c06b9e0 0x7f0d3c06dea0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c007fd0 tx=0x7f0d4c007e80 comp rx=0 tx=0).stop 2024-04-01T22:33:43.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.348+0000 7f0d623c7640 1 -- 172.21.15.47:0/2895886615 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d5c15bb20 msgr2=0x7f0d5c0cab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:43.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.348+0000 7f0d623c7640 1 --2- 172.21.15.47:0/2895886615 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d5c15bb20 0x7f0d5c0cab50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0d54009eb0 tx=0x7f0d54004a40 comp rx=0 tx=0).stop 2024-04-01T22:33:43.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.348+0000 7f0d623c7640 1 -- 172.21.15.47:0/2895886615 shutdown_connections 2024-04-01T22:33:43.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.348+0000 7f0d623c7640 1 --2- 172.21.15.47:0/2895886615 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f0d3c06b9e0 0x7f0d3c06dea0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:43.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.348+0000 7f0d623c7640 1 --2- 172.21.15.47:0/2895886615 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d5c15bb20 0x7f0d5c0cab50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:43.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.348+0000 7f0d623c7640 1 --2- 172.21.15.47:0/2895886615 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0d5c15aec0 0x7f0d5c0c64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:43.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.348+0000 7f0d623c7640 1 --2- 172.21.15.47:0/2895886615 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d5c06c250 0x7f0d5c0b4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:43.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.348+0000 7f0d623c7640 1 -- 172.21.15.47:0/2895886615 >> 172.21.15.47:0/2895886615 conn(0x7f0d5c0cfdb0 msgr2=0x7f0d5c15a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:43.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.348+0000 7f0d623c7640 1 -- 172.21.15.47:0/2895886615 shutdown_connections 2024-04-01T22:33:43.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.348+0000 7f0d623c7640 1 -- 172.21.15.47:0/2895886615 wait complete. 2024-04-01T22:33:43.361 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-01T22:33:13.356568+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-01T22:33:25.309421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-01T22:33:26.268050+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-01T22:33:30.588103+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-01T22:33:43.362 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-01T22:33:43.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.469+0000 7ff2f1d79640 1 Processor -- start 2024-04-01T22:33:43.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.469+0000 7ff2f1d79640 1 -- start start 2024-04-01T22:33:43.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.470+0000 7ff2f1d79640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff2ec0c93f0 0x7ff2ec0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:43.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.470+0000 7ff2f1d79640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff2ec15afc0 0x7ff2ec06c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:43.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.470+0000 7ff2f1d79640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2ec0cdae0 con 0x7ff2ec06c770 2024-04-01T22:33:43.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.470+0000 7ff2f1d79640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7ff2ec0c97d0 con 0x7ff2ec15afc0 2024-04-01T22:33:43.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.470+0000 7ff2f1d79640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7ff2ec0cdd80 con 0x7ff2ec0c93f0 2024-04-01T22:33:43.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.470+0000 7ff2eaffd640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff2ec15afc0 0x7ff2ec06c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:43.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.470+0000 7ff2eb7fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff2ec0c93f0 0x7ff2ec0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:43.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.471+0000 7ff2ebfff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7ff2ec06c770 0x7ff2ec0cc0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:58944/0 (socket says 172.21.15.47:58944) 2024-04-01T22:33:43.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.471+0000 7ff2ebfff640 1 -- 172.21.15.47:0/3054478489 learned_addr learned my addr 172.21.15.47:0/3054478489 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T22:33:43.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.473+0000 7ff2eb7fe640 1 -- 172.21.15.47:0/3054478489 >> v2:172.21.15.47:3300/0 conn(0x7ff2ec15afc0 msgr2=0x7ff2ec06c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:43.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.473+0000 7ff2eb7fe640 1 --2- 172.21.15.47:0/3054478489 >> v2:172.21.15.47:3300/0 conn(0x7ff2ec15afc0 0x7ff2ec06c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:43.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.473+0000 7ff2eb7fe640 1 -- 172.21.15.47:0/3054478489 >> v1:172.21.15.47:6789/0 conn(0x7ff2ec06c770 legacy=0x7ff2ec0cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:43.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.473+0000 7ff2eb7fe640 1 -- 172.21.15.47:0/3054478489 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2ec0ce060 con 0x7ff2ec0c93f0 2024-04-01T22:33:43.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.475+0000 7ff2eb7fe640 1 --2- 172.21.15.47:0/3054478489 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2ec0c93f0 0x7ff2ec0cee30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec08d100 tx=0x7ff2dc02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddf6605fbc8c6feb server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:43.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.479+0000 7ff2ea7fc640 1 -- 172.21.15.47:0/3054478489 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc0315a0 con 0x7ff2ec0c93f0 2024-04-01T22:33:43.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.479+0000 7ff2ea7fc640 1 -- 172.21.15.47:0/3054478489 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2dc037070 con 0x7ff2ec0c93f0 2024-04-01T22:33:43.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.479+0000 7ff2ea7fc640 1 -- 172.21.15.47:0/3054478489 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc031960 con 0x7ff2ec0c93f0 2024-04-01T22:33:43.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.479+0000 7ff2f1d79640 1 -- 172.21.15.47:0/3054478489 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2ec0c93f0 msgr2=0x7ff2ec0cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:43.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.479+0000 7ff2f1d79640 1 --2- 172.21.15.47:0/3054478489 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2ec0c93f0 0x7ff2ec0cee30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec08d100 tx=0x7ff2dc02b840 comp rx=0 tx=0).stop 2024-04-01T22:33:43.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.479+0000 7ff2f1d79640 1 -- 172.21.15.47:0/3054478489 shutdown_connections 2024-04-01T22:33:43.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.479+0000 7ff2f1d79640 1 --2- 172.21.15.47:0/3054478489 >> v2:172.21.15.47:3300/0 conn(0x7ff2ec15afc0 0x7ff2ec06c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:43.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.479+0000 7ff2f1d79640 1 --2- 172.21.15.47:0/3054478489 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2ec0c93f0 0x7ff2ec0cee30 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:43.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.479+0000 7ff2f1d79640 1 -- 172.21.15.47:0/3054478489 >> 172.21.15.47:0/3054478489 conn(0x7ff2ec0cfdb0 msgr2=0x7ff2ec0d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:43.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.479+0000 7ff2f1d79640 1 -- 172.21.15.47:0/3054478489 shutdown_connections 2024-04-01T22:33:43.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.479+0000 7ff2f1d79640 1 -- 172.21.15.47:0/3054478489 wait complete. 2024-04-01T22:33:43.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.481+0000 7ff2f1d79640 1 Processor -- start 2024-04-01T22:33:43.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.481+0000 7ff2f1d79640 1 -- start start 2024-04-01T22:33:43.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.481+0000 7ff2f1d79640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2ec06c770 0x7ff2ec0c5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:43.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.481+0000 7ff2f1d79640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2ec0c93f0 0x7ff2ec153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:43.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.481+0000 7ff2f1d79640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff2ec15afc0 0x7ff2ec154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:43.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.481+0000 7ff2f1d79640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ec15b400 con 0x7ff2ec06c770 2024-04-01T22:33:43.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.481+0000 7ff2f1d79640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ec0ce620 con 0x7ff2ec0c93f0 2024-04-01T22:33:43.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.481+0000 7ff2f1d79640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7ff2ec0cf430 con 0x7ff2ec15afc0 2024-04-01T22:33:43.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.482+0000 7ff2eb7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2ec06c770 0x7ff2ec0c5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:43.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.482+0000 7ff2ebfff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff2ec15afc0 0x7ff2ec154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:43.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.482+0000 7ff2eaffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2ec0c93f0 0x7ff2ec153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:43.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.482+0000 7ff2ebfff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff2ec15afc0 0x7ff2ec154440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:58716/0 (socket says 172.21.15.47:58716) 2024-04-01T22:33:43.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.482+0000 7ff2ebfff640 1 -- 172.21.15.47:0/1088741387 learned_addr learned my addr 172.21.15.47:0/1088741387 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:43.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.486+0000 7ff2ebfff640 1 -- 172.21.15.47:0/1088741387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2ec0c93f0 msgr2=0x7ff2ec153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:43.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.486+0000 7ff2ebfff640 1 --2- 172.21.15.47:0/1088741387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2ec0c93f0 0x7ff2ec153f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:43.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.486+0000 7ff2ebfff640 1 -- 172.21.15.47:0/1088741387 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2ec06c770 msgr2=0x7ff2ec0c5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:43.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.486+0000 7ff2ebfff640 1 --2- 172.21.15.47:0/1088741387 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2ec06c770 0x7ff2ec0c5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:43.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.486+0000 7ff2ebfff640 1 -- 172.21.15.47:0/1088741387 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2ec1e41b0 con 0x7ff2ec15afc0 2024-04-01T22:33:43.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.486+0000 7ff2eaffd640 1 --2- 172.21.15.47:0/1088741387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2ec0c93f0 0x7ff2ec153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T22:33:43.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.488+0000 7ff2ebfff640 1 --2- 172.21.15.47:0/1088741387 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff2ec15afc0 0x7ff2ec154440 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff2e400cbf0 tx=0x7ff2e400a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:43.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.492+0000 7ff2d3fff640 1 -- 172.21.15.47:0/1088741387 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4017070 con 0x7ff2ec15afc0 2024-04-01T22:33:43.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.492+0000 7ff2d3fff640 1 -- 172.21.15.47:0/1088741387 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2e400ad40 con 0x7ff2ec15afc0 2024-04-01T22:33:43.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.492+0000 7ff2d3fff640 1 -- 172.21.15.47:0/1088741387 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4012600 con 0x7ff2ec15afc0 2024-04-01T22:33:43.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.492+0000 7ff2f1d79640 1 -- 172.21.15.47:0/1088741387 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2ec0c66c0 con 0x7ff2ec15afc0 2024-04-01T22:33:43.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.492+0000 7ff2f1d79640 1 -- 172.21.15.47:0/1088741387 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2ec0c4000 con 0x7ff2ec15afc0 2024-04-01T22:33:43.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.493+0000 7ff2f1d79640 1 -- 172.21.15.47:0/1088741387 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2ec068210 con 0x7ff2ec15afc0 2024-04-01T22:33:43.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.510+0000 7ff2d3fff640 1 -- 172.21.15.47:0/1088741387 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7ff2e401a070 con 0x7ff2ec15afc0 2024-04-01T22:33:43.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.510+0000 7ff2d3fff640 1 --2- 172.21.15.47:0/1088741387 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff2d806b9e0 0x7ff2d806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:43.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.511+0000 7ff2eb7fe640 1 --2- 172.21.15.47:0/1088741387 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff2d806b9e0 0x7ff2d806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:43.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.511+0000 7ff2eb7fe640 1 --2- 172.21.15.47:0/1088741387 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff2d806b9e0 0x7ff2d806dea0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc036000 tx=0x7ff2dc03d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:43.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.514+0000 7ff2d3fff640 1 -- 172.21.15.47:0/1088741387 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff2e401de30 con 0x7ff2ec15afc0 2024-04-01T22:33:43.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.750+0000 7ff2d3fff640 1 -- 172.21.15.47:0/1088741387 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7ff2e4058f90 con 0x7ff2ec15afc0 2024-04-01T22:33:43.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.931+0000 7ff2f1d79640 1 -- 172.21.15.47:0/1088741387 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff2ec0c2f40 con 0x7ff2ec15afc0 2024-04-01T22:33:43.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.955+0000 7ff2d3fff640 1 -- 172.21.15.47:0/1088741387 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7ff2e405d030 con 0x7ff2ec15afc0 2024-04-01T22:33:43.955 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-01T22:33:43.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.957+0000 7ff2f1d79640 1 -- 172.21.15.47:0/1088741387 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff2d806b9e0 msgr2=0x7ff2d806dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:43.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.957+0000 7ff2f1d79640 1 --2- 172.21.15.47:0/1088741387 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff2d806b9e0 0x7ff2d806dea0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc036000 tx=0x7ff2dc03d040 comp rx=0 tx=0).stop 2024-04-01T22:33:43.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.957+0000 7ff2f1d79640 1 -- 172.21.15.47:0/1088741387 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff2ec15afc0 msgr2=0x7ff2ec154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:43.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.957+0000 7ff2f1d79640 1 --2- 172.21.15.47:0/1088741387 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff2ec15afc0 0x7ff2ec154440 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff2e400cbf0 tx=0x7ff2e400a430 comp rx=0 tx=0).stop 2024-04-01T22:33:43.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.957+0000 7ff2f1d79640 1 -- 172.21.15.47:0/1088741387 shutdown_connections 2024-04-01T22:33:43.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.957+0000 7ff2f1d79640 1 --2- 172.21.15.47:0/1088741387 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff2d806b9e0 0x7ff2d806dea0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:43.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.957+0000 7ff2f1d79640 1 --2- 172.21.15.47:0/1088741387 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff2ec15afc0 0x7ff2ec154440 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:43.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.957+0000 7ff2f1d79640 1 --2- 172.21.15.47:0/1088741387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff2ec0c93f0 0x7ff2ec153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:43.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.957+0000 7ff2f1d79640 1 --2- 172.21.15.47:0/1088741387 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2ec06c770 0x7ff2ec0c5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:43.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.957+0000 7ff2f1d79640 1 -- 172.21.15.47:0/1088741387 >> 172.21.15.47:0/1088741387 conn(0x7ff2ec0cfdb0 msgr2=0x7ff2ec0d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:43.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.957+0000 7ff2f1d79640 1 -- 172.21.15.47:0/1088741387 shutdown_connections 2024-04-01T22:33:43.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:43.957+0000 7ff2f1d79640 1 -- 172.21.15.47:0/1088741387 wait complete. 2024-04-01T22:33:43.969 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-01T22:33:44.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.075+0000 7f97ce73e640 1 Processor -- start 2024-04-01T22:33:44.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.075+0000 7f97ce73e640 1 -- start start 2024-04-01T22:33:44.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.076+0000 7f97ce73e640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f97c8150a50 0x7f97c80c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:44.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.076+0000 7f97ce73e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f97c80c6b60 0x7f97c80c52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:44.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.076+0000 7f97ce73e640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97c815a3a0 con 0x7f97c806fcd0 2024-04-01T22:33:44.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.076+0000 7f97ce73e640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f97c8150e30 con 0x7f97c80c6b60 2024-04-01T22:33:44.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.076+0000 7f97ce73e640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f97c80c6740 con 0x7f97c8150a50 2024-04-01T22:33:44.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.077+0000 7f97cccdb640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f97c80c6b60 0x7f97c80c52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:44.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.077+0000 7f97c7fff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f97c8150a50 0x7f97c80c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:44.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.077+0000 7f97c7fff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f97c8150a50 0x7f97c80c2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:44084/0 (socket says 172.21.15.47:44084) 2024-04-01T22:33:44.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.077+0000 7f97c77fe640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f97c806fcd0 0x7f97c8159c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:58956/0 (socket says 172.21.15.47:58956) 2024-04-01T22:33:44.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.077+0000 7f97c7fff640 1 -- 172.21.15.47:0/846643836 learned_addr learned my addr 172.21.15.47:0/846643836 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:44.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.079+0000 7f97c7fff640 1 -- 172.21.15.47:0/846643836 >> v2:172.21.15.47:3300/0 conn(0x7f97c80c6b60 msgr2=0x7f97c80c52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:44.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.079+0000 7f97c7fff640 1 --2- 172.21.15.47:0/846643836 >> v2:172.21.15.47:3300/0 conn(0x7f97c80c6b60 0x7f97c80c52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:44.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.079+0000 7f97c7fff640 1 -- 172.21.15.47:0/846643836 >> v1:172.21.15.47:6789/0 conn(0x7f97c806fcd0 legacy=0x7f97c8159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:44.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.079+0000 7f97c7fff640 1 -- 172.21.15.47:0/846643836 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97c8072fc0 con 0x7f97c8150a50 2024-04-01T22:33:44.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.081+0000 7f97c7fff640 1 --2- 172.21.15.47:0/846643836 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97c8150a50 0x7f97c80c2bb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f97c80cc040 tx=0x7f97b002dfe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fd2406289ba0a62 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:44.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.085+0000 7f97c6ffd640 1 -- 172.21.15.47:0/846643836 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b0034070 con 0x7f97c8150a50 2024-04-01T22:33:44.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.085+0000 7f97c6ffd640 1 -- 172.21.15.47:0/846643836 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97b002ed90 con 0x7f97c8150a50 2024-04-01T22:33:44.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.085+0000 7f97c6ffd640 1 -- 172.21.15.47:0/846643836 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b0038620 con 0x7f97c8150a50 2024-04-01T22:33:44.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.085+0000 7f97ce73e640 1 -- 172.21.15.47:0/846643836 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97c8150a50 msgr2=0x7f97c80c2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:44.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.085+0000 7f97ce73e640 1 --2- 172.21.15.47:0/846643836 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97c8150a50 0x7f97c80c2bb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f97c80cc040 tx=0x7f97b002dfe0 comp rx=0 tx=0).stop 2024-04-01T22:33:44.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.086+0000 7f97ce73e640 1 -- 172.21.15.47:0/846643836 shutdown_connections 2024-04-01T22:33:44.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.086+0000 7f97ce73e640 1 --2- 172.21.15.47:0/846643836 >> v2:172.21.15.47:3300/0 conn(0x7f97c80c6b60 0x7f97c80c52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:44.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.086+0000 7f97ce73e640 1 --2- 172.21.15.47:0/846643836 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97c8150a50 0x7f97c80c2bb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:44.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.086+0000 7f97ce73e640 1 -- 172.21.15.47:0/846643836 >> 172.21.15.47:0/846643836 conn(0x7f97c806b110 msgr2=0x7f97c806b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:44.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.086+0000 7f97ce73e640 1 -- 172.21.15.47:0/846643836 shutdown_connections 2024-04-01T22:33:44.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.086+0000 7f97ce73e640 1 -- 172.21.15.47:0/846643836 wait complete. 2024-04-01T22:33:44.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.087+0000 7f97ce73e640 1 Processor -- start 2024-04-01T22:33:44.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.087+0000 7f97ce73e640 1 -- start start 2024-04-01T22:33:44.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.088+0000 7f97ce73e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97c806fcd0 0x7f97c81577d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:44.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.088+0000 7f97ce73e640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f97c80c6b60 0x7f97c81491c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:44.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.088+0000 7f97ce73e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97c8150a50 0x7f97c81eec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:44.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.088+0000 7f97ce73e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f97c80732a0 con 0x7f97c806fcd0 2024-04-01T22:33:44.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.088+0000 7f97ce73e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f97c80c48c0 con 0x7f97c8150a50 2024-04-01T22:33:44.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.088+0000 7f97ce73e640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f97c80c4de0 con 0x7f97c80c6b60 2024-04-01T22:33:44.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.088+0000 7f97c7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97c806fcd0 0x7f97c81577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:44.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.088+0000 7f97c77fe640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f97c80c6b60 0x7f97c81491c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:44.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.088+0000 7f97c7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97c806fcd0 0x7f97c81577d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55214/0 (socket says 172.21.15.47:55214) 2024-04-01T22:33:44.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.088+0000 7f97c7fff640 1 -- 172.21.15.47:0/4239150403 learned_addr learned my addr 172.21.15.47:0/4239150403 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:44.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.088+0000 7f97cccdb640 1 --2- 172.21.15.47:0/4239150403 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97c8150a50 0x7f97c81eec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:44.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.092+0000 7f97c7fff640 1 -- 172.21.15.47:0/4239150403 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f97c80c6b60 msgr2=0x7f97c81491c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:44.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.092+0000 7f97c7fff640 1 --2- 172.21.15.47:0/4239150403 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f97c80c6b60 0x7f97c81491c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:44.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.092+0000 7f97c7fff640 1 -- 172.21.15.47:0/4239150403 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97c8150a50 msgr2=0x7f97c81eec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:44.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.092+0000 7f97c7fff640 1 --2- 172.21.15.47:0/4239150403 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97c8150a50 0x7f97c81eec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:44.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.092+0000 7f97c7fff640 1 -- 172.21.15.47:0/4239150403 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97c814c0d0 con 0x7f97c806fcd0 2024-04-01T22:33:44.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.094+0000 7f97c7fff640 1 --2- 172.21.15.47:0/4239150403 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97c806fcd0 0x7f97c81577d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f97b000bbf0 tx=0x7f97b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:44.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.099+0000 7f97c4ff9640 1 -- 172.21.15.47:0/4239150403 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b0047070 con 0x7f97c806fcd0 2024-04-01T22:33:44.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.099+0000 7f97c4ff9640 1 -- 172.21.15.47:0/4239150403 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97b0043650 con 0x7f97c806fcd0 2024-04-01T22:33:44.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.099+0000 7f97ce73e640 1 -- 172.21.15.47:0/4239150403 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97c8157fb0 con 0x7f97c806fcd0 2024-04-01T22:33:44.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.099+0000 7f97c4ff9640 1 -- 172.21.15.47:0/4239150403 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b0043a40 con 0x7f97c806fcd0 2024-04-01T22:33:44.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.100+0000 7f97ce73e640 1 -- 172.21.15.47:0/4239150403 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97c8159a90 con 0x7f97c806fcd0 2024-04-01T22:33:44.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.101+0000 7f97ce73e640 1 -- 172.21.15.47:0/4239150403 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97c8068210 con 0x7f97c806fcd0 2024-04-01T22:33:44.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.121+0000 7f97c4ff9640 1 -- 172.21.15.47:0/4239150403 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f97b0043be0 con 0x7f97c806fcd0 2024-04-01T22:33:44.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.121+0000 7f97c4ff9640 1 --2- 172.21.15.47:0/4239150403 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f97a806b9e0 0x7f97a806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:44.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.121+0000 7f97c77fe640 1 --2- 172.21.15.47:0/4239150403 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f97a806b9e0 0x7f97a806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:44.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.122+0000 7f97c77fe640 1 --2- 172.21.15.47:0/4239150403 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f97a806b9e0 0x7f97a806dea0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f97c80cb6f0 tx=0x7f97b8007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:44.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.383+0000 7f97c4ff9640 1 -- 172.21.15.47:0/4239150403 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f97b0042e00 con 0x7f97c806fcd0 2024-04-01T22:33:44.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.383+0000 7f97c4ff9640 1 -- 172.21.15.47:0/4239150403 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f97c814c0d0 con 0x7f97c806fcd0 2024-04-01T22:33:44.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.569+0000 7f97ce73e640 1 -- 172.21.15.47:0/4239150403 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f97c8071ed0 con 0x7f97c806fcd0 2024-04-01T22:33:44.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.577+0000 7f97c4ff9640 1 -- 172.21.15.47:0/4239150403 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f97b007d540 con 0x7f97c806fcd0 2024-04-01T22:33:44.577 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-01T22:33:44.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.580+0000 7f97ce73e640 1 -- 172.21.15.47:0/4239150403 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f97a806b9e0 msgr2=0x7f97a806dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:44.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.580+0000 7f97ce73e640 1 --2- 172.21.15.47:0/4239150403 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f97a806b9e0 0x7f97a806dea0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f97c80cb6f0 tx=0x7f97b8007e80 comp rx=0 tx=0).stop 2024-04-01T22:33:44.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.580+0000 7f97ce73e640 1 -- 172.21.15.47:0/4239150403 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97c806fcd0 msgr2=0x7f97c81577d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:44.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.580+0000 7f97ce73e640 1 --2- 172.21.15.47:0/4239150403 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97c806fcd0 0x7f97c81577d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f97b000bbf0 tx=0x7f97b00046c0 comp rx=0 tx=0).stop 2024-04-01T22:33:44.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.580+0000 7f97ce73e640 1 -- 172.21.15.47:0/4239150403 shutdown_connections 2024-04-01T22:33:44.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.580+0000 7f97ce73e640 1 --2- 172.21.15.47:0/4239150403 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f97a806b9e0 0x7f97a806dea0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:44.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.580+0000 7f97ce73e640 1 --2- 172.21.15.47:0/4239150403 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97c8150a50 0x7f97c81eec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:44.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.580+0000 7f97ce73e640 1 --2- 172.21.15.47:0/4239150403 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f97c80c6b60 0x7f97c81491c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:44.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.580+0000 7f97ce73e640 1 --2- 172.21.15.47:0/4239150403 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97c806fcd0 0x7f97c81577d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:44.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.580+0000 7f97ce73e640 1 -- 172.21.15.47:0/4239150403 >> 172.21.15.47:0/4239150403 conn(0x7f97c806b110 msgr2=0x7f97c80cb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:44.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.580+0000 7f97ce73e640 1 -- 172.21.15.47:0/4239150403 shutdown_connections 2024-04-01T22:33:44.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.580+0000 7f97ce73e640 1 -- 172.21.15.47:0/4239150403 wait complete. 2024-04-01T22:33:44.590 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-01T22:33:44.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.696+0000 7f471b22e640 1 Processor -- start 2024-04-01T22:33:44.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.696+0000 7f471b22e640 1 -- start start 2024-04-01T22:33:44.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.697+0000 7f471b22e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f47140c88c0 0x7f47140c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:44.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.697+0000 7f471b22e640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47140c99d0 con 0x7f4714154660 2024-04-01T22:33:44.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.697+0000 7f471b22e640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47140c9cb0 con 0x7f47140ca580 2024-04-01T22:33:44.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.697+0000 7f471b22e640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f47140c3790 con 0x7f47140c88c0 2024-04-01T22:33:44.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.698+0000 7f4713fff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f47140c88c0 0x7f47140c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:44.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.698+0000 7f47197cb640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f47140ca580 0x7f47140ca990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.47:55364/0 (socket says 172.21.15.47:55364) 2024-04-01T22:33:44.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.698+0000 7f47197cb640 1 -- 172.21.15.47:0/3580121162 learned_addr learned my addr 172.21.15.47:0/3580121162 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T22:33:44.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.700+0000 7f47137fe640 1 -- 172.21.15.47:0/3580121162 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1581666654 0 0) 0x7f47140c9cb0 con 0x7f47140ca580 2024-04-01T22:33:44.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.700+0000 7f47137fe640 1 -- 172.21.15.47:0/3580121162 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4704003520 con 0x7f47140ca580 2024-04-01T22:33:44.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.701+0000 7f4713fff640 1 -- 172.21.15.47:0/3580121162 >> v1:172.21.15.181:6789/0 conn(0x7f47140ca580 legacy=0x7f47140ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:44.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.701+0000 7f4713fff640 1 -- 172.21.15.47:0/3580121162 >> v1:172.21.15.47:6789/0 conn(0x7f4714154660 legacy=0x7f471415e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:44.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.701+0000 7f4713fff640 1 -- 172.21.15.47:0/3580121162 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47140c9f90 con 0x7f47140c88c0 2024-04-01T22:33:44.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.706+0000 7f4713fff640 1 --2- 172.21.15.47:0/3580121162 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f47140c88c0 0x7f47140c8d30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f47000097a0 tx=0x7f470002b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb7be22b968fb8d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:44.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.709+0000 7f47137fe640 1 -- 172.21.15.47:0/3580121162 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470002f810 con 0x7f47140c88c0 2024-04-01T22:33:44.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.710+0000 7f47137fe640 1 -- 172.21.15.47:0/3580121162 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f470002f9b0 con 0x7f47140c88c0 2024-04-01T22:33:44.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.710+0000 7f47137fe640 1 -- 172.21.15.47:0/3580121162 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470002fd80 con 0x7f47140c88c0 2024-04-01T22:33:44.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.710+0000 7f471b22e640 1 -- 172.21.15.47:0/3580121162 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f47140c88c0 msgr2=0x7f47140c8d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:44.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.710+0000 7f471b22e640 1 --2- 172.21.15.47:0/3580121162 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f47140c88c0 0x7f47140c8d30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f47000097a0 tx=0x7f470002b9f0 comp rx=0 tx=0).stop 2024-04-01T22:33:44.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.710+0000 7f471b22e640 1 -- 172.21.15.47:0/3580121162 shutdown_connections 2024-04-01T22:33:44.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.710+0000 7f471b22e640 1 --2- 172.21.15.47:0/3580121162 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f47140c88c0 0x7f47140c8d30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:44.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.710+0000 7f471b22e640 1 -- 172.21.15.47:0/3580121162 >> 172.21.15.47:0/3580121162 conn(0x7f4714071310 msgr2=0x7f4714071720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:44.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.710+0000 7f471b22e640 1 -- 172.21.15.47:0/3580121162 shutdown_connections 2024-04-01T22:33:44.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.710+0000 7f471b22e640 1 -- 172.21.15.47:0/3580121162 wait complete. 2024-04-01T22:33:44.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.712+0000 7f471b22e640 1 Processor -- start 2024-04-01T22:33:44.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.712+0000 7f471b22e640 1 -- start start 2024-04-01T22:33:44.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.712+0000 7f471b22e640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f47140c88c0 0x7f471406d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:44.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.712+0000 7f471b22e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f47140ca580 0x7f471406d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:44.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.712+0000 7f471b22e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4714154660 0x7f47141f02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:44.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.712+0000 7f471b22e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f471415de60 con 0x7f47140ca580 2024-04-01T22:33:44.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.712+0000 7f471b22e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f471415ea90 con 0x7f4714154660 2024-04-01T22:33:44.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.712+0000 7f471b22e640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f47140ca270 con 0x7f47140c88c0 2024-04-01T22:33:44.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.713+0000 7f4713fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f47140ca580 0x7f471406d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:44.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.713+0000 7f4718fca640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f47140c88c0 0x7f471406d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:44.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.713+0000 7f47197cb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4714154660 0x7f47141f02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:44.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.713+0000 7f4713fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f47140ca580 0x7f471406d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55246/0 (socket says 172.21.15.47:55246) 2024-04-01T22:33:44.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.713+0000 7f4713fff640 1 -- 172.21.15.47:0/140497349 learned_addr learned my addr 172.21.15.47:0/140497349 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:44.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.717+0000 7f4713fff640 1 -- 172.21.15.47:0/140497349 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f47140c88c0 msgr2=0x7f471406d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:44.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.717+0000 7f4713fff640 1 --2- 172.21.15.47:0/140497349 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f47140c88c0 0x7f471406d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:44.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.717+0000 7f4713fff640 1 -- 172.21.15.47:0/140497349 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4714154660 msgr2=0x7f47141f02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:44.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.717+0000 7f4713fff640 1 --2- 172.21.15.47:0/140497349 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4714154660 0x7f47141f02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:44.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.717+0000 7f4713fff640 1 -- 172.21.15.47:0/140497349 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4714143240 con 0x7f47140ca580 2024-04-01T22:33:44.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.719+0000 7f4713fff640 1 --2- 172.21.15.47:0/140497349 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f47140ca580 0x7f471406d740 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f47000098c0 tx=0x7f47000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:44.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.723+0000 7f47117fa640 1 -- 172.21.15.47:0/140497349 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47000376d0 con 0x7f47140ca580 2024-04-01T22:33:44.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.723+0000 7f47117fa640 1 -- 172.21.15.47:0/140497349 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4700037870 con 0x7f47140ca580 2024-04-01T22:33:44.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.723+0000 7f47117fa640 1 -- 172.21.15.47:0/140497349 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4700037c60 con 0x7f47140ca580 2024-04-01T22:33:44.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.723+0000 7f471b22e640 1 -- 172.21.15.47:0/140497349 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47141f41e0 con 0x7f47140ca580 2024-04-01T22:33:44.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.723+0000 7f471b22e640 1 -- 172.21.15.47:0/140497349 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47141f44c0 con 0x7f47140ca580 2024-04-01T22:33:44.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.724+0000 7f471b22e640 1 -- 172.21.15.47:0/140497349 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47140c8680 con 0x7f47140ca580 2024-04-01T22:33:44.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.747+0000 7f47117fa640 1 -- 172.21.15.47:0/140497349 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f4700049020 con 0x7f47140ca580 2024-04-01T22:33:44.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.747+0000 7f47117fa640 1 --2- 172.21.15.47:0/140497349 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f46f806b990 0x7f46f806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:44.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.748+0000 7f4718fca640 1 --2- 172.21.15.47:0/140497349 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f46f806b990 0x7f46f806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:44.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:44.748+0000 7f4718fca640 1 --2- 172.21.15.47:0/140497349 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f46f806b990 0x7f46f806de50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f47080016e0 tx=0x7f4708009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:45.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.028+0000 7f47117fa640 1 -- 172.21.15.47:0/140497349 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4700037e00 con 0x7f47140ca580 2024-04-01T22:33:45.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.028+0000 7f47117fa640 1 -- 172.21.15.47:0/140497349 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f47140c8680 con 0x7f47140ca580 2024-04-01T22:33:45.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.224+0000 7f471b22e640 1 -- 172.21.15.47:0/140497349 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4714068210 con 0x7f47140ca580 2024-04-01T22:33:45.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.230+0000 7f47117fa640 1 -- 172.21.15.47:0/140497349 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f4700033030 con 0x7f47140ca580 2024-04-01T22:33:45.230 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-04-01T22:33:45.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.232+0000 7f471b22e640 1 -- 172.21.15.47:0/140497349 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f46f806b990 msgr2=0x7f46f806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:45.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.232+0000 7f471b22e640 1 --2- 172.21.15.47:0/140497349 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f46f806b990 0x7f46f806de50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f47080016e0 tx=0x7f4708009040 comp rx=0 tx=0).stop 2024-04-01T22:33:45.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.232+0000 7f471b22e640 1 -- 172.21.15.47:0/140497349 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f47140ca580 msgr2=0x7f471406d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:45.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.232+0000 7f471b22e640 1 --2- 172.21.15.47:0/140497349 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f47140ca580 0x7f471406d740 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f47000098c0 tx=0x7f47000046c0 comp rx=0 tx=0).stop 2024-04-01T22:33:45.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.232+0000 7f471b22e640 1 -- 172.21.15.47:0/140497349 shutdown_connections 2024-04-01T22:33:45.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.232+0000 7f471b22e640 1 --2- 172.21.15.47:0/140497349 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f46f806b990 0x7f46f806de50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:45.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.232+0000 7f471b22e640 1 --2- 172.21.15.47:0/140497349 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4714154660 0x7f47141f02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:45.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.232+0000 7f471b22e640 1 --2- 172.21.15.47:0/140497349 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f47140ca580 0x7f471406d740 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:45.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.232+0000 7f471b22e640 1 --2- 172.21.15.47:0/140497349 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f47140c88c0 0x7f471406d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:45.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.232+0000 7f471b22e640 1 -- 172.21.15.47:0/140497349 >> 172.21.15.47:0/140497349 conn(0x7f4714071310 msgr2=0x7f47140716f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:45.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.232+0000 7f471b22e640 1 -- 172.21.15.47:0/140497349 shutdown_connections 2024-04-01T22:33:45.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.232+0000 7f471b22e640 1 -- 172.21.15.47:0/140497349 wait complete. 2024-04-01T22:33:45.243 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-01T22:33:45.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.349+0000 7fecb736c640 1 Processor -- start 2024-04-01T22:33:45.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.349+0000 7fecb736c640 1 -- start start 2024-04-01T22:33:45.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.350+0000 7fecb736c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fecb00cc7e0 0x7fecb015afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:45.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.350+0000 7fecb736c640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecb00cdae0 con 0x7fecb00c93f0 2024-04-01T22:33:45.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.350+0000 7fecb736c640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecb00c97d0 con 0x7fecb00cee30 2024-04-01T22:33:45.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.350+0000 7fecb736c640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fecb015b500 con 0x7fecb00cc7e0 2024-04-01T22:33:45.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.350+0000 7fecb5108640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fecb00c93f0 0x7fecb006c230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:58980/0 (socket says 172.21.15.47:58980) 2024-04-01T22:33:45.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.350+0000 7fecb5108640 1 -- 172.21.15.47:0/3334364144 learned_addr learned my addr 172.21.15.47:0/3334364144 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T22:33:45.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.350+0000 7fecb5909640 1 --2- 172.21.15.47:0/3334364144 >> v2:172.21.15.181:3300/0 conn(0x7fecb00cc7e0 0x7fecb015afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:45.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.353+0000 7feca7fff640 1 -- 172.21.15.47:0/3334364144 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3253158651 0 0) 0x7fecb00cdae0 con 0x7fecb00c93f0 2024-04-01T22:33:45.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.353+0000 7feca7fff640 1 -- 172.21.15.47:0/3334364144 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec9c003520 con 0x7fecb00c93f0 2024-04-01T22:33:45.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.354+0000 7fecb5909640 1 -- 172.21.15.47:0/3334364144 >> v1:172.21.15.181:6789/0 conn(0x7fecb00cee30 legacy=0x7fecb00cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:45.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.354+0000 7fecb5909640 1 -- 172.21.15.47:0/3334364144 >> v1:172.21.15.47:6789/0 conn(0x7fecb00c93f0 legacy=0x7fecb006c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:45.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.354+0000 7fecb5909640 1 -- 172.21.15.47:0/3334364144 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecb00cdd80 con 0x7fecb00cc7e0 2024-04-01T22:33:45.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.358+0000 7fecb5909640 1 --2- 172.21.15.47:0/3334364144 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fecb00cc7e0 0x7fecb015afc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7feca8009d90 tx=0x7feca802beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d7b64e86a4fedaa server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:45.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.362+0000 7feca7fff640 1 -- 172.21.15.47:0/3334364144 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca8039070 con 0x7fecb00cc7e0 2024-04-01T22:33:45.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.362+0000 7feca7fff640 1 -- 172.21.15.47:0/3334364144 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feca802cc60 con 0x7fecb00cc7e0 2024-04-01T22:33:45.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.362+0000 7feca7fff640 1 -- 172.21.15.47:0/3334364144 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca8034660 con 0x7fecb00cc7e0 2024-04-01T22:33:45.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.363+0000 7fecb736c640 1 -- 172.21.15.47:0/3334364144 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fecb00cc7e0 msgr2=0x7fecb015afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:45.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.363+0000 7fecb736c640 1 --2- 172.21.15.47:0/3334364144 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fecb00cc7e0 0x7fecb015afc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7feca8009d90 tx=0x7feca802beb0 comp rx=0 tx=0).stop 2024-04-01T22:33:45.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.363+0000 7fecb736c640 1 -- 172.21.15.47:0/3334364144 shutdown_connections 2024-04-01T22:33:45.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.363+0000 7fecb736c640 1 --2- 172.21.15.47:0/3334364144 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fecb00cc7e0 0x7fecb015afc0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:45.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.363+0000 7fecb736c640 1 -- 172.21.15.47:0/3334364144 >> 172.21.15.47:0/3334364144 conn(0x7fecb00cfdb0 msgr2=0x7fecb00d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:45.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.363+0000 7fecb736c640 1 -- 172.21.15.47:0/3334364144 shutdown_connections 2024-04-01T22:33:45.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.363+0000 7fecb736c640 1 -- 172.21.15.47:0/3334364144 wait complete. 2024-04-01T22:33:45.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.364+0000 7fecb736c640 1 Processor -- start 2024-04-01T22:33:45.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.364+0000 7fecb736c640 1 -- start start 2024-04-01T22:33:45.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.365+0000 7fecb736c640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fecb00c93f0 0x7fecb00c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:45.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.365+0000 7fecb736c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecb00cc7e0 0x7fecb01f0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:45.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.365+0000 7fecb736c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fecb00cee30 0x7fecb01f06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:45.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.365+0000 7fecb736c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fecb00ce620 con 0x7fecb00cc7e0 2024-04-01T22:33:45.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.365+0000 7fecb736c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fecb00ce340 con 0x7fecb00cee30 2024-04-01T22:33:45.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.365+0000 7fecb736c640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fecb00cf430 con 0x7fecb00c93f0 2024-04-01T22:33:45.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.365+0000 7fecb4907640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecb00cc7e0 0x7fecb01f0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:45.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.366+0000 7fecb5108640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fecb00c93f0 0x7fecb00c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:45.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.366+0000 7fecb5909640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fecb00cee30 0x7fecb01f06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:45.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.366+0000 7fecb4907640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecb00cc7e0 0x7fecb01f0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55252/0 (socket says 172.21.15.47:55252) 2024-04-01T22:33:45.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.366+0000 7fecb4907640 1 -- 172.21.15.47:0/2165965617 learned_addr learned my addr 172.21.15.47:0/2165965617 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:45.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.369+0000 7fecb4907640 1 -- 172.21.15.47:0/2165965617 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fecb00c93f0 msgr2=0x7fecb00c6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:45.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.369+0000 7fecb4907640 1 --2- 172.21.15.47:0/2165965617 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fecb00c93f0 0x7fecb00c6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:45.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.369+0000 7fecb4907640 1 -- 172.21.15.47:0/2165965617 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fecb00cee30 msgr2=0x7fecb01f06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:45.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.369+0000 7fecb4907640 1 --2- 172.21.15.47:0/2165965617 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fecb00cee30 0x7fecb01f06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:45.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.369+0000 7fecb4907640 1 -- 172.21.15.47:0/2165965617 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecb01efc90 con 0x7fecb00cc7e0 2024-04-01T22:33:45.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.371+0000 7fecb4907640 1 --2- 172.21.15.47:0/2165965617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecb00cc7e0 0x7fecb01f0190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7feca000c3f0 tx=0x7feca000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:45.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.376+0000 7feca5ffb640 1 -- 172.21.15.47:0/2165965617 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca00052d0 con 0x7fecb00cc7e0 2024-04-01T22:33:45.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.376+0000 7feca5ffb640 1 -- 172.21.15.47:0/2165965617 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feca0005490 con 0x7fecb00cc7e0 2024-04-01T22:33:45.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.376+0000 7fecb736c640 1 -- 172.21.15.47:0/2165965617 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecb00c4e80 con 0x7fecb00cc7e0 2024-04-01T22:33:45.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.376+0000 7feca5ffb640 1 -- 172.21.15.47:0/2165965617 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca0007260 con 0x7fecb00cc7e0 2024-04-01T22:33:45.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.376+0000 7fecb736c640 1 -- 172.21.15.47:0/2165965617 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecb00c5440 con 0x7fecb00cc7e0 2024-04-01T22:33:45.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.377+0000 7fecb736c640 1 -- 172.21.15.47:0/2165965617 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecb0068210 con 0x7fecb00cc7e0 2024-04-01T22:33:45.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.648+0000 7feca5ffb640 1 -- 172.21.15.47:0/2165965617 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7feca0007400 con 0x7fecb00cc7e0 2024-04-01T22:33:45.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.649+0000 7feca5ffb640 1 --2- 172.21.15.47:0/2165965617 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fec9406b9e0 0x7fec9406dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:45.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.649+0000 7fecb5108640 1 --2- 172.21.15.47:0/2165965617 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fec9406b9e0 0x7fec9406dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:45.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.649+0000 7fecb5108640 1 --2- 172.21.15.47:0/2165965617 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fec9406b9e0 0x7fec9406dea0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fecac0011e0 tx=0x7fecac007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:45.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.664+0000 7feca5ffb640 1 -- 172.21.15.47:0/2165965617 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7feca0056b00 con 0x7fecb00cc7e0 2024-04-01T22:33:45.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.664+0000 7feca5ffb640 1 -- 172.21.15.47:0/2165965617 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7feca0058a60 con 0x7fecb00cc7e0 2024-04-01T22:33:45.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.856+0000 7fecb736c640 1 -- 172.21.15.47:0/2165965617 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fecb006cf00 con 0x7fecb00cc7e0 2024-04-01T22:33:45.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.863+0000 7feca5ffb640 1 -- 172.21.15.47:0/2165965617 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7feca005cb00 con 0x7fecb00cc7e0 2024-04-01T22:33:45.863 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-01T22:33:45.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.866+0000 7fecb736c640 1 -- 172.21.15.47:0/2165965617 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fec9406b9e0 msgr2=0x7fec9406dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:45.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.866+0000 7fecb736c640 1 --2- 172.21.15.47:0/2165965617 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fec9406b9e0 0x7fec9406dea0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fecac0011e0 tx=0x7fecac007d30 comp rx=0 tx=0).stop 2024-04-01T22:33:45.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.866+0000 7fecb736c640 1 -- 172.21.15.47:0/2165965617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecb00cc7e0 msgr2=0x7fecb01f0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:45.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.866+0000 7fecb736c640 1 --2- 172.21.15.47:0/2165965617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecb00cc7e0 0x7fecb01f0190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7feca000c3f0 tx=0x7feca000c8b0 comp rx=0 tx=0).stop 2024-04-01T22:33:45.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.866+0000 7fecb736c640 1 -- 172.21.15.47:0/2165965617 shutdown_connections 2024-04-01T22:33:45.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.866+0000 7fecb736c640 1 --2- 172.21.15.47:0/2165965617 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fec9406b9e0 0x7fec9406dea0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:45.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.866+0000 7fecb736c640 1 --2- 172.21.15.47:0/2165965617 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fecb00cee30 0x7fecb01f06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:45.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.866+0000 7fecb736c640 1 --2- 172.21.15.47:0/2165965617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecb00cc7e0 0x7fecb01f0190 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:45.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.866+0000 7fecb736c640 1 --2- 172.21.15.47:0/2165965617 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fecb00c93f0 0x7fecb00c6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:45.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.866+0000 7fecb736c640 1 -- 172.21.15.47:0/2165965617 >> 172.21.15.47:0/2165965617 conn(0x7fecb00cfdb0 msgr2=0x7fecb00d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:45.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.866+0000 7fecb736c640 1 -- 172.21.15.47:0/2165965617 shutdown_connections 2024-04-01T22:33:45.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.866+0000 7fecb736c640 1 -- 172.21.15.47:0/2165965617 wait complete. 2024-04-01T22:33:45.876 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-01T22:33:45.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.984+0000 7f545953e640 1 Processor -- start 2024-04-01T22:33:45.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.984+0000 7f545953e640 1 -- start start 2024-04-01T22:33:45.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.985+0000 7f545953e640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f545406c5f0 0x7f545415aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:45.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.985+0000 7f545953e640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54540cdc00 con 0x7f545415b9b0 2024-04-01T22:33:45.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.985+0000 7f545953e640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54540cdee0 con 0x7f545406c210 2024-04-01T22:33:45.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.985+0000 7f545953e640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f545415b400 con 0x7f545406c5f0 2024-04-01T22:33:45.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.985+0000 7f54527fc640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f545406c5f0 0x7f545415aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:45.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.985+0000 7f54537fe640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f545415b9b0 0x7f545415be10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:58988/0 (socket says 172.21.15.47:58988) 2024-04-01T22:33:45.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.985+0000 7f54537fe640 1 -- 172.21.15.47:0/4005380136 learned_addr learned my addr 172.21.15.47:0/4005380136 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T22:33:45.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.988+0000 7f5451ffb640 1 -- 172.21.15.47:0/4005380136 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 545865841 0 0) 0x7f54540cdee0 con 0x7f545406c210 2024-04-01T22:33:45.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.988+0000 7f5451ffb640 1 -- 172.21.15.47:0/4005380136 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f543c003520 con 0x7f545406c210 2024-04-01T22:33:45.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.988+0000 7f54527fc640 1 -- 172.21.15.47:0/4005380136 >> v1:172.21.15.181:6789/0 conn(0x7f545406c210 legacy=0x7f54540cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:45.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.988+0000 7f54527fc640 1 -- 172.21.15.47:0/4005380136 >> v1:172.21.15.47:6789/0 conn(0x7f545415b9b0 legacy=0x7f545415be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:45.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.988+0000 7f54527fc640 1 -- 172.21.15.47:0/4005380136 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54540ce1c0 con 0x7f545406c5f0 2024-04-01T22:33:45.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.990+0000 7f54527fc640 1 --2- 172.21.15.47:0/4005380136 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f545406c5f0 0x7f545415aec0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f54440097d0 tx=0x7f544402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83d0244f1cc13e96 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:45.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.994+0000 7f5451ffb640 1 -- 172.21.15.47:0/4005380136 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5444035020 con 0x7f545406c5f0 2024-04-01T22:33:45.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.994+0000 7f5451ffb640 1 -- 172.21.15.47:0/4005380136 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5444031890 con 0x7f545406c5f0 2024-04-01T22:33:45.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.994+0000 7f5451ffb640 1 -- 172.21.15.47:0/4005380136 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5444031c60 con 0x7f545406c5f0 2024-04-01T22:33:45.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.995+0000 7f545953e640 1 -- 172.21.15.47:0/4005380136 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f545406c5f0 msgr2=0x7f545415aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:45.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.995+0000 7f545953e640 1 --2- 172.21.15.47:0/4005380136 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f545406c5f0 0x7f545415aec0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f54440097d0 tx=0x7f544402b930 comp rx=0 tx=0).stop 2024-04-01T22:33:45.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.995+0000 7f545953e640 1 -- 172.21.15.47:0/4005380136 shutdown_connections 2024-04-01T22:33:45.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.995+0000 7f545953e640 1 --2- 172.21.15.47:0/4005380136 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f545406c5f0 0x7f545415aec0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:45.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.995+0000 7f545953e640 1 -- 172.21.15.47:0/4005380136 >> 172.21.15.47:0/4005380136 conn(0x7f54540cfdb0 msgr2=0x7f54540d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:45.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.995+0000 7f545953e640 1 -- 172.21.15.47:0/4005380136 shutdown_connections 2024-04-01T22:33:45.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.995+0000 7f545953e640 1 -- 172.21.15.47:0/4005380136 wait complete. 2024-04-01T22:33:45.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.996+0000 7f545953e640 1 Processor -- start 2024-04-01T22:33:45.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.996+0000 7f545953e640 1 -- start start 2024-04-01T22:33:45.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.997+0000 7f545953e640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f545406c210 0x7f5454157300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:45.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.997+0000 7f545953e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f545406c5f0 0x7f54541e48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:45.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.997+0000 7f545953e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f545415b9b0 0x7f54541582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:45.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.997+0000 7f545953e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f54540ce810 con 0x7f545415b9b0 2024-04-01T22:33:45.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.997+0000 7f545953e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f54540cd9b0 con 0x7f545406c5f0 2024-04-01T22:33:45.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.997+0000 7f545953e640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f54540cf310 con 0x7f545406c210 2024-04-01T22:33:45.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.997+0000 7f5452ffd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f545406c210 0x7f5454157300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:45.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.997+0000 7f54537fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f545415b9b0 0x7f54541582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:45.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.997+0000 7f54527fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f545406c5f0 0x7f54541e48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:45.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.997+0000 7f5452ffd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f545406c210 0x7f5454157300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:58762/0 (socket says 172.21.15.47:58762) 2024-04-01T22:33:45.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:45.997+0000 7f5452ffd640 1 -- 172.21.15.47:0/185071981 learned_addr learned my addr 172.21.15.47:0/185071981 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:46.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.001+0000 7f54537fe640 1 -- 172.21.15.47:0/185071981 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f545406c210 msgr2=0x7f5454157300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:46.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.001+0000 7f54537fe640 1 --2- 172.21.15.47:0/185071981 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f545406c210 0x7f5454157300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:46.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.001+0000 7f54537fe640 1 -- 172.21.15.47:0/185071981 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f545406c5f0 msgr2=0x7f54541e48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:46.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.001+0000 7f54537fe640 1 --2- 172.21.15.47:0/185071981 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f545406c5f0 0x7f54541e48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:46.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.001+0000 7f54537fe640 1 -- 172.21.15.47:0/185071981 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54540b1a20 con 0x7f545415b9b0 2024-04-01T22:33:46.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.003+0000 7f54537fe640 1 --2- 172.21.15.47:0/185071981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f545415b9b0 0x7f54541582b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f544c00ca70 tx=0x7f544c00cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:46.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.007+0000 7f543b7fe640 1 -- 172.21.15.47:0/185071981 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f544c017070 con 0x7f545415b9b0 2024-04-01T22:33:46.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.007+0000 7f543b7fe640 1 -- 172.21.15.47:0/185071981 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f544c00abd0 con 0x7f545415b9b0 2024-04-01T22:33:46.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.007+0000 7f545953e640 1 -- 172.21.15.47:0/185071981 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54540b1ca0 con 0x7f545415b9b0 2024-04-01T22:33:46.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.007+0000 7f543b7fe640 1 -- 172.21.15.47:0/185071981 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f544c012400 con 0x7f545415b9b0 2024-04-01T22:33:46.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.007+0000 7f545953e640 1 -- 172.21.15.47:0/185071981 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54541f0600 con 0x7f545415b9b0 2024-04-01T22:33:46.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.008+0000 7f545953e640 1 -- 172.21.15.47:0/185071981 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54541f0110 con 0x7f545415b9b0 2024-04-01T22:33:46.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.273+0000 7f543b7fe640 1 -- 172.21.15.47:0/185071981 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f544c01a070 con 0x7f545415b9b0 2024-04-01T22:33:46.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.274+0000 7f543b7fe640 1 --2- 172.21.15.47:0/185071981 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f544006b9e0 0x7f544006dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:46.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.274+0000 7f5452ffd640 1 --2- 172.21.15.47:0/185071981 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f544006b9e0 0x7f544006dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:46.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.274+0000 7f5452ffd640 1 --2- 172.21.15.47:0/185071981 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f544006b9e0 0x7f544006dea0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5448007fd0 tx=0x7f5448009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:46.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.287+0000 7f543b7fe640 1 -- 172.21.15.47:0/185071981 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f544c01de30 con 0x7f545415b9b0 2024-04-01T22:33:46.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.287+0000 7f543b7fe640 1 -- 172.21.15.47:0/185071981 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f54540b1a20 con 0x7f545415b9b0 2024-04-01T22:33:46.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.482+0000 7f545953e640 1 -- 172.21.15.47:0/185071981 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5454068210 con 0x7f545415b9b0 2024-04-01T22:33:46.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.487+0000 7f543b7fe640 1 -- 172.21.15.47:0/185071981 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f544c058f20 con 0x7f545415b9b0 2024-04-01T22:33:46.486 INFO:teuthology.orchestra.run.smithi047.stderr:listed 0 entries 2024-04-01T22:33:46.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.489+0000 7f545953e640 1 -- 172.21.15.47:0/185071981 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f544006b9e0 msgr2=0x7f544006dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:46.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.489+0000 7f545953e640 1 --2- 172.21.15.47:0/185071981 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f544006b9e0 0x7f544006dea0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5448007fd0 tx=0x7f5448009040 comp rx=0 tx=0).stop 2024-04-01T22:33:46.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.489+0000 7f545953e640 1 -- 172.21.15.47:0/185071981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f545415b9b0 msgr2=0x7f54541582b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:46.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.489+0000 7f545953e640 1 --2- 172.21.15.47:0/185071981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f545415b9b0 0x7f54541582b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f544c00ca70 tx=0x7f544c00cf30 comp rx=0 tx=0).stop 2024-04-01T22:33:46.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.489+0000 7f545953e640 1 -- 172.21.15.47:0/185071981 shutdown_connections 2024-04-01T22:33:46.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.489+0000 7f545953e640 1 --2- 172.21.15.47:0/185071981 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f544006b9e0 0x7f544006dea0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:46.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.489+0000 7f545953e640 1 --2- 172.21.15.47:0/185071981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f545415b9b0 0x7f54541582b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:46.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.489+0000 7f545953e640 1 --2- 172.21.15.47:0/185071981 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f545406c5f0 0x7f54541e48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:46.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.489+0000 7f545953e640 1 --2- 172.21.15.47:0/185071981 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f545406c210 0x7f5454157300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:46.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.489+0000 7f545953e640 1 -- 172.21.15.47:0/185071981 >> 172.21.15.47:0/185071981 conn(0x7f54540cfdb0 msgr2=0x7f545414d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:46.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.489+0000 7f545953e640 1 -- 172.21.15.47:0/185071981 shutdown_connections 2024-04-01T22:33:46.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.489+0000 7f545953e640 1 -- 172.21.15.47:0/185071981 wait complete. 2024-04-01T22:33:46.500 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-01T22:33:46.500 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-01T22:33:46.515 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T22:33:46.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.659+0000 7f30fa308640 1 Processor -- start 2024-04-01T22:33:46.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.659+0000 7f30fa308640 1 -- start start 2024-04-01T22:33:46.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.659+0000 7f30fa308640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f30f415aec0 0x7f30f406c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:46.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.659+0000 7f30fa308640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f30f415bb20 0x7f30f415bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:46.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.659+0000 7f30fa308640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30f4154b70 con 0x7f30f406c250 2024-04-01T22:33:46.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.659+0000 7f30fa308640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f30f40ce990 con 0x7f30f415bb20 2024-04-01T22:33:46.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.659+0000 7f30fa308640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f30f415c4b0 con 0x7f30f415aec0 2024-04-01T22:33:46.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.660+0000 7f30f37fe640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f30f415aec0 0x7f30f406c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:46.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.660+0000 7f30f88a5640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f30f415bb20 0x7f30f415bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:46.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.660+0000 7f30f3fff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f30f406c250 0x7f30f40ceb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.47:55390/0 (socket says 172.21.15.47:55390) 2024-04-01T22:33:46.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.660+0000 7f30f3fff640 1 -- 172.21.15.47:0/3432864254 learned_addr learned my addr 172.21.15.47:0/3432864254 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T22:33:46.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.663+0000 7f30f88a5640 1 -- 172.21.15.47:0/3432864254 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f30f415aec0 msgr2=0x7f30f406c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:46.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.663+0000 7f30f88a5640 1 --2- 172.21.15.47:0/3432864254 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f30f415aec0 0x7f30f406c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:46.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.663+0000 7f30f88a5640 1 -- 172.21.15.47:0/3432864254 >> v1:172.21.15.181:6789/0 conn(0x7f30f406c250 legacy=0x7f30f40ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:46.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.663+0000 7f30f88a5640 1 -- 172.21.15.47:0/3432864254 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30f40cdac0 con 0x7f30f415bb20 2024-04-01T22:33:46.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.665+0000 7f30f88a5640 1 --2- 172.21.15.47:0/3432864254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30f415bb20 0x7f30f415bf70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f30ec009d90 tx=0x7f30ec02bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff98bece8bceed27 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:46.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.670+0000 7f30f2ffd640 1 -- 172.21.15.47:0/3432864254 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ec039070 con 0x7f30f415bb20 2024-04-01T22:33:46.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.670+0000 7f30f2ffd640 1 -- 172.21.15.47:0/3432864254 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30ec02cce0 con 0x7f30f415bb20 2024-04-01T22:33:46.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.670+0000 7f30f2ffd640 1 -- 172.21.15.47:0/3432864254 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ec034660 con 0x7f30f415bb20 2024-04-01T22:33:46.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.671+0000 7f30fa308640 1 -- 172.21.15.47:0/3432864254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30f415bb20 msgr2=0x7f30f415bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:46.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.671+0000 7f30fa308640 1 --2- 172.21.15.47:0/3432864254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30f415bb20 0x7f30f415bf70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f30ec009d90 tx=0x7f30ec02bf30 comp rx=0 tx=0).stop 2024-04-01T22:33:46.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.671+0000 7f30fa308640 1 -- 172.21.15.47:0/3432864254 shutdown_connections 2024-04-01T22:33:46.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.671+0000 7f30fa308640 1 --2- 172.21.15.47:0/3432864254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30f415bb20 0x7f30f415bf70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:46.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.671+0000 7f30fa308640 1 --2- 172.21.15.47:0/3432864254 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f30f415aec0 0x7f30f406c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:46.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.671+0000 7f30fa308640 1 -- 172.21.15.47:0/3432864254 >> 172.21.15.47:0/3432864254 conn(0x7f30f40cfdb0 msgr2=0x7f30f40d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:46.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.671+0000 7f30fa308640 1 -- 172.21.15.47:0/3432864254 shutdown_connections 2024-04-01T22:33:46.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.671+0000 7f30fa308640 1 -- 172.21.15.47:0/3432864254 wait complete. 2024-04-01T22:33:46.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.673+0000 7f30fa308640 1 Processor -- start 2024-04-01T22:33:46.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.673+0000 7f30fa308640 1 -- start start 2024-04-01T22:33:46.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.674+0000 7f30fa308640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f30f406c250 0x7f30f40c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:46.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.674+0000 7f30fa308640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30f415aec0 0x7f30f40c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:46.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.674+0000 7f30fa308640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30f415bb20 0x7f30f40b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:46.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.674+0000 7f30fa308640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f30f40ce060 con 0x7f30f415aec0 2024-04-01T22:33:46.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.674+0000 7f30fa308640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f30f40cdd80 con 0x7f30f415bb20 2024-04-01T22:33:46.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.674+0000 7f30fa308640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f30f40ce340 con 0x7f30f406c250 2024-04-01T22:33:46.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.675+0000 7f30f3fff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f30f406c250 0x7f30f40c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:46.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.675+0000 7f30f88a5640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30f415bb20 0x7f30f40b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:46.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.675+0000 7f30f3fff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f30f406c250 0x7f30f40c7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:58774/0 (socket says 172.21.15.47:58774) 2024-04-01T22:33:46.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.675+0000 7f30f3fff640 1 -- 172.21.15.47:0/3019888423 learned_addr learned my addr 172.21.15.47:0/3019888423 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:46.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.677+0000 7f30f37fe640 1 --2- 172.21.15.47:0/3019888423 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30f415aec0 0x7f30f40c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:46.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.680+0000 7f30f3fff640 1 -- 172.21.15.47:0/3019888423 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30f415bb20 msgr2=0x7f30f40b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:46.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.680+0000 7f30f3fff640 1 --2- 172.21.15.47:0/3019888423 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30f415bb20 0x7f30f40b0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:46.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.680+0000 7f30f3fff640 1 -- 172.21.15.47:0/3019888423 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30f415aec0 msgr2=0x7f30f40c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:46.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.680+0000 7f30f3fff640 1 --2- 172.21.15.47:0/3019888423 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30f415aec0 0x7f30f40c8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:46.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.680+0000 7f30f3fff640 1 -- 172.21.15.47:0/3019888423 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30f40b4e80 con 0x7f30f406c250 2024-04-01T22:33:46.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.682+0000 7f30f3fff640 1 --2- 172.21.15.47:0/3019888423 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f30f406c250 0x7f30f40c7fe0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f30e400c400 tx=0x7f30e400c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:46.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.686+0000 7f30f0ff9640 1 -- 172.21.15.47:0/3019888423 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e4017070 con 0x7f30f406c250 2024-04-01T22:33:46.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.686+0000 7f30f0ff9640 1 -- 172.21.15.47:0/3019888423 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30e4005ce0 con 0x7f30f406c250 2024-04-01T22:33:46.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.686+0000 7f30f0ff9640 1 -- 172.21.15.47:0/3019888423 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e40072f0 con 0x7f30f406c250 2024-04-01T22:33:46.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.686+0000 7f30fa308640 1 -- 172.21.15.47:0/3019888423 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30f40b5600 con 0x7f30f406c250 2024-04-01T22:33:46.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.686+0000 7f30fa308640 1 -- 172.21.15.47:0/3019888423 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f30f40b35a0 con 0x7f30f406c250 2024-04-01T22:33:46.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.688+0000 7f30fa308640 1 -- 172.21.15.47:0/3019888423 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30f4068210 con 0x7f30f406c250 2024-04-01T22:33:46.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.705+0000 7f30f0ff9640 1 -- 172.21.15.47:0/3019888423 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f30e401a070 con 0x7f30f406c250 2024-04-01T22:33:46.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.705+0000 7f30f0ff9640 1 --2- 172.21.15.47:0/3019888423 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f30e006b9e0 0x7f30e006dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:46.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.705+0000 7f30f37fe640 1 --2- 172.21.15.47:0/3019888423 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f30e006b9e0 0x7f30e006dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:46.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.706+0000 7f30f37fe640 1 --2- 172.21.15.47:0/3019888423 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f30e006b9e0 0x7f30e006dea0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f30f40c8f10 tx=0x7f30e8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:46.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.709+0000 7f30f0ff9640 1 -- 172.21.15.47:0/3019888423 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f30e4056680 con 0x7f30f406c250 2024-04-01T22:33:46.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:46.942+0000 7f30f0ff9640 1 -- 172.21.15.47:0/3019888423 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f30e4021020 con 0x7f30f406c250 2024-04-01T22:33:47.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.144+0000 7f30fa308640 1 -- 172.21.15.47:0/3019888423 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f30f40b5b50 con 0x7f30f406c250 2024-04-01T22:33:47.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.266+0000 7f30f0ff9640 1 -- 172.21.15.47:0/3019888423 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18526 (secure 0 0 0) 0x7f30e40585e0 con 0x7f30f406c250 2024-04-01T22:33:47.267 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:33:47.267 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"fsid":"a6998a48-38bc-4e42-b0d9-04f2fb5c3c87","created":"2024-04-01T22:32:57.112033+0000","modified":"2024-04-01T22:33:33.448062+0000","last_up_change":"2024-04-01T22:33:11.141073+0000","last_in_change":"2024-04-01T22:33:02.650459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T22:33:13.356568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T22:33:25.309421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T22:33:26.268050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-01T22:33:30.588103+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7bd3f25d-e3a5-4932-b381-53dcbb464dde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6811","nonce":3827395709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6813","nonce":3827395709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6817","nonce":3827395709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6815","nonce":3827395709}]},"public_addr":"172.21.15.47:6811/3827395709","cluster_addr":"172.21.15.47:6813/3827395709","heartbeat_back_addr":"172.21.15.47:6817/3827395709","heartbeat_front_addr":"172.21.15.47:6815/3827395709","state":["exists","up"]},{"osd":1,"uuid":"2aa60ba2-67ff-43c7-96c4-82ae2f3855ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6827","nonce":3152157503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6829","nonce":3152157503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6833","nonce":3152157503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6831","nonce":3152157503}]},"public_addr":"172.21.15.47:6827/3152157503","cluster_addr":"172.21.15.47:6829/3152157503","heartbeat_back_addr":"172.21.15.47:6833/3152157503","heartbeat_front_addr":"172.21.15.47:6831/3152157503","state":["exists","up"]},{"osd":2,"uuid":"d83f8a98-6db8-42b7-9ef6-5b16eb9a3492","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6803","nonce":1003968856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6805","nonce":1003968856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6809","nonce":1003968856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6807","nonce":1003968856}]},"public_addr":"172.21.15.47:6803/1003968856","cluster_addr":"172.21.15.47:6805/1003968856","heartbeat_back_addr":"172.21.15.47:6809/1003968856","heartbeat_front_addr":"172.21.15.47:6807/1003968856","state":["exists","up"]},{"osd":3,"uuid":"edc02ed5-d25c-4dc9-a0c3-7a26f20fae07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6819","nonce":2845699561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6821","nonce":2845699561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6825","nonce":2845699561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6823","nonce":2845699561}]},"public_addr":"172.21.15.47:6819/2845699561","cluster_addr":"172.21.15.47:6821/2845699561","heartbeat_back_addr":"172.21.15.47:6825/2845699561","heartbeat_front_addr":"172.21.15.47:6823/2845699561","state":["exists","up"]},{"osd":4,"uuid":"b3d67e74-f51e-4474-9c62-dd0daa60c728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6809","nonce":2961538461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6811","nonce":2961538461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6815","nonce":2961538461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6813","nonce":2961538461}]},"public_addr":"172.21.15.181:6809/2961538461","cluster_addr":"172.21.15.181:6811/2961538461","heartbeat_back_addr":"172.21.15.181:6815/2961538461","heartbeat_front_addr":"172.21.15.181:6813/2961538461","state":["exists","up"]},{"osd":5,"uuid":"d86e8f7a-99f4-4457-9949-cf2cb853e79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6817","nonce":2161566540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6819","nonce":2161566540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6823","nonce":2161566540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6821","nonce":2161566540}]},"public_addr":"172.21.15.181:6817/2161566540","cluster_addr":"172.21.15.181:6819/2161566540","heartbeat_back_addr":"172.21.15.181:6823/2161566540","heartbeat_front_addr":"172.21.15.181:6821/2161566540","state":["exists","up"]},{"osd":6,"uuid":"aa08266c-1719-4abd-afb9-e7e8ac593658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6801","nonce":3792144865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6803","nonce":3792144865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6807","nonce":3792144865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6805","nonce":3792144865}]},"public_addr":"172.21.15.181:6801/3792144865","cluster_addr":"172.21.15.181:6803/3792144865","heartbeat_back_addr":"172.21.15.181:6807/3792144865","heartbeat_front_addr":"172.21.15.181:6805/3792144865","state":["exists","up"]},{"osd":7,"uuid":"6e509762-24c8-46c3-93a1-4c50b11ebcf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6825","nonce":1760995885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6827","nonce":1760995885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6831","nonce":1760995885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6829","nonce":1760995885}]},"public_addr":"172.21.15.181:6825/1760995885","cluster_addr":"172.21.15.181:6827/1760995885","heartbeat_back_addr":"172.21.15.181:6831/1760995885","heartbeat_front_addr":"172.21.15.181:6829/1760995885","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.202426+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.255318+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.170288+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.290065+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.214871+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.176432+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.139940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.299546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T22:33:47.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.268+0000 7f30fa308640 1 -- 172.21.15.47:0/3019888423 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f30e006b9e0 msgr2=0x7f30e006dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:47.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.268+0000 7f30fa308640 1 --2- 172.21.15.47:0/3019888423 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f30e006b9e0 0x7f30e006dea0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f30f40c8f10 tx=0x7f30e8009190 comp rx=0 tx=0).stop 2024-04-01T22:33:47.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.268+0000 7f30fa308640 1 -- 172.21.15.47:0/3019888423 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f30f406c250 msgr2=0x7f30f40c7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:47.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.269+0000 7f30fa308640 1 --2- 172.21.15.47:0/3019888423 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f30f406c250 0x7f30f40c7fe0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f30e400c400 tx=0x7f30e400c8c0 comp rx=0 tx=0).stop 2024-04-01T22:33:47.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.269+0000 7f30fa308640 1 -- 172.21.15.47:0/3019888423 shutdown_connections 2024-04-01T22:33:47.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.269+0000 7f30fa308640 1 --2- 172.21.15.47:0/3019888423 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f30e006b9e0 0x7f30e006dea0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:47.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.269+0000 7f30fa308640 1 --2- 172.21.15.47:0/3019888423 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f30f415bb20 0x7f30f40b0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:47.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.269+0000 7f30fa308640 1 --2- 172.21.15.47:0/3019888423 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30f415aec0 0x7f30f40c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:47.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.269+0000 7f30fa308640 1 --2- 172.21.15.47:0/3019888423 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f30f406c250 0x7f30f40c7fe0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:47.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.269+0000 7f30fa308640 1 -- 172.21.15.47:0/3019888423 >> 172.21.15.47:0/3019888423 conn(0x7f30f40cfdb0 msgr2=0x7f30f4153f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:47.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.269+0000 7f30fa308640 1 -- 172.21.15.47:0/3019888423 shutdown_connections 2024-04-01T22:33:47.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.269+0000 7f30fa308640 1 -- 172.21.15.47:0/3019888423 wait complete. 2024-04-01T22:33:47.279 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-01T22:33:13.356568+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-01T22:33:25.309421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-01T22:33:26.268050+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-01T22:33:30.588103+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-01T22:33:47.280 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-01T22:33:47.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.413+0000 7f9d8609a640 1 Processor -- start 2024-04-01T22:33:47.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.413+0000 7f9d8609a640 1 -- start start 2024-04-01T22:33:47.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.414+0000 7f9d8609a640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f9d800c89d0 0x7f9d8006c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:47.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.414+0000 7f9d8609a640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9d8006cc90 0x7f9d8015a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:47.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.414+0000 7f9d8609a640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d8015b1c0 con 0x7f9d800c8db0 2024-04-01T22:33:47.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.414+0000 7f9d8609a640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f9d8015e9c0 con 0x7f9d800c89d0 2024-04-01T22:33:47.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.414+0000 7f9d8609a640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f9d8015dc00 con 0x7f9d8006cc90 2024-04-01T22:33:47.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.414+0000 7f9d7ffff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9d8006cc90 0x7f9d8015a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:47.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.415+0000 7f9d7f7fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f9d800c89d0 0x7f9d8006c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:47.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.415+0000 7f9d77fff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f9d800c8db0 0x7f9d80154040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:58990/0 (socket says 172.21.15.47:58990) 2024-04-01T22:33:47.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.415+0000 7f9d77fff640 1 -- 172.21.15.47:0/244889291 learned_addr learned my addr 172.21.15.47:0/244889291 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T22:33:47.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.417+0000 7f9d7ffff640 1 -- 172.21.15.47:0/244889291 >> v2:172.21.15.181:3300/0 conn(0x7f9d800c89d0 msgr2=0x7f9d8006c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:47.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.417+0000 7f9d7ffff640 1 --2- 172.21.15.47:0/244889291 >> v2:172.21.15.181:3300/0 conn(0x7f9d800c89d0 0x7f9d8006c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:47.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.417+0000 7f9d7ffff640 1 -- 172.21.15.47:0/244889291 >> v1:172.21.15.47:6789/0 conn(0x7f9d800c8db0 legacy=0x7f9d80154040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:47.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.417+0000 7f9d7ffff640 1 -- 172.21.15.47:0/244889291 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d8015dee0 con 0x7f9d8006cc90 2024-04-01T22:33:47.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.419+0000 7f9d7ffff640 1 --2- 172.21.15.47:0/244889291 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9d8006cc90 0x7f9d8015a430 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9d78009d90 tx=0x7f9d7802bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf2691f1fdd7d737 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:47.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.422+0000 7f9d7effd640 1 -- 172.21.15.47:0/244889291 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d78039070 con 0x7f9d8006cc90 2024-04-01T22:33:47.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.422+0000 7f9d7effd640 1 -- 172.21.15.47:0/244889291 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d7802cce0 con 0x7f9d8006cc90 2024-04-01T22:33:47.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.422+0000 7f9d7effd640 1 -- 172.21.15.47:0/244889291 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d78034660 con 0x7f9d8006cc90 2024-04-01T22:33:47.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.423+0000 7f9d8609a640 1 -- 172.21.15.47:0/244889291 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9d8006cc90 msgr2=0x7f9d8015a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:47.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.423+0000 7f9d8609a640 1 --2- 172.21.15.47:0/244889291 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9d8006cc90 0x7f9d8015a430 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9d78009d90 tx=0x7f9d7802bf30 comp rx=0 tx=0).stop 2024-04-01T22:33:47.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.423+0000 7f9d8609a640 1 -- 172.21.15.47:0/244889291 shutdown_connections 2024-04-01T22:33:47.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.423+0000 7f9d8609a640 1 --2- 172.21.15.47:0/244889291 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9d8006cc90 0x7f9d8015a430 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:47.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.423+0000 7f9d8609a640 1 --2- 172.21.15.47:0/244889291 >> v2:172.21.15.181:3300/0 conn(0x7f9d800c89d0 0x7f9d8006c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:47.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.423+0000 7f9d8609a640 1 -- 172.21.15.47:0/244889291 >> 172.21.15.47:0/244889291 conn(0x7f9d80071310 msgr2=0x7f9d80071720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:47.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.423+0000 7f9d8609a640 1 -- 172.21.15.47:0/244889291 shutdown_connections 2024-04-01T22:33:47.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.423+0000 7f9d8609a640 1 -- 172.21.15.47:0/244889291 wait complete. 2024-04-01T22:33:47.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.424+0000 7f9d8609a640 1 Processor -- start 2024-04-01T22:33:47.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.425+0000 7f9d8609a640 1 -- start start 2024-04-01T22:33:47.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.425+0000 7f9d8609a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9d8006cc90 0x7f9d800ca450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:47.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.425+0000 7f9d8609a640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9d800c89d0 0x7f9d800ca990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:47.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.425+0000 7f9d8609a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d800c8db0 0x7f9d8015b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:47.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.425+0000 7f9d8609a640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9d800cdbe0 con 0x7f9d800c8db0 2024-04-01T22:33:47.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.425+0000 7f9d8609a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9d8015e4a0 con 0x7f9d8006cc90 2024-04-01T22:33:47.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.425+0000 7f9d8609a640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f9d800cdd60 con 0x7f9d800c89d0 2024-04-01T22:33:47.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.426+0000 7f9d7ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d800c8db0 0x7f9d8015b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:47.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.426+0000 7f9d77fff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9d800c89d0 0x7f9d800ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:47.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.426+0000 7f9d7f7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9d8006cc90 0x7f9d800ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:47.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.426+0000 7f9d77fff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9d800c89d0 0x7f9d800ca990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:58784/0 (socket says 172.21.15.47:58784) 2024-04-01T22:33:47.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.426+0000 7f9d77fff640 1 -- 172.21.15.47:0/1873814626 learned_addr learned my addr 172.21.15.47:0/1873814626 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:47.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.430+0000 7f9d77fff640 1 -- 172.21.15.47:0/1873814626 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9d8006cc90 msgr2=0x7f9d800ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:47.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.430+0000 7f9d77fff640 1 --2- 172.21.15.47:0/1873814626 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9d8006cc90 0x7f9d800ca450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:47.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.430+0000 7f9d77fff640 1 -- 172.21.15.47:0/1873814626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d800c8db0 msgr2=0x7f9d8015b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:47.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.430+0000 7f9d77fff640 1 --2- 172.21.15.47:0/1873814626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d800c8db0 0x7f9d8015b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:47.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.430+0000 7f9d77fff640 1 -- 172.21.15.47:0/1873814626 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d80159650 con 0x7f9d800c89d0 2024-04-01T22:33:47.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.432+0000 7f9d77fff640 1 --2- 172.21.15.47:0/1873814626 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9d800c89d0 0x7f9d800ca990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9d6800c3c0 tx=0x7f9d6800c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:47.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.435+0000 7f9d7cff9640 1 -- 172.21.15.47:0/1873814626 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d68017070 con 0x7f9d800c89d0 2024-04-01T22:33:47.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.436+0000 7f9d7cff9640 1 -- 172.21.15.47:0/1873814626 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d68005ce0 con 0x7f9d800c89d0 2024-04-01T22:33:47.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.436+0000 7f9d7cff9640 1 -- 172.21.15.47:0/1873814626 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d680072f0 con 0x7f9d800c89d0 2024-04-01T22:33:47.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.436+0000 7f9d8609a640 1 -- 172.21.15.47:0/1873814626 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d80159930 con 0x7f9d800c89d0 2024-04-01T22:33:47.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.436+0000 7f9d8609a640 1 -- 172.21.15.47:0/1873814626 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d80159ef0 con 0x7f9d800c89d0 2024-04-01T22:33:47.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.436+0000 7f9d8609a640 1 -- 172.21.15.47:0/1873814626 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d8006d950 con 0x7f9d800c89d0 2024-04-01T22:33:47.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.678+0000 7f9d7cff9640 1 -- 172.21.15.47:0/1873814626 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f9d6801a070 con 0x7f9d800c89d0 2024-04-01T22:33:47.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.679+0000 7f9d7cff9640 1 --2- 172.21.15.47:0/1873814626 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f9d6006b9e0 0x7f9d6006dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:47.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.679+0000 7f9d7f7fe640 1 --2- 172.21.15.47:0/1873814626 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f9d6006b9e0 0x7f9d6006dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:47.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.679+0000 7f9d7f7fe640 1 --2- 172.21.15.47:0/1873814626 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f9d6006b9e0 0x7f9d6006dea0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9d70009b40 tx=0x7f9d70009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:47.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.682+0000 7f9d7cff9640 1 -- 172.21.15.47:0/1873814626 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9d680565f0 con 0x7f9d800c89d0 2024-04-01T22:33:47.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.692+0000 7f9d7cff9640 1 -- 172.21.15.47:0/1873814626 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f9d8006d950 con 0x7f9d800c89d0 2024-04-01T22:33:47.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.887+0000 7f9d8609a640 1 -- 172.21.15.47:0/1873814626 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9d80068210 con 0x7f9d800c89d0 2024-04-01T22:33:47.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.892+0000 7f9d7cff9640 1 -- 172.21.15.47:0/1873814626 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f9d68021020 con 0x7f9d800c89d0 2024-04-01T22:33:47.892 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-01T22:33:47.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.895+0000 7f9d8609a640 1 -- 172.21.15.47:0/1873814626 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f9d6006b9e0 msgr2=0x7f9d6006dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:47.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.895+0000 7f9d8609a640 1 --2- 172.21.15.47:0/1873814626 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f9d6006b9e0 0x7f9d6006dea0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9d70009b40 tx=0x7f9d70009190 comp rx=0 tx=0).stop 2024-04-01T22:33:47.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.895+0000 7f9d8609a640 1 -- 172.21.15.47:0/1873814626 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9d800c89d0 msgr2=0x7f9d800ca990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:47.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.895+0000 7f9d8609a640 1 --2- 172.21.15.47:0/1873814626 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9d800c89d0 0x7f9d800ca990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9d6800c3c0 tx=0x7f9d6800c880 comp rx=0 tx=0).stop 2024-04-01T22:33:47.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.895+0000 7f9d8609a640 1 -- 172.21.15.47:0/1873814626 shutdown_connections 2024-04-01T22:33:47.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.895+0000 7f9d8609a640 1 --2- 172.21.15.47:0/1873814626 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f9d6006b9e0 0x7f9d6006dea0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:47.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.895+0000 7f9d8609a640 1 --2- 172.21.15.47:0/1873814626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d800c8db0 0x7f9d8015b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:47.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.895+0000 7f9d8609a640 1 --2- 172.21.15.47:0/1873814626 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9d800c89d0 0x7f9d800ca990 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:47.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.895+0000 7f9d8609a640 1 --2- 172.21.15.47:0/1873814626 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9d8006cc90 0x7f9d800ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:47.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.896+0000 7f9d8609a640 1 -- 172.21.15.47:0/1873814626 >> 172.21.15.47:0/1873814626 conn(0x7f9d80071310 msgr2=0x7f9d800c94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:47.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.896+0000 7f9d8609a640 1 -- 172.21.15.47:0/1873814626 shutdown_connections 2024-04-01T22:33:47.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:47.896+0000 7f9d8609a640 1 -- 172.21.15.47:0/1873814626 wait complete. 2024-04-01T22:33:47.906 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-01T22:33:48.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.012+0000 7f800b59a640 1 Processor -- start 2024-04-01T22:33:48.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.012+0000 7f800b59a640 1 -- start start 2024-04-01T22:33:48.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.013+0000 7f800b59a640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f80040c93f0 0x7f80040cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:48.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.013+0000 7f800b59a640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f800415afc0 0x7f800406c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:48.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.013+0000 7f800b59a640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80040cdae0 con 0x7f800406c770 2024-04-01T22:33:48.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.013+0000 7f800b59a640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f80040c97d0 con 0x7f800415afc0 2024-04-01T22:33:48.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.013+0000 7f800b59a640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f80040cdd80 con 0x7f80040c93f0 2024-04-01T22:33:48.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.014+0000 7f8008b35640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f800415afc0 0x7f800406c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:48.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.014+0000 7f8009336640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f80040c93f0 0x7f80040cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:48.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.014+0000 7f8008b35640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f800415afc0 0x7f800406c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55302/0 (socket says 172.21.15.47:55302) 2024-04-01T22:33:48.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.014+0000 7f8008b35640 1 -- 172.21.15.47:0/1254085348 learned_addr learned my addr 172.21.15.47:0/1254085348 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:48.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.017+0000 7f8008b35640 1 -- 172.21.15.47:0/1254085348 >> v2:172.21.15.181:3300/0 conn(0x7f80040c93f0 msgr2=0x7f80040cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:48.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.017+0000 7f8008b35640 1 --2- 172.21.15.47:0/1254085348 >> v2:172.21.15.181:3300/0 conn(0x7f80040c93f0 0x7f80040cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:48.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.017+0000 7f8008b35640 1 -- 172.21.15.47:0/1254085348 >> v1:172.21.15.181:6789/0 conn(0x7f800406c770 legacy=0x7f80040cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:48.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.017+0000 7f8008b35640 1 -- 172.21.15.47:0/1254085348 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80040ce060 con 0x7f800415afc0 2024-04-01T22:33:48.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.018+0000 7f8008b35640 1 --2- 172.21.15.47:0/1254085348 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f800415afc0 0x7f800406c230 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f800408d100 tx=0x7f800002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=757c5bea18fd1065 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:48.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.022+0000 7f7ffbfff640 1 -- 172.21.15.47:0/1254085348 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8000035020 con 0x7f800415afc0 2024-04-01T22:33:48.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.022+0000 7f7ffbfff640 1 -- 172.21.15.47:0/1254085348 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8000031870 con 0x7f800415afc0 2024-04-01T22:33:48.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.022+0000 7f7ffbfff640 1 -- 172.21.15.47:0/1254085348 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8000031c40 con 0x7f800415afc0 2024-04-01T22:33:48.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.023+0000 7f800b59a640 1 -- 172.21.15.47:0/1254085348 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f800415afc0 msgr2=0x7f800406c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:48.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.023+0000 7f800b59a640 1 --2- 172.21.15.47:0/1254085348 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f800415afc0 0x7f800406c230 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f800408d100 tx=0x7f800002b910 comp rx=0 tx=0).stop 2024-04-01T22:33:48.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.023+0000 7f800b59a640 1 -- 172.21.15.47:0/1254085348 shutdown_connections 2024-04-01T22:33:48.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.023+0000 7f800b59a640 1 --2- 172.21.15.47:0/1254085348 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f800415afc0 0x7f800406c230 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:48.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.023+0000 7f800b59a640 1 --2- 172.21.15.47:0/1254085348 >> v2:172.21.15.181:3300/0 conn(0x7f80040c93f0 0x7f80040cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:48.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.023+0000 7f800b59a640 1 -- 172.21.15.47:0/1254085348 >> 172.21.15.47:0/1254085348 conn(0x7f80040cfdb0 msgr2=0x7f80040d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:48.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.023+0000 7f800b59a640 1 -- 172.21.15.47:0/1254085348 shutdown_connections 2024-04-01T22:33:48.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.023+0000 7f800b59a640 1 -- 172.21.15.47:0/1254085348 wait complete. 2024-04-01T22:33:48.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.024+0000 7f800b59a640 1 Processor -- start 2024-04-01T22:33:48.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.024+0000 7f800b59a640 1 -- start start 2024-04-01T22:33:48.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.025+0000 7f800b59a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f800406c770 0x7f80040b4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:48.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.025+0000 7f800b59a640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f80040c93f0 0x7f8004154f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:48.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.025+0000 7f800b59a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f800415afc0 0x7f80041539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:48.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.025+0000 7f800b59a640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f800415b400 con 0x7f800406c770 2024-04-01T22:33:48.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.025+0000 7f800b59a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f80040ce620 con 0x7f800415afc0 2024-04-01T22:33:48.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.025+0000 7f800b59a640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f80040cf430 con 0x7f80040c93f0 2024-04-01T22:33:48.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.025+0000 7f8009336640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f800406c770 0x7f80040b4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:48.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.026+0000 7f8009b37640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f800415afc0 0x7f80041539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:48.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.026+0000 7f8008b35640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f80040c93f0 0x7f8004154f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:48.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.026+0000 7f8009336640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f800406c770 0x7f80040b4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55308/0 (socket says 172.21.15.47:55308) 2024-04-01T22:33:48.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.026+0000 7f8009336640 1 -- 172.21.15.47:0/2509966868 learned_addr learned my addr 172.21.15.47:0/2509966868 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:48.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.029+0000 7f8009336640 1 -- 172.21.15.47:0/2509966868 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f80040c93f0 msgr2=0x7f8004154f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:48.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.029+0000 7f8009336640 1 --2- 172.21.15.47:0/2509966868 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f80040c93f0 0x7f8004154f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:48.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.029+0000 7f8009336640 1 -- 172.21.15.47:0/2509966868 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f800415afc0 msgr2=0x7f80041539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:48.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.029+0000 7f8009336640 1 --2- 172.21.15.47:0/2509966868 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f800415afc0 0x7f80041539d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:48.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.029+0000 7f8009336640 1 -- 172.21.15.47:0/2509966868 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80040b1560 con 0x7f800406c770 2024-04-01T22:33:48.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.031+0000 7f8009336640 1 --2- 172.21.15.47:0/2509966868 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f800406c770 0x7f80040b4a50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7ff400e9e0 tx=0x7f7ff400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:48.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.033+0000 7f7ff9ffb640 1 -- 172.21.15.47:0/2509966868 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff4017070 con 0x7f800406c770 2024-04-01T22:33:48.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.033+0000 7f800b59a640 1 -- 172.21.15.47:0/2509966868 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80040b1b00 con 0x7f800406c770 2024-04-01T22:33:48.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.034+0000 7f800b59a640 1 -- 172.21.15.47:0/2509966868 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80040b4530 con 0x7f800406c770 2024-04-01T22:33:48.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.035+0000 7f800b59a640 1 -- 172.21.15.47:0/2509966868 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8004068210 con 0x7f800406c770 2024-04-01T22:33:48.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.241+0000 7f7ff9ffb640 1 -- 172.21.15.47:0/2509966868 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ff4005990 con 0x7f800406c770 2024-04-01T22:33:48.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.282+0000 7f7ff9ffb640 1 -- 172.21.15.47:0/2509966868 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff4021060 con 0x7f800406c770 2024-04-01T22:33:48.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.290+0000 7f7ff9ffb640 1 -- 172.21.15.47:0/2509966868 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f7ff401a070 con 0x7f800406c770 2024-04-01T22:33:48.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.291+0000 7f7ff9ffb640 1 --2- 172.21.15.47:0/2509966868 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f7fe806b990 0x7f7fe806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:48.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.291+0000 7f8008b35640 1 --2- 172.21.15.47:0/2509966868 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f7fe806b990 0x7f7fe806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:48.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.291+0000 7f8008b35640 1 --2- 172.21.15.47:0/2509966868 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f7fe806b990 0x7f7fe806de50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8000036000 tx=0x7f800003c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:48.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.320+0000 7f7ff9ffb640 1 -- 172.21.15.47:0/2509966868 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7ff4057640 con 0x7f800406c770 2024-04-01T22:33:48.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.321+0000 7f7ff9ffb640 1 -- 172.21.15.47:0/2509966868 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f7ff40595a0 con 0x7f800406c770 2024-04-01T22:33:48.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.508+0000 7f800b59a640 1 -- 172.21.15.47:0/2509966868 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f80040c9e90 con 0x7f800406c770 2024-04-01T22:33:48.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.513+0000 7f7ff9ffb640 1 -- 172.21.15.47:0/2509966868 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f7ff405d640 con 0x7f800406c770 2024-04-01T22:33:48.512 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-01T22:33:48.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.515+0000 7f800b59a640 1 -- 172.21.15.47:0/2509966868 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f7fe806b990 msgr2=0x7f7fe806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:48.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.515+0000 7f800b59a640 1 --2- 172.21.15.47:0/2509966868 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f7fe806b990 0x7f7fe806de50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8000036000 tx=0x7f800003c040 comp rx=0 tx=0).stop 2024-04-01T22:33:48.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.515+0000 7f800b59a640 1 -- 172.21.15.47:0/2509966868 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f800406c770 msgr2=0x7f80040b4a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:48.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.515+0000 7f800b59a640 1 --2- 172.21.15.47:0/2509966868 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f800406c770 0x7f80040b4a50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7ff400e9e0 tx=0x7f7ff400eea0 comp rx=0 tx=0).stop 2024-04-01T22:33:48.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.515+0000 7f800b59a640 1 -- 172.21.15.47:0/2509966868 shutdown_connections 2024-04-01T22:33:48.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.515+0000 7f800b59a640 1 --2- 172.21.15.47:0/2509966868 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f7fe806b990 0x7f7fe806de50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:48.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.515+0000 7f800b59a640 1 --2- 172.21.15.47:0/2509966868 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f800415afc0 0x7f80041539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:48.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.515+0000 7f800b59a640 1 --2- 172.21.15.47:0/2509966868 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f80040c93f0 0x7f8004154f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:48.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.515+0000 7f800b59a640 1 --2- 172.21.15.47:0/2509966868 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f800406c770 0x7f80040b4a50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:48.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.515+0000 7f800b59a640 1 -- 172.21.15.47:0/2509966868 >> 172.21.15.47:0/2509966868 conn(0x7f80040cfdb0 msgr2=0x7f80040c6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:48.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.516+0000 7f800b59a640 1 -- 172.21.15.47:0/2509966868 shutdown_connections 2024-04-01T22:33:48.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.516+0000 7f800b59a640 1 -- 172.21.15.47:0/2509966868 wait complete. 2024-04-01T22:33:48.526 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-01T22:33:48.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.632+0000 7f950111e640 1 Processor -- start 2024-04-01T22:33:48.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.633+0000 7f950111e640 1 -- start start 2024-04-01T22:33:48.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.633+0000 7f950111e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f94fc071470 0x7f94fc158c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:48.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.633+0000 7f950111e640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f94fc0c8560 0x7f94fc151db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:48.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.633+0000 7f950111e640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94fc15c6a0 con 0x7f94fc071850 2024-04-01T22:33:48.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.633+0000 7f950111e640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f94fc159170 con 0x7f94fc071470 2024-04-01T22:33:48.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.633+0000 7f950111e640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f94fc15b840 con 0x7f94fc0c8560 2024-04-01T22:33:48.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.634+0000 7f94fad9d640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f94fc071470 0x7f94fc158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:48.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.634+0000 7f94fa59c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f94fc0c8560 0x7f94fc151db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:48.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.634+0000 7f94fad9d640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f94fc071470 0x7f94fc158c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55314/0 (socket says 172.21.15.47:55314) 2024-04-01T22:33:48.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.634+0000 7f94fad9d640 1 -- 172.21.15.47:0/3635090002 learned_addr learned my addr 172.21.15.47:0/3635090002 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:48.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.636+0000 7f94fad9d640 1 -- 172.21.15.47:0/3635090002 >> v2:172.21.15.181:3300/0 conn(0x7f94fc0c8560 msgr2=0x7f94fc151db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:48.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.636+0000 7f94fad9d640 1 --2- 172.21.15.47:0/3635090002 >> v2:172.21.15.181:3300/0 conn(0x7f94fc0c8560 0x7f94fc151db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:48.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.636+0000 7f94fad9d640 1 -- 172.21.15.47:0/3635090002 >> v1:172.21.15.181:6789/0 conn(0x7f94fc071850 legacy=0x7f94fc0c2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:48.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.636+0000 7f94fad9d640 1 -- 172.21.15.47:0/3635090002 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94fc15bb20 con 0x7f94fc071470 2024-04-01T22:33:48.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.638+0000 7f94fad9d640 1 --2- 172.21.15.47:0/3635090002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94fc071470 0x7f94fc158c30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f94fc070180 tx=0x7f94f002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8d454beb4c1590e server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:48.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.642+0000 7f94f9d9b640 1 -- 172.21.15.47:0/3635090002 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f0034070 con 0x7f94fc071470 2024-04-01T22:33:48.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.642+0000 7f94f9d9b640 1 -- 172.21.15.47:0/3635090002 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94f0030860 con 0x7f94fc071470 2024-04-01T22:33:48.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.642+0000 7f94f9d9b640 1 -- 172.21.15.47:0/3635090002 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f0030c30 con 0x7f94fc071470 2024-04-01T22:33:48.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.643+0000 7f950111e640 1 -- 172.21.15.47:0/3635090002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94fc071470 msgr2=0x7f94fc158c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:48.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.643+0000 7f950111e640 1 --2- 172.21.15.47:0/3635090002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94fc071470 0x7f94fc158c30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f94fc070180 tx=0x7f94f002b9a0 comp rx=0 tx=0).stop 2024-04-01T22:33:48.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.643+0000 7f950111e640 1 -- 172.21.15.47:0/3635090002 shutdown_connections 2024-04-01T22:33:48.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.643+0000 7f950111e640 1 --2- 172.21.15.47:0/3635090002 >> v2:172.21.15.181:3300/0 conn(0x7f94fc0c8560 0x7f94fc151db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:48.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.643+0000 7f950111e640 1 --2- 172.21.15.47:0/3635090002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94fc071470 0x7f94fc158c30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:48.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.643+0000 7f950111e640 1 -- 172.21.15.47:0/3635090002 >> 172.21.15.47:0/3635090002 conn(0x7f94fc06b500 msgr2=0x7f94fc06f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:48.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.643+0000 7f950111e640 1 -- 172.21.15.47:0/3635090002 shutdown_connections 2024-04-01T22:33:48.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.643+0000 7f950111e640 1 -- 172.21.15.47:0/3635090002 wait complete. 2024-04-01T22:33:48.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.644+0000 7f950111e640 1 Processor -- start 2024-04-01T22:33:48.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.644+0000 7f950111e640 1 -- start start 2024-04-01T22:33:48.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.645+0000 7f950111e640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94fc071470 0x7f94fc1e3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:48.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.645+0000 7f950111e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94fc071850 0x7f94fc15a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:48.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.645+0000 7f950111e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94fc0c8560 0x7f94fc155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:48.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.645+0000 7f950111e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f94fc15c3c0 con 0x7f94fc0c8560 2024-04-01T22:33:48.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.645+0000 7f950111e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f94fc15c0e0 con 0x7f94fc071850 2024-04-01T22:33:48.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.645+0000 7f950111e640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f94fc0c3500 con 0x7f94fc071470 2024-04-01T22:33:48.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.645+0000 7f94fb59e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94fc0c8560 0x7f94fc155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:48.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.646+0000 7f94fa59c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94fc071850 0x7f94fc15a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:48.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.646+0000 7f94fad9d640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94fc071470 0x7f94fc1e3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:48.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.646+0000 7f94fa59c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94fc071850 0x7f94fc15a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:44192/0 (socket says 172.21.15.47:44192) 2024-04-01T22:33:48.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.646+0000 7f94fa59c640 1 -- 172.21.15.47:0/1889606784 learned_addr learned my addr 172.21.15.47:0/1889606784 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:48.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.649+0000 7f94fa59c640 1 -- 172.21.15.47:0/1889606784 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94fc071470 msgr2=0x7f94fc1e3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:48.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.649+0000 7f94fa59c640 1 --2- 172.21.15.47:0/1889606784 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94fc071470 0x7f94fc1e3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:48.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.649+0000 7f94fa59c640 1 -- 172.21.15.47:0/1889606784 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94fc0c8560 msgr2=0x7f94fc155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:48.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.649+0000 7f94fa59c640 1 --2- 172.21.15.47:0/1889606784 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94fc0c8560 0x7f94fc155d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:48.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.649+0000 7f94fa59c640 1 -- 172.21.15.47:0/1889606784 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94fc0b2930 con 0x7f94fc071850 2024-04-01T22:33:48.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.652+0000 7f94fa59c640 1 --2- 172.21.15.47:0/1889606784 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94fc071850 0x7f94fc15a840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f94ec00e870 tx=0x7f94ec00ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:48.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.656+0000 7f94e37fe640 1 -- 172.21.15.47:0/1889606784 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ec017070 con 0x7f94fc071850 2024-04-01T22:33:48.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.656+0000 7f94e37fe640 1 -- 172.21.15.47:0/1889606784 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94ec00c940 con 0x7f94fc071850 2024-04-01T22:33:48.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.656+0000 7f950111e640 1 -- 172.21.15.47:0/1889606784 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94fc0b0f80 con 0x7f94fc071850 2024-04-01T22:33:48.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.656+0000 7f94e37fe640 1 -- 172.21.15.47:0/1889606784 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ec00cd30 con 0x7f94fc071850 2024-04-01T22:33:48.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.656+0000 7f950111e640 1 -- 172.21.15.47:0/1889606784 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94fc0b2e80 con 0x7f94fc071850 2024-04-01T22:33:48.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.657+0000 7f950111e640 1 -- 172.21.15.47:0/1889606784 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94fc068920 con 0x7f94fc071850 2024-04-01T22:33:48.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.677+0000 7f94e37fe640 1 -- 172.21.15.47:0/1889606784 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f94ec01a070 con 0x7f94fc071850 2024-04-01T22:33:48.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.677+0000 7f94e37fe640 1 --2- 172.21.15.47:0/1889606784 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f94e806b990 0x7f94e806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:48.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.677+0000 7f94fad9d640 1 --2- 172.21.15.47:0/1889606784 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f94e806b990 0x7f94e806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:48.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.678+0000 7f94fad9d640 1 --2- 172.21.15.47:0/1889606784 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f94e806b990 0x7f94e806de50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f94f0036000 tx=0x7f94f0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:48.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.681+0000 7f94e37fe640 1 -- 172.21.15.47:0/1889606784 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f94ec057470 con 0x7f94fc071850 2024-04-01T22:33:48.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:48.920+0000 7f94e37fe640 1 -- 172.21.15.47:0/1889606784 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f94ec0593d0 con 0x7f94fc071850 2024-04-01T22:33:49.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.120+0000 7f950111e640 1 -- 172.21.15.47:0/1889606784 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f94fc0c8f60 con 0x7f94fc071850 2024-04-01T22:33:49.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.141+0000 7f94e37fe640 1 -- 172.21.15.47:0/1889606784 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f94ec05d470 con 0x7f94fc071850 2024-04-01T22:33:49.141 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-04-01T22:33:49.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.143+0000 7f950111e640 1 -- 172.21.15.47:0/1889606784 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f94e806b990 msgr2=0x7f94e806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:49.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.143+0000 7f950111e640 1 --2- 172.21.15.47:0/1889606784 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f94e806b990 0x7f94e806de50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f94f0036000 tx=0x7f94f0008030 comp rx=0 tx=0).stop 2024-04-01T22:33:49.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.143+0000 7f950111e640 1 -- 172.21.15.47:0/1889606784 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94fc071850 msgr2=0x7f94fc15a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:49.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.143+0000 7f950111e640 1 --2- 172.21.15.47:0/1889606784 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94fc071850 0x7f94fc15a840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f94ec00e870 tx=0x7f94ec00ed30 comp rx=0 tx=0).stop 2024-04-01T22:33:49.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.143+0000 7f950111e640 1 -- 172.21.15.47:0/1889606784 shutdown_connections 2024-04-01T22:33:49.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.143+0000 7f950111e640 1 --2- 172.21.15.47:0/1889606784 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f94e806b990 0x7f94e806de50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:49.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.143+0000 7f950111e640 1 --2- 172.21.15.47:0/1889606784 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94fc0c8560 0x7f94fc155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:49.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.143+0000 7f950111e640 1 --2- 172.21.15.47:0/1889606784 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94fc071850 0x7f94fc15a840 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:49.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.143+0000 7f950111e640 1 --2- 172.21.15.47:0/1889606784 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f94fc071470 0x7f94fc1e3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:49.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.143+0000 7f950111e640 1 -- 172.21.15.47:0/1889606784 >> 172.21.15.47:0/1889606784 conn(0x7f94fc06b500 msgr2=0x7f94fc151b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:49.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.143+0000 7f950111e640 1 -- 172.21.15.47:0/1889606784 shutdown_connections 2024-04-01T22:33:49.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.143+0000 7f950111e640 1 -- 172.21.15.47:0/1889606784 wait complete. 2024-04-01T22:33:49.155 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-01T22:33:49.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.260+0000 7f977bed4640 1 Processor -- start 2024-04-01T22:33:49.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.260+0000 7f977bed4640 1 -- start start 2024-04-01T22:33:49.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.261+0000 7f977bed4640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f97740cc7e0 0x7f977415afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:49.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.261+0000 7f977bed4640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97740cdae0 con 0x7f97740c93f0 2024-04-01T22:33:49.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.261+0000 7f977bed4640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97740c97d0 con 0x7f97740cee30 2024-04-01T22:33:49.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.261+0000 7f977bed4640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f977415b500 con 0x7f97740cc7e0 2024-04-01T22:33:49.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.262+0000 7f977a471640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f97740cc7e0 0x7f977415afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:49.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.262+0000 7f977946f640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f97740cee30 0x7f97740cc0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.47:55416/0 (socket says 172.21.15.47:55416) 2024-04-01T22:33:49.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.262+0000 7f977946f640 1 -- 172.21.15.47:0/21564112 learned_addr learned my addr 172.21.15.47:0/21564112 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T22:33:49.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.264+0000 7f977a471640 1 -- 172.21.15.47:0/21564112 >> v1:172.21.15.181:6789/0 conn(0x7f97740cee30 legacy=0x7f97740cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:49.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.264+0000 7f977a471640 1 -- 172.21.15.47:0/21564112 >> v1:172.21.15.47:6789/0 conn(0x7f97740c93f0 legacy=0x7f977406c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:49.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.264+0000 7f9778c6e640 1 -- 172.21.15.47:0/21564112 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 757355571 0 0) 0x7f97740c97d0 con 0x7f97740cee30 2024-04-01T22:33:49.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.264+0000 7f977a471640 1 -- 172.21.15.47:0/21564112 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97740cdd80 con 0x7f97740cc7e0 2024-04-01T22:33:49.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.266+0000 7f977a471640 1 --2- 172.21.15.47:0/21564112 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f97740cc7e0 0x7f977415afc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f976c009dc0 tx=0x7f976c02be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7512575339feb8f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:49.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.269+0000 7f9778c6e640 1 -- 172.21.15.47:0/21564112 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f976c039070 con 0x7f97740cc7e0 2024-04-01T22:33:49.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.269+0000 7f9778c6e640 1 -- 172.21.15.47:0/21564112 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f976c02cc40 con 0x7f97740cc7e0 2024-04-01T22:33:49.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.269+0000 7f9778c6e640 1 -- 172.21.15.47:0/21564112 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f976c034440 con 0x7f97740cc7e0 2024-04-01T22:33:49.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.270+0000 7f977bed4640 1 -- 172.21.15.47:0/21564112 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f97740cc7e0 msgr2=0x7f977415afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:49.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.270+0000 7f977bed4640 1 --2- 172.21.15.47:0/21564112 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f97740cc7e0 0x7f977415afc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f976c009dc0 tx=0x7f976c02be90 comp rx=0 tx=0).stop 2024-04-01T22:33:49.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.270+0000 7f977bed4640 1 -- 172.21.15.47:0/21564112 shutdown_connections 2024-04-01T22:33:49.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.270+0000 7f977bed4640 1 --2- 172.21.15.47:0/21564112 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f97740cc7e0 0x7f977415afc0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:49.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.270+0000 7f977bed4640 1 -- 172.21.15.47:0/21564112 >> 172.21.15.47:0/21564112 conn(0x7f97740cfdb0 msgr2=0x7f97740d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:49.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.270+0000 7f977bed4640 1 -- 172.21.15.47:0/21564112 shutdown_connections 2024-04-01T22:33:49.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.270+0000 7f977bed4640 1 -- 172.21.15.47:0/21564112 wait complete. 2024-04-01T22:33:49.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.271+0000 7f977bed4640 1 Processor -- start 2024-04-01T22:33:49.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.271+0000 7f977bed4640 1 -- start start 2024-04-01T22:33:49.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.272+0000 7f977bed4640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f97740c93f0 0x7f97740b4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:49.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.272+0000 7f977bed4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97740cc7e0 0x7f977414bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:49.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.272+0000 7f977bed4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97740cee30 0x7f977414caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:49.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.272+0000 7f977bed4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f97740ce620 con 0x7f97740cc7e0 2024-04-01T22:33:49.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.272+0000 7f977bed4640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f97740ce340 con 0x7f97740cee30 2024-04-01T22:33:49.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.272+0000 7f977bed4640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f97740cf430 con 0x7f97740c93f0 2024-04-01T22:33:49.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.273+0000 7f977946f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97740cc7e0 0x7f977414bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:49.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.273+0000 7f9779c70640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f97740c93f0 0x7f97740b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:49.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.273+0000 7f977a471640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97740cee30 0x7f977414caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:49.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.273+0000 7f9779c70640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f97740c93f0 0x7f97740b4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:58812/0 (socket says 172.21.15.47:58812) 2024-04-01T22:33:49.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.273+0000 7f9779c70640 1 -- 172.21.15.47:0/2088944532 learned_addr learned my addr 172.21.15.47:0/2088944532 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:49.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.276+0000 7f9779c70640 1 -- 172.21.15.47:0/2088944532 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97740cee30 msgr2=0x7f977414caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:49.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.276+0000 7f9779c70640 1 --2- 172.21.15.47:0/2088944532 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97740cee30 0x7f977414caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:49.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.276+0000 7f9779c70640 1 -- 172.21.15.47:0/2088944532 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97740cc7e0 msgr2=0x7f977414bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:49.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.276+0000 7f9779c70640 1 --2- 172.21.15.47:0/2088944532 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97740cc7e0 0x7f977414bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:49.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.276+0000 7f9779c70640 1 -- 172.21.15.47:0/2088944532 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97741f0af0 con 0x7f97740c93f0 2024-04-01T22:33:49.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.278+0000 7f9779c70640 1 --2- 172.21.15.47:0/2088944532 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f97740c93f0 0x7f97740b4040 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f977000c400 tx=0x7f977000c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:49.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.282+0000 7f976a7fc640 1 -- 172.21.15.47:0/2088944532 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97700052d0 con 0x7f97740c93f0 2024-04-01T22:33:49.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.282+0000 7f976a7fc640 1 -- 172.21.15.47:0/2088944532 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9770005490 con 0x7f97740c93f0 2024-04-01T22:33:49.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.282+0000 7f977bed4640 1 -- 172.21.15.47:0/2088944532 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97741f0dd0 con 0x7f97740c93f0 2024-04-01T22:33:49.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.282+0000 7f976a7fc640 1 -- 172.21.15.47:0/2088944532 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9770007260 con 0x7f97740c93f0 2024-04-01T22:33:49.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.282+0000 7f977bed4640 1 -- 172.21.15.47:0/2088944532 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f97740b3560 con 0x7f97740c93f0 2024-04-01T22:33:49.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.283+0000 7f977bed4640 1 -- 172.21.15.47:0/2088944532 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9774068210 con 0x7f97740c93f0 2024-04-01T22:33:49.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.302+0000 7f976a7fc640 1 -- 172.21.15.47:0/2088944532 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f9770007400 con 0x7f97740c93f0 2024-04-01T22:33:49.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.303+0000 7f976a7fc640 1 --2- 172.21.15.47:0/2088944532 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f975806b9e0 0x7f975806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:49.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.303+0000 7f977946f640 1 --2- 172.21.15.47:0/2088944532 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f975806b9e0 0x7f975806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:49.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.303+0000 7f977946f640 1 --2- 172.21.15.47:0/2088944532 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f975806b9e0 0x7f975806dea0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f977406cb30 tx=0x7f9764007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:49.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.305+0000 7f976a7fc640 1 -- 172.21.15.47:0/2088944532 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9770056b90 con 0x7f97740c93f0 2024-04-01T22:33:49.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.539+0000 7f976a7fc640 1 -- 172.21.15.47:0/2088944532 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f9770020070 con 0x7f97740c93f0 2024-04-01T22:33:49.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.729+0000 7f977bed4640 1 -- 172.21.15.47:0/2088944532 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f977406cf00 con 0x7f97740c93f0 2024-04-01T22:33:49.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.734+0000 7f976a7fc640 1 -- 172.21.15.47:0/2088944532 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f9770058af0 con 0x7f97740c93f0 2024-04-01T22:33:49.734 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-01T22:33:49.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.736+0000 7f977bed4640 1 -- 172.21.15.47:0/2088944532 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f975806b9e0 msgr2=0x7f975806dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:49.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.736+0000 7f977bed4640 1 --2- 172.21.15.47:0/2088944532 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f975806b9e0 0x7f975806dea0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f977406cb30 tx=0x7f9764007de0 comp rx=0 tx=0).stop 2024-04-01T22:33:49.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.736+0000 7f977bed4640 1 -- 172.21.15.47:0/2088944532 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f97740c93f0 msgr2=0x7f97740b4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:49.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.736+0000 7f977bed4640 1 --2- 172.21.15.47:0/2088944532 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f97740c93f0 0x7f97740b4040 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f977000c400 tx=0x7f977000c8c0 comp rx=0 tx=0).stop 2024-04-01T22:33:49.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.736+0000 7f977bed4640 1 -- 172.21.15.47:0/2088944532 shutdown_connections 2024-04-01T22:33:49.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.736+0000 7f977bed4640 1 --2- 172.21.15.47:0/2088944532 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f975806b9e0 0x7f975806dea0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:49.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.736+0000 7f977bed4640 1 --2- 172.21.15.47:0/2088944532 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97740cee30 0x7f977414caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:49.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.736+0000 7f977bed4640 1 --2- 172.21.15.47:0/2088944532 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97740cc7e0 0x7f977414bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:49.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.736+0000 7f977bed4640 1 --2- 172.21.15.47:0/2088944532 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f97740c93f0 0x7f97740b4040 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:49.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.736+0000 7f977bed4640 1 -- 172.21.15.47:0/2088944532 >> 172.21.15.47:0/2088944532 conn(0x7f97740cfdb0 msgr2=0x7f97740c7ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:49.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.736+0000 7f977bed4640 1 -- 172.21.15.47:0/2088944532 shutdown_connections 2024-04-01T22:33:49.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.736+0000 7f977bed4640 1 -- 172.21.15.47:0/2088944532 wait complete. 2024-04-01T22:33:49.748 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-01T22:33:49.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.851+0000 7fa13fd6c640 1 Processor -- start 2024-04-01T22:33:49.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.851+0000 7fa13fd6c640 1 -- start start 2024-04-01T22:33:49.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.852+0000 7fa13fd6c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa138152210 0x7fa1380c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:49.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.852+0000 7fa13fd6c640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1381585a0 con 0x7fa1380cac90 2024-04-01T22:33:49.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.852+0000 7fa13fd6c640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa138158880 con 0x7fa1380c8ce0 2024-04-01T22:33:49.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.852+0000 7fa13fd6c640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fa138158b60 con 0x7fa138152210 2024-04-01T22:33:49.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.852+0000 7fa13db08640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa138152210 0x7fa1380c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:49.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.853+0000 7fa13d307640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fa1380c8ce0 0x7fa1380ca580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.47:44606/0 (socket says 172.21.15.47:44606) 2024-04-01T22:33:49.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.853+0000 7fa13d307640 1 -- 172.21.15.47:0/1370167244 learned_addr learned my addr 172.21.15.47:0/1370167244 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T22:33:49.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.855+0000 7fa13cb06640 1 -- 172.21.15.47:0/1370167244 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 29687894 0 0) 0x7fa138158880 con 0x7fa1380c8ce0 2024-04-01T22:33:49.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.855+0000 7fa13cb06640 1 -- 172.21.15.47:0/1370167244 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa124003520 con 0x7fa1380c8ce0 2024-04-01T22:33:49.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.857+0000 7fa13db08640 1 -- 172.21.15.47:0/1370167244 >> v1:172.21.15.181:6789/0 conn(0x7fa1380c8ce0 legacy=0x7fa1380ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:49.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.857+0000 7fa13db08640 1 -- 172.21.15.47:0/1370167244 >> v1:172.21.15.47:6789/0 conn(0x7fa1380cac90 legacy=0x7fa13815bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:49.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.857+0000 7fa13db08640 1 -- 172.21.15.47:0/1370167244 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa138158e40 con 0x7fa138152210 2024-04-01T22:33:49.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.862+0000 7fa13db08640 1 --2- 172.21.15.47:0/1370167244 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa138152210 0x7fa1380c87a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa1340097a0 tx=0x7fa13402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4394b43821360c1b server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:49.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.867+0000 7fa13cb06640 1 -- 172.21.15.47:0/1370167244 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa134034070 con 0x7fa138152210 2024-04-01T22:33:49.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.867+0000 7fa13cb06640 1 -- 172.21.15.47:0/1370167244 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa134030610 con 0x7fa138152210 2024-04-01T22:33:49.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.867+0000 7fa13cb06640 1 -- 172.21.15.47:0/1370167244 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1340309e0 con 0x7fa138152210 2024-04-01T22:33:49.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.867+0000 7fa13fd6c640 1 -- 172.21.15.47:0/1370167244 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa138152210 msgr2=0x7fa1380c87a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:49.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.867+0000 7fa13fd6c640 1 --2- 172.21.15.47:0/1370167244 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa138152210 0x7fa1380c87a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa1340097a0 tx=0x7fa13402b960 comp rx=0 tx=0).stop 2024-04-01T22:33:49.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.867+0000 7fa13fd6c640 1 -- 172.21.15.47:0/1370167244 shutdown_connections 2024-04-01T22:33:49.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.867+0000 7fa13fd6c640 1 --2- 172.21.15.47:0/1370167244 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa138152210 0x7fa1380c87a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:49.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.867+0000 7fa13fd6c640 1 -- 172.21.15.47:0/1370167244 >> 172.21.15.47:0/1370167244 conn(0x7fa138071310 msgr2=0x7fa138071720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:49.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.867+0000 7fa13fd6c640 1 -- 172.21.15.47:0/1370167244 shutdown_connections 2024-04-01T22:33:49.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.867+0000 7fa13fd6c640 1 -- 172.21.15.47:0/1370167244 wait complete. 2024-04-01T22:33:49.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.869+0000 7fa13fd6c640 1 Processor -- start 2024-04-01T22:33:49.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.869+0000 7fa13fd6c640 1 -- start start 2024-04-01T22:33:49.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.869+0000 7fa13fd6c640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa1380c8ce0 0x7fa13814e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:49.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.869+0000 7fa13fd6c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1380cac90 0x7fa1380cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:49.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.869+0000 7fa13fd6c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa138152210 0x7fa1381536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:49.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.869+0000 7fa13fd6c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa1380ca250 con 0x7fa138152210 2024-04-01T22:33:49.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.869+0000 7fa13fd6c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa13815b860 con 0x7fa1380cac90 2024-04-01T22:33:49.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.869+0000 7fa13fd6c640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fa138158270 con 0x7fa1380c8ce0 2024-04-01T22:33:49.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.870+0000 7fa13e309640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa138152210 0x7fa1381536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:49.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.870+0000 7fa13d307640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1380cac90 0x7fa1380cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:49.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.870+0000 7fa13db08640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa1380c8ce0 0x7fa13814e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:49.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.870+0000 7fa13db08640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa1380c8ce0 0x7fa13814e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:33218/0 (socket says 172.21.15.47:33218) 2024-04-01T22:33:49.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.870+0000 7fa13db08640 1 -- 172.21.15.47:0/612518598 learned_addr learned my addr 172.21.15.47:0/612518598 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:49.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.874+0000 7fa13db08640 1 -- 172.21.15.47:0/612518598 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1380cac90 msgr2=0x7fa1380cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:49.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.874+0000 7fa13db08640 1 --2- 172.21.15.47:0/612518598 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1380cac90 0x7fa1380cdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:49.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.874+0000 7fa13db08640 1 -- 172.21.15.47:0/612518598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa138152210 msgr2=0x7fa1381536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:49.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.874+0000 7fa13db08640 1 --2- 172.21.15.47:0/612518598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa138152210 0x7fa1381536a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:49.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.874+0000 7fa13db08640 1 -- 172.21.15.47:0/612518598 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa138152c00 con 0x7fa1380c8ce0 2024-04-01T22:33:49.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.876+0000 7fa13db08640 1 --2- 172.21.15.47:0/612518598 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa1380c8ce0 0x7fa13814e730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa134000c00 tx=0x7fa1340046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:49.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.879+0000 7fa12e7fc640 1 -- 172.21.15.47:0/612518598 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa134034040 con 0x7fa1380c8ce0 2024-04-01T22:33:49.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.880+0000 7fa12e7fc640 1 -- 172.21.15.47:0/612518598 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa13403aaa0 con 0x7fa1380c8ce0 2024-04-01T22:33:49.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.880+0000 7fa13fd6c640 1 -- 172.21.15.47:0/612518598 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1381553a0 con 0x7fa1380c8ce0 2024-04-01T22:33:49.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.880+0000 7fa12e7fc640 1 -- 172.21.15.47:0/612518598 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1340443f0 con 0x7fa1380c8ce0 2024-04-01T22:33:49.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.880+0000 7fa13fd6c640 1 -- 172.21.15.47:0/612518598 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa138155960 con 0x7fa1380c8ce0 2024-04-01T22:33:49.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:49.880+0000 7fa13fd6c640 1 -- 172.21.15.47:0/612518598 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1381525f0 con 0x7fa1380c8ce0 2024-04-01T22:33:50.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:50.123+0000 7fa12e7fc640 1 -- 172.21.15.47:0/612518598 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7fa13404b060 con 0x7fa1380c8ce0 2024-04-01T22:33:50.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:50.123+0000 7fa12e7fc640 1 --2- 172.21.15.47:0/612518598 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fa11c06ba10 0x7fa11c06ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:50.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:50.123+0000 7fa13d307640 1 --2- 172.21.15.47:0/612518598 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fa11c06ba10 0x7fa11c06ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:50.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:50.124+0000 7fa13d307640 1 --2- 172.21.15.47:0/612518598 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fa11c06ba10 0x7fa11c06ded0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa1381eeb60 tx=0x7fa128007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:50.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:50.126+0000 7fa12e7fc640 1 -- 172.21.15.47:0/612518598 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa1340792e0 con 0x7fa1380c8ce0 2024-04-01T22:33:50.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:50.136+0000 7fa12e7fc640 1 -- 172.21.15.47:0/612518598 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fa1381525f0 con 0x7fa1380c8ce0 2024-04-01T22:33:50.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:50.331+0000 7fa13fd6c640 1 -- 172.21.15.47:0/612518598 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa138068210 con 0x7fa1380c8ce0 2024-04-01T22:33:50.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:50.338+0000 7fa12e7fc640 1 -- 172.21.15.47:0/612518598 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7fa13403f070 con 0x7fa1380c8ce0 2024-04-01T22:33:50.337 INFO:teuthology.orchestra.run.smithi047.stderr:listed 0 entries 2024-04-01T22:33:50.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:50.341+0000 7fa13fd6c640 1 -- 172.21.15.47:0/612518598 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fa11c06ba10 msgr2=0x7fa11c06ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:50.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:50.341+0000 7fa13fd6c640 1 --2- 172.21.15.47:0/612518598 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fa11c06ba10 0x7fa11c06ded0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa1381eeb60 tx=0x7fa128007d30 comp rx=0 tx=0).stop 2024-04-01T22:33:50.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:50.341+0000 7fa13fd6c640 1 -- 172.21.15.47:0/612518598 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa1380c8ce0 msgr2=0x7fa13814e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:50.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:50.341+0000 7fa13fd6c640 1 --2- 172.21.15.47:0/612518598 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa1380c8ce0 0x7fa13814e730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa134000c00 tx=0x7fa1340046c0 comp rx=0 tx=0).stop 2024-04-01T22:33:50.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:50.341+0000 7fa13fd6c640 1 -- 172.21.15.47:0/612518598 shutdown_connections 2024-04-01T22:33:50.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:50.341+0000 7fa13fd6c640 1 --2- 172.21.15.47:0/612518598 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fa11c06ba10 0x7fa11c06ded0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:50.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:50.341+0000 7fa13fd6c640 1 --2- 172.21.15.47:0/612518598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa138152210 0x7fa1381536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:50.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:50.341+0000 7fa13fd6c640 1 --2- 172.21.15.47:0/612518598 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1380cac90 0x7fa1380cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:50.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:50.341+0000 7fa13fd6c640 1 --2- 172.21.15.47:0/612518598 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa1380c8ce0 0x7fa13814e730 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:50.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:50.341+0000 7fa13fd6c640 1 -- 172.21.15.47:0/612518598 >> 172.21.15.47:0/612518598 conn(0x7fa138071310 msgr2=0x7fa138151810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:50.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:50.341+0000 7fa13fd6c640 1 -- 172.21.15.47:0/612518598 shutdown_connections 2024-04-01T22:33:50.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:50.341+0000 7fa13fd6c640 1 -- 172.21.15.47:0/612518598 wait complete. 2024-04-01T22:33:50.351 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi047.front.sepia.ceph.com... 2024-04-01T22:33:50.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T22:33:50.351 DEBUG:teuthology.orchestra.run.smithi047:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-01T22:33:50.376 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi047.stderr:ceph-fuse[42476]: fuse finished with error 0 and tester_r 0 2024-04-01T22:33:50.378 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T22:33:56.479 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi047.front.sepia.ceph.com 2024-04-01T22:33:56.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T22:33:56.480 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-01T22:33:56.498 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T22:33:56.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.641+0000 7f020477a640 1 Processor -- start 2024-04-01T22:33:56.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.642+0000 7f020477a640 1 -- start start 2024-04-01T22:33:56.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.642+0000 7f020477a640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f01fc06c250 0x7f01fc15aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:56.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.642+0000 7f020477a640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f01fc06c630 0x7f01fc0ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:56.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.642+0000 7f020477a640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01fc154b70 con 0x7f01fc0cf0d0 2024-04-01T22:33:56.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.642+0000 7f020477a640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f01fc0ce990 con 0x7f01fc06c250 2024-04-01T22:33:56.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.642+0000 7f020477a640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f01fc0cdac0 con 0x7f01fc06c630 2024-04-01T22:33:56.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.643+0000 7f0202516640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f01fc06c250 0x7f01fc15aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:56.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.643+0000 7f0201d15640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f01fc06c630 0x7f01fc0ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:56.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.643+0000 7f0202516640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f01fc06c250 0x7f01fc15aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49320/0 (socket says 172.21.15.47:49320) 2024-04-01T22:33:56.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.643+0000 7f0202516640 1 -- 172.21.15.47:0/3921790938 learned_addr learned my addr 172.21.15.47:0/3921790938 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:56.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.646+0000 7f0202516640 1 -- 172.21.15.47:0/3921790938 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f01fc06c630 msgr2=0x7f01fc0ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:56.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.646+0000 7f0202516640 1 --2- 172.21.15.47:0/3921790938 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f01fc06c630 0x7f01fc0ceb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:56.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.646+0000 7f0202516640 1 -- 172.21.15.47:0/3921790938 >> v1:172.21.15.47:6789/0 conn(0x7f01fc0cf0d0 legacy=0x7f01fc15bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:56.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.646+0000 7f0202516640 1 -- 172.21.15.47:0/3921790938 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01fc0cdd80 con 0x7f01fc06c250 2024-04-01T22:33:56.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.648+0000 7f0202516640 1 --2- 172.21.15.47:0/3921790938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01fc06c250 0x7f01fc15aec0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f01f8009870 tx=0x7f01f802ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bffacb4cd489fd5f server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:56.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.656+0000 7f0201514640 1 -- 172.21.15.47:0/3921790938 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f802f840 con 0x7f01fc06c250 2024-04-01T22:33:56.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.656+0000 7f0201514640 1 -- 172.21.15.47:0/3921790938 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01f802f9e0 con 0x7f01fc06c250 2024-04-01T22:33:56.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.656+0000 7f0201514640 1 -- 172.21.15.47:0/3921790938 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f802fdb0 con 0x7f01fc06c250 2024-04-01T22:33:56.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.656+0000 7f020477a640 1 -- 172.21.15.47:0/3921790938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01fc06c250 msgr2=0x7f01fc15aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:56.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.657+0000 7f020477a640 1 --2- 172.21.15.47:0/3921790938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01fc06c250 0x7f01fc15aec0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f01f8009870 tx=0x7f01f802ba20 comp rx=0 tx=0).stop 2024-04-01T22:33:56.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.657+0000 7f020477a640 1 -- 172.21.15.47:0/3921790938 shutdown_connections 2024-04-01T22:33:56.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.657+0000 7f020477a640 1 --2- 172.21.15.47:0/3921790938 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f01fc06c630 0x7f01fc0ceb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:56.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.657+0000 7f020477a640 1 --2- 172.21.15.47:0/3921790938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01fc06c250 0x7f01fc15aec0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:56.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.657+0000 7f020477a640 1 -- 172.21.15.47:0/3921790938 >> 172.21.15.47:0/3921790938 conn(0x7f01fc0cfdb0 msgr2=0x7f01fc0d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:56.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.657+0000 7f020477a640 1 -- 172.21.15.47:0/3921790938 shutdown_connections 2024-04-01T22:33:56.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.657+0000 7f020477a640 1 -- 172.21.15.47:0/3921790938 wait complete. 2024-04-01T22:33:56.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.658+0000 7f020477a640 1 Processor -- start 2024-04-01T22:33:56.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.658+0000 7f020477a640 1 -- start start 2024-04-01T22:33:56.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.659+0000 7f020477a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01fc06c250 0x7f01fc152e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:56.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.659+0000 7f020477a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f01fc06c630 0x7f01fc1f39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:56.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.659+0000 7f020477a640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f01fc1f3f10 0x7f01fc151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:56.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.659+0000 7f020477a640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f01fc0ce620 con 0x7f01fc06c250 2024-04-01T22:33:56.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.659+0000 7f020477a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f01fc0ce340 con 0x7f01fc06c630 2024-04-01T22:33:56.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.659+0000 7f020477a640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f01fc06ca30 con 0x7f01fc1f3f10 2024-04-01T22:33:56.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.659+0000 7f0202516640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01fc06c250 0x7f01fc152e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:56.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.660+0000 7f0202516640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01fc06c250 0x7f01fc152e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49322/0 (socket says 172.21.15.47:49322) 2024-04-01T22:33:56.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.660+0000 7f0202516640 1 -- 172.21.15.47:0/47750627 learned_addr learned my addr 172.21.15.47:0/47750627 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:56.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.660+0000 7f0201d15640 1 --2- 172.21.15.47:0/47750627 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f01fc06c630 0x7f01fc1f39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:56.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.660+0000 7f0202d17640 1 --2- 172.21.15.47:0/47750627 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f01fc1f3f10 0x7f01fc151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:56.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.663+0000 7f0202516640 1 -- 172.21.15.47:0/47750627 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f01fc1f3f10 msgr2=0x7f01fc151e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:56.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.663+0000 7f0202516640 1 --2- 172.21.15.47:0/47750627 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f01fc1f3f10 0x7f01fc151e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:56.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.663+0000 7f0202516640 1 -- 172.21.15.47:0/47750627 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f01fc06c630 msgr2=0x7f01fc1f39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:56.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.663+0000 7f0202516640 1 --2- 172.21.15.47:0/47750627 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f01fc06c630 0x7f01fc1f39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:56.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.663+0000 7f0202516640 1 -- 172.21.15.47:0/47750627 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01fc1f1380 con 0x7f01fc06c250 2024-04-01T22:33:56.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.665+0000 7f0202516640 1 --2- 172.21.15.47:0/47750627 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01fc06c250 0x7f01fc152e40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f01f8000c00 tx=0x7f01f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:56.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.667+0000 7f01f2ffd640 1 -- 172.21.15.47:0/47750627 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f8037c40 con 0x7f01fc06c250 2024-04-01T22:33:56.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.667+0000 7f020477a640 1 -- 172.21.15.47:0/47750627 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01fc0b0c10 con 0x7f01fc06c250 2024-04-01T22:33:56.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.667+0000 7f020477a640 1 -- 172.21.15.47:0/47750627 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01fc1f08a0 con 0x7f01fc06c250 2024-04-01T22:33:56.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.668+0000 7f020477a640 1 -- 172.21.15.47:0/47750627 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01fc068210 con 0x7f01fc06c250 2024-04-01T22:33:56.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.872+0000 7f01f2ffd640 1 -- 172.21.15.47:0/47750627 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01f8047070 con 0x7f01fc06c250 2024-04-01T22:33:56.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.942+0000 7f01f2ffd640 1 -- 172.21.15.47:0/47750627 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f802f940 con 0x7f01fc06c250 2024-04-01T22:33:56.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.942+0000 7f01f2ffd640 1 -- 172.21.15.47:0/47750627 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f01f8040050 con 0x7f01fc06c250 2024-04-01T22:33:56.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.943+0000 7f01f2ffd640 1 --2- 172.21.15.47:0/47750627 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f01e006b990 0x7f01e006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:56.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.943+0000 7f0201d15640 1 --2- 172.21.15.47:0/47750627 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f01e006b990 0x7f01e006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:56.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.943+0000 7f0201d15640 1 --2- 172.21.15.47:0/47750627 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f01e006b990 0x7f01e006de50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f01fc153680 tx=0x7f01ec009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:56.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.959+0000 7f01f2ffd640 1 -- 172.21.15.47:0/47750627 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f01f807a390 con 0x7f01fc06c250 2024-04-01T22:33:56.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:56.959+0000 7f01f2ffd640 1 -- 172.21.15.47:0/47750627 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f01f8033030 con 0x7f01fc06c250 2024-04-01T22:33:57.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.209+0000 7f020477a640 1 -- 172.21.15.47:0/47750627 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f01fc0b5b50 con 0x7f01fc06c250 2024-04-01T22:33:57.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.268+0000 7f01f2ffd640 1 -- 172.21.15.47:0/47750627 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18526 (secure 0 0 0) 0x7f01f807c2f0 con 0x7f01fc06c250 2024-04-01T22:33:57.269 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:33:57.269 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"fsid":"a6998a48-38bc-4e42-b0d9-04f2fb5c3c87","created":"2024-04-01T22:32:57.112033+0000","modified":"2024-04-01T22:33:33.448062+0000","last_up_change":"2024-04-01T22:33:11.141073+0000","last_in_change":"2024-04-01T22:33:02.650459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T22:33:13.356568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T22:33:25.309421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T22:33:26.268050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-01T22:33:30.588103+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7bd3f25d-e3a5-4932-b381-53dcbb464dde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6811","nonce":3827395709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6813","nonce":3827395709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6817","nonce":3827395709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6815","nonce":3827395709}]},"public_addr":"172.21.15.47:6811/3827395709","cluster_addr":"172.21.15.47:6813/3827395709","heartbeat_back_addr":"172.21.15.47:6817/3827395709","heartbeat_front_addr":"172.21.15.47:6815/3827395709","state":["exists","up"]},{"osd":1,"uuid":"2aa60ba2-67ff-43c7-96c4-82ae2f3855ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6827","nonce":3152157503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6829","nonce":3152157503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6833","nonce":3152157503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6831","nonce":3152157503}]},"public_addr":"172.21.15.47:6827/3152157503","cluster_addr":"172.21.15.47:6829/3152157503","heartbeat_back_addr":"172.21.15.47:6833/3152157503","heartbeat_front_addr":"172.21.15.47:6831/3152157503","state":["exists","up"]},{"osd":2,"uuid":"d83f8a98-6db8-42b7-9ef6-5b16eb9a3492","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6803","nonce":1003968856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6805","nonce":1003968856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6809","nonce":1003968856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6807","nonce":1003968856}]},"public_addr":"172.21.15.47:6803/1003968856","cluster_addr":"172.21.15.47:6805/1003968856","heartbeat_back_addr":"172.21.15.47:6809/1003968856","heartbeat_front_addr":"172.21.15.47:6807/1003968856","state":["exists","up"]},{"osd":3,"uuid":"edc02ed5-d25c-4dc9-a0c3-7a26f20fae07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6819","nonce":2845699561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6821","nonce":2845699561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6825","nonce":2845699561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6823","nonce":2845699561}]},"public_addr":"172.21.15.47:6819/2845699561","cluster_addr":"172.21.15.47:6821/2845699561","heartbeat_back_addr":"172.21.15.47:6825/2845699561","heartbeat_front_addr":"172.21.15.47:6823/2845699561","state":["exists","up"]},{"osd":4,"uuid":"b3d67e74-f51e-4474-9c62-dd0daa60c728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6809","nonce":2961538461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6811","nonce":2961538461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6815","nonce":2961538461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6813","nonce":2961538461}]},"public_addr":"172.21.15.181:6809/2961538461","cluster_addr":"172.21.15.181:6811/2961538461","heartbeat_back_addr":"172.21.15.181:6815/2961538461","heartbeat_front_addr":"172.21.15.181:6813/2961538461","state":["exists","up"]},{"osd":5,"uuid":"d86e8f7a-99f4-4457-9949-cf2cb853e79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6817","nonce":2161566540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6819","nonce":2161566540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6823","nonce":2161566540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6821","nonce":2161566540}]},"public_addr":"172.21.15.181:6817/2161566540","cluster_addr":"172.21.15.181:6819/2161566540","heartbeat_back_addr":"172.21.15.181:6823/2161566540","heartbeat_front_addr":"172.21.15.181:6821/2161566540","state":["exists","up"]},{"osd":6,"uuid":"aa08266c-1719-4abd-afb9-e7e8ac593658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6801","nonce":3792144865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6803","nonce":3792144865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6807","nonce":3792144865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6805","nonce":3792144865}]},"public_addr":"172.21.15.181:6801/3792144865","cluster_addr":"172.21.15.181:6803/3792144865","heartbeat_back_addr":"172.21.15.181:6807/3792144865","heartbeat_front_addr":"172.21.15.181:6805/3792144865","state":["exists","up"]},{"osd":7,"uuid":"6e509762-24c8-46c3-93a1-4c50b11ebcf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6825","nonce":1760995885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6827","nonce":1760995885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6831","nonce":1760995885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6829","nonce":1760995885}]},"public_addr":"172.21.15.181:6825/1760995885","cluster_addr":"172.21.15.181:6827/1760995885","heartbeat_back_addr":"172.21.15.181:6831/1760995885","heartbeat_front_addr":"172.21.15.181:6829/1760995885","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.202426+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.255318+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.170288+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.290065+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.214871+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.176432+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.139940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.299546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T22:33:57.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.270+0000 7f020477a640 1 -- 172.21.15.47:0/47750627 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f01e006b990 msgr2=0x7f01e006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:57.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.270+0000 7f020477a640 1 --2- 172.21.15.47:0/47750627 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f01e006b990 0x7f01e006de50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f01fc153680 tx=0x7f01ec009190 comp rx=0 tx=0).stop 2024-04-01T22:33:57.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.270+0000 7f020477a640 1 -- 172.21.15.47:0/47750627 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01fc06c250 msgr2=0x7f01fc152e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:57.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.270+0000 7f020477a640 1 --2- 172.21.15.47:0/47750627 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01fc06c250 0x7f01fc152e40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f01f8000c00 tx=0x7f01f80046c0 comp rx=0 tx=0).stop 2024-04-01T22:33:57.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.270+0000 7f020477a640 1 -- 172.21.15.47:0/47750627 shutdown_connections 2024-04-01T22:33:57.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.270+0000 7f020477a640 1 --2- 172.21.15.47:0/47750627 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f01e006b990 0x7f01e006de50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:57.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.270+0000 7f020477a640 1 --2- 172.21.15.47:0/47750627 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f01fc1f3f10 0x7f01fc151e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:57.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.270+0000 7f020477a640 1 --2- 172.21.15.47:0/47750627 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f01fc06c630 0x7f01fc1f39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:57.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.270+0000 7f020477a640 1 --2- 172.21.15.47:0/47750627 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01fc06c250 0x7f01fc152e40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:57.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.270+0000 7f020477a640 1 -- 172.21.15.47:0/47750627 >> 172.21.15.47:0/47750627 conn(0x7f01fc0cfdb0 msgr2=0x7f01fc0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:57.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.270+0000 7f020477a640 1 -- 172.21.15.47:0/47750627 shutdown_connections 2024-04-01T22:33:57.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.270+0000 7f020477a640 1 -- 172.21.15.47:0/47750627 wait complete. 2024-04-01T22:33:57.283 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T22:33:57.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.384+0000 7fae07547640 1 Processor -- start 2024-04-01T22:33:57.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.385+0000 7fae07547640 1 -- start start 2024-04-01T22:33:57.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.385+0000 7fae07547640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fae0015c230 0x7fae0006c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:57.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.385+0000 7fae07547640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae00154b70 con 0x7fae0006c250 2024-04-01T22:33:57.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.385+0000 7fae07547640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae000cdac0 con 0x7fae0015aec0 2024-04-01T22:33:57.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.385+0000 7fae07547640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fae000ce990 con 0x7fae0015c230 2024-04-01T22:33:57.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.386+0000 7fae052e3640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fae0006c250 0x7fae000ceb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:46016/0 (socket says 172.21.15.47:46016) 2024-04-01T22:33:57.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.386+0000 7fae052e3640 1 -- 172.21.15.47:0/3666823290 learned_addr learned my addr 172.21.15.47:0/3666823290 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T22:33:57.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.386+0000 7fae05ae4640 1 --2- 172.21.15.47:0/3666823290 >> v2:172.21.15.181:3300/0 conn(0x7fae0015c230 0x7fae0006c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:57.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.389+0000 7fadf7fff640 1 -- 172.21.15.47:0/3666823290 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4281711443 0 0) 0x7fae00154b70 con 0x7fae0006c250 2024-04-01T22:33:57.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.389+0000 7fadf7fff640 1 -- 172.21.15.47:0/3666823290 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadec003520 con 0x7fae0006c250 2024-04-01T22:33:57.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.390+0000 7fae05ae4640 1 -- 172.21.15.47:0/3666823290 >> v1:172.21.15.181:6789/0 conn(0x7fae0015aec0 legacy=0x7fae0015bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:57.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.390+0000 7fae05ae4640 1 -- 172.21.15.47:0/3666823290 >> v1:172.21.15.47:6789/0 conn(0x7fae0006c250 legacy=0x7fae000ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:57.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.390+0000 7fae05ae4640 1 -- 172.21.15.47:0/3666823290 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae000cf2a0 con 0x7fae0015c230 2024-04-01T22:33:57.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.393+0000 7fae05ae4640 1 --2- 172.21.15.47:0/3666823290 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae0015c230 0x7fae0006c630 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fadf8009d90 tx=0x7fadf802bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5bab15f10bdaa0f server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:57.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.397+0000 7fadf7fff640 1 -- 172.21.15.47:0/3666823290 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf8039070 con 0x7fae0015c230 2024-04-01T22:33:57.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.397+0000 7fadf7fff640 1 -- 172.21.15.47:0/3666823290 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadf802cd80 con 0x7fae0015c230 2024-04-01T22:33:57.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.397+0000 7fadf7fff640 1 -- 172.21.15.47:0/3666823290 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf8034660 con 0x7fae0015c230 2024-04-01T22:33:57.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.398+0000 7fae07547640 1 -- 172.21.15.47:0/3666823290 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae0015c230 msgr2=0x7fae0006c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:57.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.398+0000 7fae07547640 1 --2- 172.21.15.47:0/3666823290 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae0015c230 0x7fae0006c630 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fadf8009d90 tx=0x7fadf802bfd0 comp rx=0 tx=0).stop 2024-04-01T22:33:57.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.398+0000 7fae07547640 1 -- 172.21.15.47:0/3666823290 shutdown_connections 2024-04-01T22:33:57.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.398+0000 7fae07547640 1 --2- 172.21.15.47:0/3666823290 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae0015c230 0x7fae0006c630 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:57.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.398+0000 7fae07547640 1 -- 172.21.15.47:0/3666823290 >> 172.21.15.47:0/3666823290 conn(0x7fae000cfdb0 msgr2=0x7fae000d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:57.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.398+0000 7fae07547640 1 -- 172.21.15.47:0/3666823290 shutdown_connections 2024-04-01T22:33:57.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.398+0000 7fae07547640 1 -- 172.21.15.47:0/3666823290 wait complete. 2024-04-01T22:33:57.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.400+0000 7fae07547640 1 Processor -- start 2024-04-01T22:33:57.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.400+0000 7fae07547640 1 -- start start 2024-04-01T22:33:57.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.401+0000 7fae07547640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fae0006c250 0x7fae000b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:57.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.401+0000 7fae07547640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae0015aec0 0x7fae001574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:57.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.401+0000 7fae07547640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae0015c230 0x7fae000b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:57.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.401+0000 7fae07547640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fae000ce340 con 0x7fae0015aec0 2024-04-01T22:33:57.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.401+0000 7fae07547640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fae000ce060 con 0x7fae0015c230 2024-04-01T22:33:57.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.401+0000 7fae07547640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fae000ce620 con 0x7fae0006c250 2024-04-01T22:33:57.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.401+0000 7fae04ae2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae0015aec0 0x7fae001574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:57.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.402+0000 7fae05ae4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae0015c230 0x7fae000b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:57.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.402+0000 7fae04ae2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae0015aec0 0x7fae001574e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49332/0 (socket says 172.21.15.47:49332) 2024-04-01T22:33:57.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.402+0000 7fae04ae2640 1 -- 172.21.15.47:0/2445171980 learned_addr learned my addr 172.21.15.47:0/2445171980 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:57.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.402+0000 7fae052e3640 1 --2- 172.21.15.47:0/2445171980 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fae0006c250 0x7fae000b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:57.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.406+0000 7fae05ae4640 1 -- 172.21.15.47:0/2445171980 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fae0006c250 msgr2=0x7fae000b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:57.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.406+0000 7fae05ae4640 1 --2- 172.21.15.47:0/2445171980 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fae0006c250 0x7fae000b2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:57.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.406+0000 7fae05ae4640 1 -- 172.21.15.47:0/2445171980 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae0015aec0 msgr2=0x7fae001574e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:57.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.406+0000 7fae05ae4640 1 --2- 172.21.15.47:0/2445171980 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae0015aec0 0x7fae001574e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:57.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.406+0000 7fae05ae4640 1 -- 172.21.15.47:0/2445171980 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae00157a20 con 0x7fae0015c230 2024-04-01T22:33:57.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.408+0000 7fae05ae4640 1 --2- 172.21.15.47:0/2445171980 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae0015c230 0x7fae000b52e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fae00073780 tx=0x7fadf8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:57.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.412+0000 7fadf5ffb640 1 -- 172.21.15.47:0/2445171980 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf8044020 con 0x7fae0015c230 2024-04-01T22:33:57.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.412+0000 7fadf5ffb640 1 -- 172.21.15.47:0/2445171980 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadf803f470 con 0x7fae0015c230 2024-04-01T22:33:57.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.412+0000 7fadf5ffb640 1 -- 172.21.15.47:0/2445171980 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf8039040 con 0x7fae0015c230 2024-04-01T22:33:57.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.412+0000 7fae07547640 1 -- 172.21.15.47:0/2445171980 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae000b3560 con 0x7fae0015c230 2024-04-01T22:33:57.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.412+0000 7fae07547640 1 -- 172.21.15.47:0/2445171980 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae000b3b20 con 0x7fae0015c230 2024-04-01T22:33:57.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.413+0000 7fae07547640 1 -- 172.21.15.47:0/2445171980 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae00068210 con 0x7fae0015c230 2024-04-01T22:33:57.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.432+0000 7fadf5ffb640 1 -- 172.21.15.47:0/2445171980 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7fadf8047020 con 0x7fae0015c230 2024-04-01T22:33:57.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.432+0000 7fadf5ffb640 1 --2- 172.21.15.47:0/2445171980 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fade406b9e0 0x7fade406dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:57.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.432+0000 7fae052e3640 1 --2- 172.21.15.47:0/2445171980 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fade406b9e0 0x7fade406dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:57.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.432+0000 7fae052e3640 1 --2- 172.21.15.47:0/2445171980 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fade406b9e0 0x7fade406dea0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fadfc005880 tx=0x7fadfc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:57.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.659+0000 7fadf5ffb640 1 -- 172.21.15.47:0/2445171980 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fadf8079b80 con 0x7fae0015c230 2024-04-01T22:33:57.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.669+0000 7fadf5ffb640 1 -- 172.21.15.47:0/2445171980 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fadf804e030 con 0x7fae0015c230 2024-04-01T22:33:57.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.851+0000 7fae07547640 1 -- 172.21.15.47:0/2445171980 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fae000b5b50 con 0x7fae0015c230 2024-04-01T22:33:57.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.987+0000 7fadf5ffb640 1 -- 172.21.15.47:0/2445171980 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18526 (secure 0 0 0) 0x7fadf807bae0 con 0x7fae0015c230 2024-04-01T22:33:57.988 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:33:57.988 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"fsid":"a6998a48-38bc-4e42-b0d9-04f2fb5c3c87","created":"2024-04-01T22:32:57.112033+0000","modified":"2024-04-01T22:33:33.448062+0000","last_up_change":"2024-04-01T22:33:11.141073+0000","last_in_change":"2024-04-01T22:33:02.650459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T22:33:13.356568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T22:33:25.309421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T22:33:26.268050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-01T22:33:30.588103+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7bd3f25d-e3a5-4932-b381-53dcbb464dde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6811","nonce":3827395709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6813","nonce":3827395709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6817","nonce":3827395709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6815","nonce":3827395709}]},"public_addr":"172.21.15.47:6811/3827395709","cluster_addr":"172.21.15.47:6813/3827395709","heartbeat_back_addr":"172.21.15.47:6817/3827395709","heartbeat_front_addr":"172.21.15.47:6815/3827395709","state":["exists","up"]},{"osd":1,"uuid":"2aa60ba2-67ff-43c7-96c4-82ae2f3855ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6827","nonce":3152157503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6829","nonce":3152157503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6833","nonce":3152157503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6831","nonce":3152157503}]},"public_addr":"172.21.15.47:6827/3152157503","cluster_addr":"172.21.15.47:6829/3152157503","heartbeat_back_addr":"172.21.15.47:6833/3152157503","heartbeat_front_addr":"172.21.15.47:6831/3152157503","state":["exists","up"]},{"osd":2,"uuid":"d83f8a98-6db8-42b7-9ef6-5b16eb9a3492","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6803","nonce":1003968856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6805","nonce":1003968856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6809","nonce":1003968856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6807","nonce":1003968856}]},"public_addr":"172.21.15.47:6803/1003968856","cluster_addr":"172.21.15.47:6805/1003968856","heartbeat_back_addr":"172.21.15.47:6809/1003968856","heartbeat_front_addr":"172.21.15.47:6807/1003968856","state":["exists","up"]},{"osd":3,"uuid":"edc02ed5-d25c-4dc9-a0c3-7a26f20fae07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6819","nonce":2845699561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6821","nonce":2845699561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6825","nonce":2845699561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6823","nonce":2845699561}]},"public_addr":"172.21.15.47:6819/2845699561","cluster_addr":"172.21.15.47:6821/2845699561","heartbeat_back_addr":"172.21.15.47:6825/2845699561","heartbeat_front_addr":"172.21.15.47:6823/2845699561","state":["exists","up"]},{"osd":4,"uuid":"b3d67e74-f51e-4474-9c62-dd0daa60c728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6809","nonce":2961538461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6811","nonce":2961538461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6815","nonce":2961538461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6813","nonce":2961538461}]},"public_addr":"172.21.15.181:6809/2961538461","cluster_addr":"172.21.15.181:6811/2961538461","heartbeat_back_addr":"172.21.15.181:6815/2961538461","heartbeat_front_addr":"172.21.15.181:6813/2961538461","state":["exists","up"]},{"osd":5,"uuid":"d86e8f7a-99f4-4457-9949-cf2cb853e79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6817","nonce":2161566540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6819","nonce":2161566540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6823","nonce":2161566540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6821","nonce":2161566540}]},"public_addr":"172.21.15.181:6817/2161566540","cluster_addr":"172.21.15.181:6819/2161566540","heartbeat_back_addr":"172.21.15.181:6823/2161566540","heartbeat_front_addr":"172.21.15.181:6821/2161566540","state":["exists","up"]},{"osd":6,"uuid":"aa08266c-1719-4abd-afb9-e7e8ac593658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6801","nonce":3792144865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6803","nonce":3792144865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6807","nonce":3792144865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6805","nonce":3792144865}]},"public_addr":"172.21.15.181:6801/3792144865","cluster_addr":"172.21.15.181:6803/3792144865","heartbeat_back_addr":"172.21.15.181:6807/3792144865","heartbeat_front_addr":"172.21.15.181:6805/3792144865","state":["exists","up"]},{"osd":7,"uuid":"6e509762-24c8-46c3-93a1-4c50b11ebcf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6825","nonce":1760995885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6827","nonce":1760995885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6831","nonce":1760995885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6829","nonce":1760995885}]},"public_addr":"172.21.15.181:6825/1760995885","cluster_addr":"172.21.15.181:6827/1760995885","heartbeat_back_addr":"172.21.15.181:6831/1760995885","heartbeat_front_addr":"172.21.15.181:6829/1760995885","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.202426+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.255318+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.170288+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.290065+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.214871+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.176432+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.139940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.299546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T22:33:57.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.989+0000 7fae07547640 1 -- 172.21.15.47:0/2445171980 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fade406b9e0 msgr2=0x7fade406dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:57.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.989+0000 7fae07547640 1 --2- 172.21.15.47:0/2445171980 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fade406b9e0 0x7fade406dea0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fadfc005880 tx=0x7fadfc009040 comp rx=0 tx=0).stop 2024-04-01T22:33:57.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.989+0000 7fae07547640 1 -- 172.21.15.47:0/2445171980 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae0015c230 msgr2=0x7fae000b52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:57.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.989+0000 7fae07547640 1 --2- 172.21.15.47:0/2445171980 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae0015c230 0x7fae000b52e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fae00073780 tx=0x7fadf8004a40 comp rx=0 tx=0).stop 2024-04-01T22:33:57.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.989+0000 7fae07547640 1 -- 172.21.15.47:0/2445171980 shutdown_connections 2024-04-01T22:33:57.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.989+0000 7fae07547640 1 --2- 172.21.15.47:0/2445171980 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fade406b9e0 0x7fade406dea0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:57.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.989+0000 7fae07547640 1 --2- 172.21.15.47:0/2445171980 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fae0015c230 0x7fae000b52e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:57.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.989+0000 7fae07547640 1 --2- 172.21.15.47:0/2445171980 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae0015aec0 0x7fae001574e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:57.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.989+0000 7fae07547640 1 --2- 172.21.15.47:0/2445171980 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fae0006c250 0x7fae000b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:57.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.989+0000 7fae07547640 1 -- 172.21.15.47:0/2445171980 >> 172.21.15.47:0/2445171980 conn(0x7fae000cfdb0 msgr2=0x7fae00154030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:57.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.989+0000 7fae07547640 1 -- 172.21.15.47:0/2445171980 shutdown_connections 2024-04-01T22:33:57.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:57.989+0000 7fae07547640 1 -- 172.21.15.47:0/2445171980 wait complete. 2024-04-01T22:33:58.001 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-01T22:33:58.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.108+0000 7f1ad6d69640 1 Processor -- start 2024-04-01T22:33:58.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.108+0000 7f1ad6d69640 1 -- start start 2024-04-01T22:33:58.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.108+0000 7f1ad6d69640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ad00cee30 0x7f1ad015afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:58.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.108+0000 7f1ad6d69640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ad00cdae0 con 0x7f1ad00c93f0 2024-04-01T22:33:58.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.108+0000 7f1ad6d69640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ad00c97d0 con 0x7f1ad00cc0d0 2024-04-01T22:33:58.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.108+0000 7f1ad6d69640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f1ad015b500 con 0x7f1ad00cee30 2024-04-01T22:33:58.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.110+0000 7f1acffff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ad00cee30 0x7f1ad015afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:58.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.111+0000 7f1acffff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ad00cee30 0x7f1ad015afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:33238/0 (socket says 172.21.15.47:33238) 2024-04-01T22:33:58.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.111+0000 7f1acffff640 1 -- 172.21.15.47:0/1967523499 learned_addr learned my addr 172.21.15.47:0/1967523499 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:58.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.113+0000 7f1acffff640 1 -- 172.21.15.47:0/1967523499 >> v1:172.21.15.181:6789/0 conn(0x7f1ad00cc0d0 legacy=0x7f1ad00cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:58.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.113+0000 7f1acffff640 1 -- 172.21.15.47:0/1967523499 >> v1:172.21.15.47:6789/0 conn(0x7f1ad00c93f0 legacy=0x7f1ad006c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:58.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.113+0000 7f1acffff640 1 -- 172.21.15.47:0/1967523499 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ad00cdd80 con 0x7f1ad00cee30 2024-04-01T22:33:58.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.115+0000 7f1acffff640 1 --2- 172.21.15.47:0/1967523499 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ad00cee30 0x7f1ad015afc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1abc0098a0 tx=0x7f1abc02b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e8b8e15de0d0767 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:58.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.118+0000 7f1acf7fe640 1 -- 172.21.15.47:0/1967523499 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1abc0317c0 con 0x7f1ad00cee30 2024-04-01T22:33:58.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.118+0000 7f1acf7fe640 1 -- 172.21.15.47:0/1967523499 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1abc037070 con 0x7f1ad00cee30 2024-04-01T22:33:58.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.118+0000 7f1acf7fe640 1 -- 172.21.15.47:0/1967523499 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1abc031b80 con 0x7f1ad00cee30 2024-04-01T22:33:58.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.119+0000 7f1ad6d69640 1 -- 172.21.15.47:0/1967523499 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ad00cee30 msgr2=0x7f1ad015afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:58.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.119+0000 7f1ad6d69640 1 --2- 172.21.15.47:0/1967523499 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ad00cee30 0x7f1ad015afc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1abc0098a0 tx=0x7f1abc02b860 comp rx=0 tx=0).stop 2024-04-01T22:33:58.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.119+0000 7f1ad6d69640 1 -- 172.21.15.47:0/1967523499 shutdown_connections 2024-04-01T22:33:58.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.119+0000 7f1ad6d69640 1 --2- 172.21.15.47:0/1967523499 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ad00cee30 0x7f1ad015afc0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:58.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.119+0000 7f1ad6d69640 1 -- 172.21.15.47:0/1967523499 >> 172.21.15.47:0/1967523499 conn(0x7f1ad00cfdb0 msgr2=0x7f1ad00d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:58.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.119+0000 7f1ad6d69640 1 -- 172.21.15.47:0/1967523499 shutdown_connections 2024-04-01T22:33:58.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.119+0000 7f1ad6d69640 1 -- 172.21.15.47:0/1967523499 wait complete. 2024-04-01T22:33:58.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.120+0000 7f1ad6d69640 1 Processor -- start 2024-04-01T22:33:58.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.120+0000 7f1ad6d69640 1 -- start start 2024-04-01T22:33:58.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.121+0000 7f1ad6d69640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ad00c93f0 0x7f1ad00c7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:58.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.121+0000 7f1ad6d69640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ad00cc0d0 0x7f1ad00c3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:58.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.121+0000 7f1ad6d69640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ad00cee30 0x7f1ad014dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:58.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.121+0000 7f1ad6d69640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad00ce620 con 0x7f1ad00cee30 2024-04-01T22:33:58.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.121+0000 7f1ad6d69640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad00ce340 con 0x7f1ad00c93f0 2024-04-01T22:33:58.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.121+0000 7f1ad6d69640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f1ad00cf430 con 0x7f1ad00cc0d0 2024-04-01T22:33:58.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.122+0000 7f1ad4b05640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ad00c93f0 0x7f1ad00c7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:58.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.122+0000 7f1ad4b05640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ad00c93f0 0x7f1ad00c7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:37346/0 (socket says 172.21.15.47:37346) 2024-04-01T22:33:58.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.122+0000 7f1ad4b05640 1 -- 172.21.15.47:0/164358944 learned_addr learned my addr 172.21.15.47:0/164358944 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:58.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.123+0000 7f1acffff640 1 --2- 172.21.15.47:0/164358944 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ad00cc0d0 0x7f1ad00c3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:58.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.123+0000 7f1ad5306640 1 --2- 172.21.15.47:0/164358944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ad00cee30 0x7f1ad014dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:58.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.126+0000 7f1ad4b05640 1 -- 172.21.15.47:0/164358944 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ad00cc0d0 msgr2=0x7f1ad00c3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:58.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.126+0000 7f1ad4b05640 1 --2- 172.21.15.47:0/164358944 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ad00cc0d0 0x7f1ad00c3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:58.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.126+0000 7f1ad4b05640 1 -- 172.21.15.47:0/164358944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ad00cee30 msgr2=0x7f1ad014dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:58.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.126+0000 7f1ad4b05640 1 --2- 172.21.15.47:0/164358944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ad00cee30 0x7f1ad014dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:58.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.126+0000 7f1ad4b05640 1 -- 172.21.15.47:0/164358944 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ad00b5640 con 0x7f1ad00c93f0 2024-04-01T22:33:58.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.129+0000 7f1ad4b05640 1 --2- 172.21.15.47:0/164358944 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ad00c93f0 0x7f1ad00c7140 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1ac400c410 tx=0x7f1ac400c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:58.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.133+0000 7f1acd7fa640 1 -- 172.21.15.47:0/164358944 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac4017070 con 0x7f1ad00c93f0 2024-04-01T22:33:58.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.133+0000 7f1acd7fa640 1 -- 172.21.15.47:0/164358944 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ac40035f0 con 0x7f1ad00c93f0 2024-04-01T22:33:58.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.133+0000 7f1ad6d69640 1 -- 172.21.15.47:0/164358944 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ad01f3900 con 0x7f1ad00c93f0 2024-04-01T22:33:58.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.133+0000 7f1acd7fa640 1 -- 172.21.15.47:0/164358944 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac40039e0 con 0x7f1ad00c93f0 2024-04-01T22:33:58.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.133+0000 7f1ad6d69640 1 -- 172.21.15.47:0/164358944 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ad01f3ec0 con 0x7f1ad00c93f0 2024-04-01T22:33:58.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.134+0000 7f1ad6d69640 1 -- 172.21.15.47:0/164358944 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ad00732d0 con 0x7f1ad00c93f0 2024-04-01T22:33:58.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.152+0000 7f1acd7fa640 1 -- 172.21.15.47:0/164358944 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f1ac401a070 con 0x7f1ad00c93f0 2024-04-01T22:33:58.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.153+0000 7f1acd7fa640 1 --2- 172.21.15.47:0/164358944 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f1ab406b9e0 0x7f1ab406dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:58.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.153+0000 7f1acffff640 1 --2- 172.21.15.47:0/164358944 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f1ab406b9e0 0x7f1ab406dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:58.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.154+0000 7f1acffff640 1 --2- 172.21.15.47:0/164358944 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f1ab406b9e0 0x7f1ab406dea0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1abc036000 tx=0x7f1abc03d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:58.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.155+0000 7f1acd7fa640 1 -- 172.21.15.47:0/164358944 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1ac4056720 con 0x7f1ad00c93f0 2024-04-01T22:33:58.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.390+0000 7f1acd7fa640 1 -- 172.21.15.47:0/164358944 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f1ad00732d0 con 0x7f1ad00c93f0 2024-04-01T22:33:58.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:58.615+0000 7f1ad6d69640 1 -- 172.21.15.47:0/164358944 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f1ad0068210 con 0x7f1ad00c93f0 2024-04-01T22:33:59.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.223+0000 7f1acd7fa640 1 -- 172.21.15.47:0/164358944 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f1ac4021020 con 0x7f1ad00c93f0 2024-04-01T22:33:59.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.225+0000 7f1ad6d69640 1 -- 172.21.15.47:0/164358944 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f1ab406b9e0 msgr2=0x7f1ab406dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:59.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.225+0000 7f1ad6d69640 1 --2- 172.21.15.47:0/164358944 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f1ab406b9e0 0x7f1ab406dea0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1abc036000 tx=0x7f1abc03d040 comp rx=0 tx=0).stop 2024-04-01T22:33:59.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.225+0000 7f1ad6d69640 1 -- 172.21.15.47:0/164358944 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ad00c93f0 msgr2=0x7f1ad00c7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:59.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.225+0000 7f1ad6d69640 1 --2- 172.21.15.47:0/164358944 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ad00c93f0 0x7f1ad00c7140 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1ac400c410 tx=0x7f1ac400c8d0 comp rx=0 tx=0).stop 2024-04-01T22:33:59.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.226+0000 7f1ad6d69640 1 -- 172.21.15.47:0/164358944 shutdown_connections 2024-04-01T22:33:59.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.226+0000 7f1ad6d69640 1 --2- 172.21.15.47:0/164358944 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f1ab406b9e0 0x7f1ab406dea0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:59.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.226+0000 7f1ad6d69640 1 --2- 172.21.15.47:0/164358944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ad00cee30 0x7f1ad014dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:59.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.226+0000 7f1ad6d69640 1 --2- 172.21.15.47:0/164358944 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1ad00cc0d0 0x7f1ad00c3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:59.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.226+0000 7f1ad6d69640 1 --2- 172.21.15.47:0/164358944 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1ad00c93f0 0x7f1ad00c7140 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:59.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.226+0000 7f1ad6d69640 1 -- 172.21.15.47:0/164358944 >> 172.21.15.47:0/164358944 conn(0x7f1ad00cfdb0 msgr2=0x7f1ad014fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:59.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.226+0000 7f1ad6d69640 1 -- 172.21.15.47:0/164358944 shutdown_connections 2024-04-01T22:33:59.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.226+0000 7f1ad6d69640 1 -- 172.21.15.47:0/164358944 wait complete. 2024-04-01T22:33:59.236 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300} 2024-04-01T22:33:59.237 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-01T22:33:59.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.342+0000 7f4c353e9640 1 Processor -- start 2024-04-01T22:33:59.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.342+0000 7f4c353e9640 1 -- start start 2024-04-01T22:33:59.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.342+0000 7f4c353e9640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4c300c8db0 0x7f4c30154040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:59.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.342+0000 7f4c353e9640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4c30154580 0x7f4c3015a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:59.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.342+0000 7f4c353e9640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c3015b1c0 con 0x7f4c300c89d0 2024-04-01T22:33:59.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.342+0000 7f4c353e9640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f4c3015e9c0 con 0x7f4c300c8db0 2024-04-01T22:33:59.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.342+0000 7f4c353e9640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f4c3015dc00 con 0x7f4c30154580 2024-04-01T22:33:59.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.343+0000 7f4c27fff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4c300c8db0 0x7f4c30154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:59.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.343+0000 7f4c27fff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4c300c8db0 0x7f4c30154040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49340/0 (socket says 172.21.15.47:49340) 2024-04-01T22:33:59.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.343+0000 7f4c2f7fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4c30154580 0x7f4c3015a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:59.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.343+0000 7f4c27fff640 1 -- 172.21.15.47:0/3361213022 learned_addr learned my addr 172.21.15.47:0/3361213022 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:59.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.346+0000 7f4c2f7fe640 1 -- 172.21.15.47:0/3361213022 >> v2:172.21.15.47:3300/0 conn(0x7f4c300c8db0 msgr2=0x7f4c30154040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:33:59.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.346+0000 7f4c2f7fe640 1 --2- 172.21.15.47:0/3361213022 >> v2:172.21.15.47:3300/0 conn(0x7f4c300c8db0 0x7f4c30154040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:59.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.346+0000 7f4c2f7fe640 1 -- 172.21.15.47:0/3361213022 >> v1:172.21.15.47:6789/0 conn(0x7f4c300c89d0 legacy=0x7f4c3006c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:59.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.346+0000 7f4c2f7fe640 1 -- 172.21.15.47:0/3361213022 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c3015dee0 con 0x7f4c30154580 2024-04-01T22:33:59.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.348+0000 7f4c2f7fe640 1 --2- 172.21.15.47:0/3361213022 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c30154580 0x7f4c3015a430 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4c30072150 tx=0x7f4c2802bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=868301f06bdef68a server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:59.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.351+0000 7f4c2e7fc640 1 -- 172.21.15.47:0/3361213022 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c28039070 con 0x7f4c30154580 2024-04-01T22:33:59.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.351+0000 7f4c2e7fc640 1 -- 172.21.15.47:0/3361213022 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c2802cd00 con 0x7f4c30154580 2024-04-01T22:33:59.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.351+0000 7f4c2e7fc640 1 -- 172.21.15.47:0/3361213022 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c28034660 con 0x7f4c30154580 2024-04-01T22:33:59.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.352+0000 7f4c353e9640 1 -- 172.21.15.47:0/3361213022 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c30154580 msgr2=0x7f4c3015a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:59.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.352+0000 7f4c353e9640 1 --2- 172.21.15.47:0/3361213022 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c30154580 0x7f4c3015a430 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4c30072150 tx=0x7f4c2802bf50 comp rx=0 tx=0).stop 2024-04-01T22:33:59.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.352+0000 7f4c353e9640 1 -- 172.21.15.47:0/3361213022 shutdown_connections 2024-04-01T22:33:59.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.352+0000 7f4c353e9640 1 --2- 172.21.15.47:0/3361213022 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c30154580 0x7f4c3015a430 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:59.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.352+0000 7f4c353e9640 1 --2- 172.21.15.47:0/3361213022 >> v2:172.21.15.47:3300/0 conn(0x7f4c300c8db0 0x7f4c30154040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:59.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.352+0000 7f4c353e9640 1 -- 172.21.15.47:0/3361213022 >> 172.21.15.47:0/3361213022 conn(0x7f4c30071310 msgr2=0x7f4c30071720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:33:59.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.352+0000 7f4c353e9640 1 -- 172.21.15.47:0/3361213022 shutdown_connections 2024-04-01T22:33:59.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.352+0000 7f4c353e9640 1 -- 172.21.15.47:0/3361213022 wait complete. 2024-04-01T22:33:59.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.353+0000 7f4c353e9640 1 Processor -- start 2024-04-01T22:33:59.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.353+0000 7f4c353e9640 1 -- start start 2024-04-01T22:33:59.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.354+0000 7f4c353e9640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c300c89d0 0x7f4c300c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:59.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.354+0000 7f4c353e9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c300c8db0 0x7f4c3014eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:59.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.354+0000 7f4c353e9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c30154580 0x7f4c300cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:59.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.354+0000 7f4c353e9640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3006ce60 con 0x7f4c30154580 2024-04-01T22:33:59.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.354+0000 7f4c353e9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3015e4a0 con 0x7f4c300c8db0 2024-04-01T22:33:59.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.354+0000 7f4c353e9640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f4c30159680 con 0x7f4c300c89d0 2024-04-01T22:33:59.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.354+0000 7f4c2f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c30154580 0x7f4c300cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:59.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.355+0000 7f4c27fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c300c8db0 0x7f4c3014eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:59.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.355+0000 7f4c2f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c30154580 0x7f4c300cbb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49344/0 (socket says 172.21.15.47:49344) 2024-04-01T22:33:59.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.355+0000 7f4c2f7fe640 1 -- 172.21.15.47:0/2454128776 learned_addr learned my addr 172.21.15.47:0/2454128776 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:33:59.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.355+0000 7f4c2effd640 1 --2- 172.21.15.47:0/2454128776 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c300c89d0 0x7f4c300c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:59.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.358+0000 7f4c2f7fe640 1 -- 172.21.15.47:0/2454128776 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c300c89d0 msgr2=0x7f4c300c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:59.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.358+0000 7f4c2f7fe640 1 --2- 172.21.15.47:0/2454128776 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c300c89d0 0x7f4c300c7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:59.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.358+0000 7f4c2f7fe640 1 -- 172.21.15.47:0/2454128776 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c300c8db0 msgr2=0x7f4c3014eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:33:59.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.358+0000 7f4c2f7fe640 1 --2- 172.21.15.47:0/2454128776 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c300c8db0 0x7f4c3014eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:33:59.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.358+0000 7f4c2f7fe640 1 -- 172.21.15.47:0/2454128776 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c30159920 con 0x7f4c30154580 2024-04-01T22:33:59.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.361+0000 7f4c2f7fe640 1 --2- 172.21.15.47:0/2454128776 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c30154580 0x7f4c300cbb50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4c2802c560 tx=0x7f4c28004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:59.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.364+0000 7f4c277fe640 1 -- 172.21.15.47:0/2454128776 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c28044020 con 0x7f4c30154580 2024-04-01T22:33:59.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.364+0000 7f4c277fe640 1 -- 172.21.15.47:0/2454128776 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c2803f470 con 0x7f4c30154580 2024-04-01T22:33:59.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.364+0000 7f4c277fe640 1 -- 172.21.15.47:0/2454128776 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c28039040 con 0x7f4c30154580 2024-04-01T22:33:59.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.364+0000 7f4c353e9640 1 -- 172.21.15.47:0/2454128776 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c30159c00 con 0x7f4c30154580 2024-04-01T22:33:59.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.365+0000 7f4c353e9640 1 -- 172.21.15.47:0/2454128776 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c3015a1c0 con 0x7f4c30154580 2024-04-01T22:33:59.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.365+0000 7f4c353e9640 1 -- 172.21.15.47:0/2454128776 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c3006c320 con 0x7f4c30154580 2024-04-01T22:33:59.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.644+0000 7f4c277fe640 1 -- 172.21.15.47:0/2454128776 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f4c28047020 con 0x7f4c30154580 2024-04-01T22:33:59.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.644+0000 7f4c277fe640 1 --2- 172.21.15.47:0/2454128776 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f4c1006b9e0 0x7f4c1006dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:33:59.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.644+0000 7f4c2effd640 1 --2- 172.21.15.47:0/2454128776 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f4c1006b9e0 0x7f4c1006dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:33:59.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.644+0000 7f4c2effd640 1 --2- 172.21.15.47:0/2454128776 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f4c1006b9e0 0x7f4c1006dea0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4c20001780 tx=0x7f4c20009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:33:59.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.677+0000 7f4c277fe640 1 -- 172.21.15.47:0/2454128776 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4c28079f40 con 0x7f4c30154580 2024-04-01T22:33:59.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.677+0000 7f4c277fe640 1 -- 172.21.15.47:0/2454128776 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f4c2804e020 con 0x7f4c30154580 2024-04-01T22:33:59.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:33:59.898+0000 7f4c353e9640 1 -- 172.21.15.47:0/2454128776 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f4c300ca420 con 0x7f4c30154580 2024-04-01T22:34:00.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.236+0000 7f4c277fe640 1 -- 172.21.15.47:0/2454128776 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f4c2807bea0 con 0x7f4c30154580 2024-04-01T22:34:00.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.239+0000 7f4c353e9640 1 -- 172.21.15.47:0/2454128776 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f4c1006b9e0 msgr2=0x7f4c1006dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:00.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.239+0000 7f4c353e9640 1 --2- 172.21.15.47:0/2454128776 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f4c1006b9e0 0x7f4c1006dea0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4c20001780 tx=0x7f4c20009040 comp rx=0 tx=0).stop 2024-04-01T22:34:00.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.239+0000 7f4c353e9640 1 -- 172.21.15.47:0/2454128776 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c30154580 msgr2=0x7f4c300cbb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:00.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.239+0000 7f4c353e9640 1 --2- 172.21.15.47:0/2454128776 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c30154580 0x7f4c300cbb50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4c2802c560 tx=0x7f4c28004a40 comp rx=0 tx=0).stop 2024-04-01T22:34:00.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.239+0000 7f4c353e9640 1 -- 172.21.15.47:0/2454128776 shutdown_connections 2024-04-01T22:34:00.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.239+0000 7f4c353e9640 1 --2- 172.21.15.47:0/2454128776 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f4c1006b9e0 0x7f4c1006dea0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:00.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.239+0000 7f4c353e9640 1 --2- 172.21.15.47:0/2454128776 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c30154580 0x7f4c300cbb50 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:00.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.239+0000 7f4c353e9640 1 --2- 172.21.15.47:0/2454128776 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c300c8db0 0x7f4c3014eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:00.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.239+0000 7f4c353e9640 1 --2- 172.21.15.47:0/2454128776 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4c300c89d0 0x7f4c300c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:00.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.239+0000 7f4c353e9640 1 -- 172.21.15.47:0/2454128776 >> 172.21.15.47:0/2454128776 conn(0x7f4c30071310 msgr2=0x7f4c3006d170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:00.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.239+0000 7f4c353e9640 1 -- 172.21.15.47:0/2454128776 shutdown_connections 2024-04-01T22:34:00.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.239+0000 7f4c353e9640 1 -- 172.21.15.47:0/2454128776 wait complete. 2024-04-01T22:34:00.250 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-04-01T22:34:00.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.354+0000 7fb031b56640 1 Processor -- start 2024-04-01T22:34:00.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.354+0000 7fb031b56640 1 -- start start 2024-04-01T22:34:00.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.355+0000 7fb031b56640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb02c0c93f0 0x7fb02c0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:00.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.355+0000 7fb031b56640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb02c0cc0d0 0x7fb02c0cc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:00.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.355+0000 7fb031b56640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb02c0ccaa0 con 0x7fb02c15afc0 2024-04-01T22:34:00.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.355+0000 7fb031b56640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fb02c0cdae0 con 0x7fb02c0c93f0 2024-04-01T22:34:00.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.355+0000 7fb031b56640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb02c0c97d0 con 0x7fb02c0cc0d0 2024-04-01T22:34:00.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.356+0000 7fb02b7fe640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb02c0c93f0 0x7fb02c0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:00.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.356+0000 7fb02bfff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb02c0cc0d0 0x7fb02c0cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:00.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.356+0000 7fb02b7fe640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb02c0c93f0 0x7fb02c0cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47624/0 (socket says 172.21.15.47:47624) 2024-04-01T22:34:00.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.356+0000 7fb02b7fe640 1 -- 172.21.15.47:0/1968721530 learned_addr learned my addr 172.21.15.47:0/1968721530 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:00.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.358+0000 7fb02bfff640 1 -- 172.21.15.47:0/1968721530 >> v2:172.21.15.47:3300/0 conn(0x7fb02c0c93f0 msgr2=0x7fb02c0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:00.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.358+0000 7fb02bfff640 1 --2- 172.21.15.47:0/1968721530 >> v2:172.21.15.47:3300/0 conn(0x7fb02c0c93f0 0x7fb02c0cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:00.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.358+0000 7fb02bfff640 1 -- 172.21.15.47:0/1968721530 >> v1:172.21.15.47:6789/0 conn(0x7fb02c15afc0 legacy=0x7fb02c06c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:00.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.358+0000 7fb02bfff640 1 -- 172.21.15.47:0/1968721530 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb02c0cdd80 con 0x7fb02c0cc0d0 2024-04-01T22:34:00.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.360+0000 7fb02bfff640 1 --2- 172.21.15.47:0/1968721530 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb02c0cc0d0 0x7fb02c0cc560 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb024009d90 tx=0x7fb02402be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac880c82fdbd6508 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:00.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.363+0000 7fb02a7fc640 1 -- 172.21.15.47:0/1968721530 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb024039070 con 0x7fb02c0cc0d0 2024-04-01T22:34:00.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.364+0000 7fb02a7fc640 1 -- 172.21.15.47:0/1968721530 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb02402cbc0 con 0x7fb02c0cc0d0 2024-04-01T22:34:00.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.364+0000 7fb02a7fc640 1 -- 172.21.15.47:0/1968721530 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb024034440 con 0x7fb02c0cc0d0 2024-04-01T22:34:00.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.364+0000 7fb031b56640 1 -- 172.21.15.47:0/1968721530 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb02c0cc0d0 msgr2=0x7fb02c0cc560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:00.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.364+0000 7fb031b56640 1 --2- 172.21.15.47:0/1968721530 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb02c0cc0d0 0x7fb02c0cc560 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb024009d90 tx=0x7fb02402be10 comp rx=0 tx=0).stop 2024-04-01T22:34:00.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.364+0000 7fb031b56640 1 -- 172.21.15.47:0/1968721530 shutdown_connections 2024-04-01T22:34:00.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.364+0000 7fb031b56640 1 --2- 172.21.15.47:0/1968721530 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb02c0cc0d0 0x7fb02c0cc560 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:00.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.364+0000 7fb031b56640 1 --2- 172.21.15.47:0/1968721530 >> v2:172.21.15.47:3300/0 conn(0x7fb02c0c93f0 0x7fb02c0cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:00.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.364+0000 7fb031b56640 1 -- 172.21.15.47:0/1968721530 >> 172.21.15.47:0/1968721530 conn(0x7fb02c0cfdb0 msgr2=0x7fb02c0d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:00.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.364+0000 7fb031b56640 1 -- 172.21.15.47:0/1968721530 shutdown_connections 2024-04-01T22:34:00.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.364+0000 7fb031b56640 1 -- 172.21.15.47:0/1968721530 wait complete. 2024-04-01T22:34:00.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.365+0000 7fb031b56640 1 Processor -- start 2024-04-01T22:34:00.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.366+0000 7fb031b56640 1 -- start start 2024-04-01T22:34:00.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.366+0000 7fb031b56640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb02c0c93f0 0x7fb02c156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:00.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.366+0000 7fb031b56640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb02c0cc0d0 0x7fb02c157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:00.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.366+0000 7fb031b56640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb02c15afc0 0x7fb02c14b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:00.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.366+0000 7fb031b56640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb02c0ce620 con 0x7fb02c0c93f0 2024-04-01T22:34:00.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.366+0000 7fb031b56640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb02c0ce340 con 0x7fb02c15afc0 2024-04-01T22:34:00.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.366+0000 7fb031b56640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb02c15b400 con 0x7fb02c0cc0d0 2024-04-01T22:34:00.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.367+0000 7fb02b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb02c0c93f0 0x7fb02c156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:00.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.367+0000 7fb02affd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb02c0cc0d0 0x7fb02c157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:00.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.367+0000 7fb02bfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb02c15afc0 0x7fb02c14b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:00.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.367+0000 7fb02b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb02c0c93f0 0x7fb02c156bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47630/0 (socket says 172.21.15.47:47630) 2024-04-01T22:34:00.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.367+0000 7fb02b7fe640 1 -- 172.21.15.47:0/879339293 learned_addr learned my addr 172.21.15.47:0/879339293 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:00.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.370+0000 7fb02affd640 1 -- 172.21.15.47:0/879339293 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb02c15afc0 msgr2=0x7fb02c14b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:00.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.370+0000 7fb02affd640 1 --2- 172.21.15.47:0/879339293 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb02c15afc0 0x7fb02c14b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:00.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.370+0000 7fb02affd640 1 -- 172.21.15.47:0/879339293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb02c0c93f0 msgr2=0x7fb02c156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:00.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.370+0000 7fb02affd640 1 --2- 172.21.15.47:0/879339293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb02c0c93f0 0x7fb02c156bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:00.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.370+0000 7fb02affd640 1 -- 172.21.15.47:0/879339293 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb02c155130 con 0x7fb02c0cc0d0 2024-04-01T22:34:00.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.373+0000 7fb02affd640 1 --2- 172.21.15.47:0/879339293 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb02c0cc0d0 0x7fb02c157100 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb01c00c3f0 tx=0x7fb01c00c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:00.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.376+0000 7fb013fff640 1 -- 172.21.15.47:0/879339293 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb01c0052d0 con 0x7fb02c0cc0d0 2024-04-01T22:34:00.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.376+0000 7fb013fff640 1 -- 172.21.15.47:0/879339293 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb01c005490 con 0x7fb02c0cc0d0 2024-04-01T22:34:00.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.376+0000 7fb031b56640 1 -- 172.21.15.47:0/879339293 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb02c0af790 con 0x7fb02c0cc0d0 2024-04-01T22:34:00.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.376+0000 7fb013fff640 1 -- 172.21.15.47:0/879339293 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb01c007260 con 0x7fb02c0cc0d0 2024-04-01T22:34:00.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.376+0000 7fb031b56640 1 -- 172.21.15.47:0/879339293 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb02c0afd50 con 0x7fb02c0cc0d0 2024-04-01T22:34:00.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.377+0000 7fb031b56640 1 -- 172.21.15.47:0/879339293 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb02c068210 con 0x7fb02c0cc0d0 2024-04-01T22:34:00.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.395+0000 7fb013fff640 1 -- 172.21.15.47:0/879339293 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7fb01c007400 con 0x7fb02c0cc0d0 2024-04-01T22:34:00.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.396+0000 7fb013fff640 1 --2- 172.21.15.47:0/879339293 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fb01806b9e0 0x7fb01806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:00.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.396+0000 7fb02b7fe640 1 --2- 172.21.15.47:0/879339293 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fb01806b9e0 0x7fb01806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:00.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.396+0000 7fb02b7fe640 1 --2- 172.21.15.47:0/879339293 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fb01806b9e0 0x7fb01806dea0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb0200094a0 tx=0x7fb020009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:00.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.399+0000 7fb013fff640 1 -- 172.21.15.47:0/879339293 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb01c056a30 con 0x7fb02c0cc0d0 2024-04-01T22:34:00.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.636+0000 7fb013fff640 1 -- 172.21.15.47:0/879339293 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fb01c058990 con 0x7fb02c0cc0d0 2024-04-01T22:34:00.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:00.859+0000 7fb031b56640 1 -- 172.21.15.47:0/879339293 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fb02c06cf00 con 0x7fb02c0cc0d0 2024-04-01T22:34:01.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.361+0000 7fb013fff640 1 -- 172.21.15.47:0/879339293 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v9) ==== 115+0+0 (secure 0 0 0) 0x7fb01c05ca30 con 0x7fb02c0cc0d0 2024-04-01T22:34:01.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.363+0000 7fb031b56640 1 -- 172.21.15.47:0/879339293 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fb01806b9e0 msgr2=0x7fb01806dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:01.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.363+0000 7fb031b56640 1 --2- 172.21.15.47:0/879339293 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fb01806b9e0 0x7fb01806dea0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb0200094a0 tx=0x7fb020009240 comp rx=0 tx=0).stop 2024-04-01T22:34:01.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.363+0000 7fb031b56640 1 -- 172.21.15.47:0/879339293 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb02c0cc0d0 msgr2=0x7fb02c157100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:01.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.363+0000 7fb031b56640 1 --2- 172.21.15.47:0/879339293 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb02c0cc0d0 0x7fb02c157100 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb01c00c3f0 tx=0x7fb01c00c8b0 comp rx=0 tx=0).stop 2024-04-01T22:34:01.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.364+0000 7fb031b56640 1 -- 172.21.15.47:0/879339293 shutdown_connections 2024-04-01T22:34:01.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.364+0000 7fb031b56640 1 --2- 172.21.15.47:0/879339293 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fb01806b9e0 0x7fb01806dea0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:01.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.364+0000 7fb031b56640 1 --2- 172.21.15.47:0/879339293 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb02c15afc0 0x7fb02c14b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:01.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.364+0000 7fb031b56640 1 --2- 172.21.15.47:0/879339293 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb02c0cc0d0 0x7fb02c157100 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:01.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.364+0000 7fb031b56640 1 --2- 172.21.15.47:0/879339293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb02c0c93f0 0x7fb02c156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:01.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.364+0000 7fb031b56640 1 -- 172.21.15.47:0/879339293 >> 172.21.15.47:0/879339293 conn(0x7fb02c0cfdb0 msgr2=0x7fb02c0d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:01.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.364+0000 7fb031b56640 1 -- 172.21.15.47:0/879339293 shutdown_connections 2024-04-01T22:34:01.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.364+0000 7fb031b56640 1 -- 172.21.15.47:0/879339293 wait complete. 2024-04-01T22:34:01.374 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-01T22:34:01.374 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T22:34:01.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.476+0000 7f9fd20cd640 1 Processor -- start 2024-04-01T22:34:01.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.476+0000 7f9fd20cd640 1 -- start start 2024-04-01T22:34:01.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.477+0000 7f9fd20cd640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f9fcc0ca090 0x7f9fcc0ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:01.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.477+0000 7f9fd20cd640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fcc1528b0 con 0x7f9fcc1524d0 2024-04-01T22:34:01.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.477+0000 7f9fd20cd640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fcc1585b0 con 0x7f9fcc15bd90 2024-04-01T22:34:01.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.477+0000 7f9fd20cd640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f9fcc159130 con 0x7f9fcc0ca090 2024-04-01T22:34:01.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.478+0000 7f9fcb7fe640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f9fcc1524d0 0x7f9fcc0c8980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:56268/0 (socket says 172.21.15.47:56268) 2024-04-01T22:34:01.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.478+0000 7f9fcb7fe640 1 -- 172.21.15.47:0/3731833843 learned_addr learned my addr 172.21.15.47:0/3731833843 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T22:34:01.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.478+0000 7f9fcaffd640 1 --2- 172.21.15.47:0/3731833843 >> v2:172.21.15.181:3300/0 conn(0x7f9fcc0ca090 0x7f9fcc0ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:01.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.480+0000 7f9fca7fc640 1 -- 172.21.15.47:0/3731833843 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 977654304 0 0) 0x7f9fcc1528b0 con 0x7f9fcc1524d0 2024-04-01T22:34:01.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.480+0000 7f9fca7fc640 1 -- 172.21.15.47:0/3731833843 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9fb4003520 con 0x7f9fcc1524d0 2024-04-01T22:34:01.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.481+0000 7f9fcaffd640 1 -- 172.21.15.47:0/3731833843 >> v1:172.21.15.181:6789/0 conn(0x7f9fcc15bd90 legacy=0x7f9fcc162ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:01.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.481+0000 7f9fcaffd640 1 -- 172.21.15.47:0/3731833843 >> v1:172.21.15.47:6789/0 conn(0x7f9fcc1524d0 legacy=0x7f9fcc0c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:01.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.481+0000 7f9fcaffd640 1 -- 172.21.15.47:0/3731833843 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fcc158890 con 0x7f9fcc0ca090 2024-04-01T22:34:01.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.486+0000 7f9fcaffd640 1 --2- 172.21.15.47:0/3731833843 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fcc0ca090 0x7f9fcc0ca4d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc0097a0 tx=0x7f9fbc02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6374efbc967c7040 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:01.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.489+0000 7f9fca7fc640 1 -- 172.21.15.47:0/3731833843 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc034070 con 0x7f9fcc0ca090 2024-04-01T22:34:01.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.489+0000 7f9fca7fc640 1 -- 172.21.15.47:0/3731833843 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fbc030610 con 0x7f9fcc0ca090 2024-04-01T22:34:01.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.489+0000 7f9fca7fc640 1 -- 172.21.15.47:0/3731833843 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc0309e0 con 0x7f9fcc0ca090 2024-04-01T22:34:01.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.490+0000 7f9fd20cd640 1 -- 172.21.15.47:0/3731833843 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fcc0ca090 msgr2=0x7f9fcc0ca4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:01.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.490+0000 7f9fd20cd640 1 --2- 172.21.15.47:0/3731833843 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fcc0ca090 0x7f9fcc0ca4d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc0097a0 tx=0x7f9fbc02b960 comp rx=0 tx=0).stop 2024-04-01T22:34:01.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.490+0000 7f9fd20cd640 1 -- 172.21.15.47:0/3731833843 shutdown_connections 2024-04-01T22:34:01.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.490+0000 7f9fd20cd640 1 --2- 172.21.15.47:0/3731833843 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fcc0ca090 0x7f9fcc0ca4d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:01.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.490+0000 7f9fd20cd640 1 -- 172.21.15.47:0/3731833843 >> 172.21.15.47:0/3731833843 conn(0x7f9fcc071330 msgr2=0x7f9fcc071740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:01.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.490+0000 7f9fd20cd640 1 -- 172.21.15.47:0/3731833843 shutdown_connections 2024-04-01T22:34:01.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.490+0000 7f9fd20cd640 1 -- 172.21.15.47:0/3731833843 wait complete. 2024-04-01T22:34:01.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.491+0000 7f9fd20cd640 1 Processor -- start 2024-04-01T22:34:01.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.491+0000 7f9fd20cd640 1 -- start start 2024-04-01T22:34:01.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.492+0000 7f9fd20cd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9fcc0ca090 0x7f9fcc0c52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:01.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.492+0000 7f9fd20cd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9fcc1524d0 0x7f9fcc151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:01.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.492+0000 7f9fd20cd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fcc15bd90 0x7f9fcc156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:01.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.492+0000 7f9fd20cd640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9fcc15b870 con 0x7f9fcc0ca090 2024-04-01T22:34:01.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.492+0000 7f9fd20cd640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9fcc158e50 con 0x7f9fcc15bd90 2024-04-01T22:34:01.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.492+0000 7f9fd20cd640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f9fcc0c9090 con 0x7f9fcc1524d0 2024-04-01T22:34:01.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.493+0000 7f9fcb7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9fcc0ca090 0x7f9fcc0c52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:01.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.493+0000 7f9fcaffd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9fcc1524d0 0x7f9fcc151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:01.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.493+0000 7f9fcbfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fcc15bd90 0x7f9fcc156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:01.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.493+0000 7f9fcb7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9fcc0ca090 0x7f9fcc0c52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47642/0 (socket says 172.21.15.47:47642) 2024-04-01T22:34:01.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.493+0000 7f9fcb7fe640 1 -- 172.21.15.47:0/539190576 learned_addr learned my addr 172.21.15.47:0/539190576 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:01.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.496+0000 7f9fcbfff640 1 -- 172.21.15.47:0/539190576 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9fcc1524d0 msgr2=0x7f9fcc151810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:01.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.496+0000 7f9fcbfff640 1 --2- 172.21.15.47:0/539190576 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9fcc1524d0 0x7f9fcc151810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:01.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.496+0000 7f9fcbfff640 1 -- 172.21.15.47:0/539190576 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9fcc0ca090 msgr2=0x7f9fcc0c52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:01.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.496+0000 7f9fcbfff640 1 --2- 172.21.15.47:0/539190576 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9fcc0ca090 0x7f9fcc0c52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:01.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.496+0000 7f9fcbfff640 1 -- 172.21.15.47:0/539190576 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fcc1e3b80 con 0x7f9fcc15bd90 2024-04-01T22:34:01.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.496+0000 7f9fcb7fe640 1 --2- 172.21.15.47:0/539190576 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9fcc0ca090 0x7f9fcc0c52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T22:34:01.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.499+0000 7f9fcbfff640 1 --2- 172.21.15.47:0/539190576 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fcc15bd90 0x7f9fcc156dd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9fc400c730 tx=0x7f9fc400cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:01.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.502+0000 7f9fb3fff640 1 -- 172.21.15.47:0/539190576 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc4003b70 con 0x7f9fcc15bd90 2024-04-01T22:34:01.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.502+0000 7f9fb3fff640 1 -- 172.21.15.47:0/539190576 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fc4003d10 con 0x7f9fcc15bd90 2024-04-01T22:34:01.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.502+0000 7f9fd20cd640 1 -- 172.21.15.47:0/539190576 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fcc1ee0b0 con 0x7f9fcc15bd90 2024-04-01T22:34:01.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.502+0000 7f9fb3fff640 1 -- 172.21.15.47:0/539190576 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc4005310 con 0x7f9fcc15bd90 2024-04-01T22:34:01.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.502+0000 7f9fd20cd640 1 -- 172.21.15.47:0/539190576 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fcc1ee670 con 0x7f9fcc15bd90 2024-04-01T22:34:01.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.503+0000 7f9fd20cd640 1 -- 172.21.15.47:0/539190576 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fcc068210 con 0x7f9fcc15bd90 2024-04-01T22:34:01.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.522+0000 7f9fb3fff640 1 -- 172.21.15.47:0/539190576 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f9fc40056c0 con 0x7f9fcc15bd90 2024-04-01T22:34:01.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.522+0000 7f9fb3fff640 1 --2- 172.21.15.47:0/539190576 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f9fb806b9e0 0x7f9fb806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:01.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.523+0000 7f9fcb7fe640 1 --2- 172.21.15.47:0/539190576 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f9fb806b9e0 0x7f9fb806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:01.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.523+0000 7f9fcb7fe640 1 --2- 172.21.15.47:0/539190576 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f9fb806b9e0 0x7f9fb806dea0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0005880 tx=0x7f9fc0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:01.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.525+0000 7f9fb3fff640 1 -- 172.21.15.47:0/539190576 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9fc40578e0 con 0x7f9fcc15bd90 2024-04-01T22:34:01.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.762+0000 7f9fb3fff640 1 -- 172.21.15.47:0/539190576 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f9fcc1e3b80 con 0x7f9fcc15bd90 2024-04-01T22:34:01.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:01.982+0000 7f9fd20cd640 1 -- 172.21.15.47:0/539190576 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9fcc0b3e60 con 0x7f9fcc15bd90 2024-04-01T22:34:02.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.015+0000 7f9fb3fff640 1 -- 172.21.15.47:0/539190576 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6835 (secure 0 0 0) 0x7f9fc4059840 con 0x7f9fcc15bd90 2024-04-01T22:34:02.015 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:34:02.015 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4222,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/1297694239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1297694239},{"type":"v1","addr":"172.21.15.181:6835","nonce":1297694239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4225,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/2435310452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":2435310452},{"type":"v1","addr":"172.21.15.181:6837","nonce":2435310452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4228,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1974242436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1974242436},{"type":"v1","addr":"172.21.15.47:6839","nonce":1974242436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/4251771217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":4251771217},{"type":"v1","addr":"172.21.15.47:6837","nonce":4251771217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/1534194215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1534194215},{"type":"v1","addr":"172.21.15.181:6833","nonce":1534194215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-01T22:33:27.610692+0000","modified":"2024-04-01T22:34:00.874320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.47:6835/1610100855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":1610100855},{"type":"v1","addr":"172.21.15.47:6835","nonce":1610100855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4254,"qdb_cluster":[4254]},"id":1}]} 2024-04-01T22:34:02.015 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 9 2024-04-01T22:34:02.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.017+0000 7f9fd20cd640 1 -- 172.21.15.47:0/539190576 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f9fb806b9e0 msgr2=0x7f9fb806dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:02.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.017+0000 7f9fd20cd640 1 --2- 172.21.15.47:0/539190576 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f9fb806b9e0 0x7f9fb806dea0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0005880 tx=0x7f9fc0009040 comp rx=0 tx=0).stop 2024-04-01T22:34:02.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.017+0000 7f9fd20cd640 1 -- 172.21.15.47:0/539190576 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fcc15bd90 msgr2=0x7f9fcc156dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:02.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.017+0000 7f9fd20cd640 1 --2- 172.21.15.47:0/539190576 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fcc15bd90 0x7f9fcc156dd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9fc400c730 tx=0x7f9fc400cbf0 comp rx=0 tx=0).stop 2024-04-01T22:34:02.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.017+0000 7f9fd20cd640 1 -- 172.21.15.47:0/539190576 shutdown_connections 2024-04-01T22:34:02.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.017+0000 7f9fd20cd640 1 --2- 172.21.15.47:0/539190576 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f9fb806b9e0 0x7f9fb806dea0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:02.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.017+0000 7f9fd20cd640 1 --2- 172.21.15.47:0/539190576 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fcc15bd90 0x7f9fcc156dd0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:02.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.017+0000 7f9fd20cd640 1 --2- 172.21.15.47:0/539190576 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9fcc1524d0 0x7f9fcc151810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:02.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.017+0000 7f9fd20cd640 1 --2- 172.21.15.47:0/539190576 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9fcc0ca090 0x7f9fcc0c52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:02.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.018+0000 7f9fd20cd640 1 -- 172.21.15.47:0/539190576 >> 172.21.15.47:0/539190576 conn(0x7f9fcc071330 msgr2=0x7f9fcc156490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:02.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.018+0000 7f9fd20cd640 1 -- 172.21.15.47:0/539190576 shutdown_connections 2024-04-01T22:34:02.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.018+0000 7f9fd20cd640 1 -- 172.21.15.47:0/539190576 wait complete. 2024-04-01T22:34:02.028 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T22:34:02.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.131+0000 7f2ffd655640 1 Processor -- start 2024-04-01T22:34:02.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.131+0000 7f2ffd655640 1 -- start start 2024-04-01T22:34:02.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.132+0000 7f2ffd655640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2ff81524c0 0x7f2ff80c9500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:02.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.132+0000 7f2ffd655640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2ff80c9a40 0x7f2ff815bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:02.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.132+0000 7f2ffd655640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ff81583a0 con 0x7f2ff80ce520 2024-04-01T22:34:02.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.132+0000 7f2ffd655640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f2ff8158150 con 0x7f2ff81524c0 2024-04-01T22:34:02.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.132+0000 7f2ffd655640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f2ff81528a0 con 0x7f2ff80c9a40 2024-04-01T22:34:02.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.133+0000 7f2ff6ffd640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2ff81524c0 0x7f2ff80c9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:02.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.133+0000 7f2ff77fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2ff80c9a40 0x7f2ff815bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:02.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.133+0000 7f2ff6ffd640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2ff81524c0 0x7f2ff80c9500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47646/0 (socket says 172.21.15.47:47646) 2024-04-01T22:34:02.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.133+0000 7f2ff6ffd640 1 -- 172.21.15.47:0/369302517 learned_addr learned my addr 172.21.15.47:0/369302517 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:02.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.135+0000 7f2ff6ffd640 1 -- 172.21.15.47:0/369302517 >> v2:172.21.15.181:3300/0 conn(0x7f2ff80c9a40 msgr2=0x7f2ff815bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:02.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.135+0000 7f2ff6ffd640 1 --2- 172.21.15.47:0/369302517 >> v2:172.21.15.181:3300/0 conn(0x7f2ff80c9a40 0x7f2ff815bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:02.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.135+0000 7f2ff6ffd640 1 -- 172.21.15.47:0/369302517 >> v1:172.21.15.181:6789/0 conn(0x7f2ff80ce520 legacy=0x7f2ff80c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:02.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.135+0000 7f2ff6ffd640 1 -- 172.21.15.47:0/369302517 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ff8158680 con 0x7f2ff81524c0 2024-04-01T22:34:02.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.137+0000 7f2ff6ffd640 1 --2- 172.21.15.47:0/369302517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ff81524c0 0x7f2ff80c9500 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2ff81582d0 tx=0x7f2ff002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9df60b6b90f9fecb server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:02.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.142+0000 7f2ff5ffb640 1 -- 172.21.15.47:0/369302517 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff0034070 con 0x7f2ff81524c0 2024-04-01T22:34:02.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.142+0000 7f2ff5ffb640 1 -- 172.21.15.47:0/369302517 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ff0030860 con 0x7f2ff81524c0 2024-04-01T22:34:02.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.142+0000 7f2ff5ffb640 1 -- 172.21.15.47:0/369302517 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff0030c30 con 0x7f2ff81524c0 2024-04-01T22:34:02.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.143+0000 7f2ffd655640 1 -- 172.21.15.47:0/369302517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ff81524c0 msgr2=0x7f2ff80c9500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:02.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.143+0000 7f2ffd655640 1 --2- 172.21.15.47:0/369302517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ff81524c0 0x7f2ff80c9500 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2ff81582d0 tx=0x7f2ff002b9a0 comp rx=0 tx=0).stop 2024-04-01T22:34:02.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.143+0000 7f2ffd655640 1 -- 172.21.15.47:0/369302517 shutdown_connections 2024-04-01T22:34:02.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.143+0000 7f2ffd655640 1 --2- 172.21.15.47:0/369302517 >> v2:172.21.15.181:3300/0 conn(0x7f2ff80c9a40 0x7f2ff815bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:02.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.143+0000 7f2ffd655640 1 --2- 172.21.15.47:0/369302517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ff81524c0 0x7f2ff80c9500 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:02.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.143+0000 7f2ffd655640 1 -- 172.21.15.47:0/369302517 >> 172.21.15.47:0/369302517 conn(0x7f2ff8061b90 msgr2=0x7f2ff8061fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:02.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.143+0000 7f2ffd655640 1 -- 172.21.15.47:0/369302517 shutdown_connections 2024-04-01T22:34:02.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.143+0000 7f2ffd655640 1 -- 172.21.15.47:0/369302517 wait complete. 2024-04-01T22:34:02.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.144+0000 7f2ffd655640 1 Processor -- start 2024-04-01T22:34:02.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.144+0000 7f2ffd655640 1 -- start start 2024-04-01T22:34:02.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.145+0000 7f2ffd655640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ff80c9a40 0x7f2ff814cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:02.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.145+0000 7f2ffd655640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ff80ce520 0x7f2ff8148bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:02.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.145+0000 7f2ffd655640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ff81524c0 0x7f2ff8149100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:02.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.145+0000 7f2ffd655640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff8158f20 con 0x7f2ff80ce520 2024-04-01T22:34:02.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.145+0000 7f2ffd655640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff8158c40 con 0x7f2ff80c9a40 2024-04-01T22:34:02.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.145+0000 7f2ffd655640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f2ff80c8eb0 con 0x7f2ff81524c0 2024-04-01T22:34:02.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.145+0000 7f2ff67fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ff80ce520 0x7f2ff8148bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:02.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.145+0000 7f2ff6ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ff80c9a40 0x7f2ff814cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:02.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.145+0000 7f2ff77fe640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ff81524c0 0x7f2ff8149100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:02.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.146+0000 7f2ff67fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ff80ce520 0x7f2ff8148bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47652/0 (socket says 172.21.15.47:47652) 2024-04-01T22:34:02.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.146+0000 7f2ff67fc640 1 -- 172.21.15.47:0/3794060777 learned_addr learned my addr 172.21.15.47:0/3794060777 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:02.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.149+0000 7f2ff67fc640 1 -- 172.21.15.47:0/3794060777 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ff81524c0 msgr2=0x7f2ff8149100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:02.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.149+0000 7f2ff67fc640 1 --2- 172.21.15.47:0/3794060777 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ff81524c0 0x7f2ff8149100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:02.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.149+0000 7f2ff67fc640 1 -- 172.21.15.47:0/3794060777 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ff80c9a40 msgr2=0x7f2ff814cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:02.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.149+0000 7f2ff67fc640 1 --2- 172.21.15.47:0/3794060777 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ff80c9a40 0x7f2ff814cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:02.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.149+0000 7f2ff67fc640 1 -- 172.21.15.47:0/3794060777 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ff814a8b0 con 0x7f2ff80ce520 2024-04-01T22:34:02.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.151+0000 7f2ff67fc640 1 --2- 172.21.15.47:0/3794060777 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ff80ce520 0x7f2ff8148bc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2fe000c400 tx=0x7f2fe000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:02.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.155+0000 7f2fef7fe640 1 -- 172.21.15.47:0/3794060777 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe00052d0 con 0x7f2ff80ce520 2024-04-01T22:34:02.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.155+0000 7f2fef7fe640 1 -- 172.21.15.47:0/3794060777 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fe0005490 con 0x7f2ff80ce520 2024-04-01T22:34:02.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.155+0000 7f2ffd655640 1 -- 172.21.15.47:0/3794060777 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ff814ae90 con 0x7f2ff80ce520 2024-04-01T22:34:02.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.155+0000 7f2fef7fe640 1 -- 172.21.15.47:0/3794060777 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe0007260 con 0x7f2ff80ce520 2024-04-01T22:34:02.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.155+0000 7f2ffd655640 1 -- 172.21.15.47:0/3794060777 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ff814b130 con 0x7f2ff80ce520 2024-04-01T22:34:02.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.156+0000 7f2ffd655640 1 -- 172.21.15.47:0/3794060777 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ff80b11a0 con 0x7f2ff80ce520 2024-04-01T22:34:02.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.179+0000 7f2fef7fe640 1 -- 172.21.15.47:0/3794060777 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f2fe0007400 con 0x7f2ff80ce520 2024-04-01T22:34:02.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.180+0000 7f2fef7fe640 1 --2- 172.21.15.47:0/3794060777 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f2fd806ba10 0x7f2fd806ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:02.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.180+0000 7f2ff6ffd640 1 --2- 172.21.15.47:0/3794060777 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f2fd806ba10 0x7f2fd806ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:02.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.180+0000 7f2ff6ffd640 1 --2- 172.21.15.47:0/3794060777 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f2fd806ba10 0x7f2fd806ded0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0036000 tx=0x7f2ff003b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:02.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.469+0000 7f2fef7fe640 1 -- 172.21.15.47:0/3794060777 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2fe0056b90 con 0x7f2ff80ce520 2024-04-01T22:34:02.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.469+0000 7f2fef7fe640 1 -- 172.21.15.47:0/3794060777 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f2ff80b11a0 con 0x7f2ff80ce520 2024-04-01T22:34:02.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.656+0000 7f2ffd655640 1 -- 172.21.15.47:0/3794060777 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2ff80c3390 con 0x7f2ff80ce520 2024-04-01T22:34:02.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.698+0000 7f2fef7fe640 1 -- 172.21.15.47:0/3794060777 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18526 (secure 0 0 0) 0x7f2fe0058af0 con 0x7f2ff80ce520 2024-04-01T22:34:02.698 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:34:02.698 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"fsid":"a6998a48-38bc-4e42-b0d9-04f2fb5c3c87","created":"2024-04-01T22:32:57.112033+0000","modified":"2024-04-01T22:33:33.448062+0000","last_up_change":"2024-04-01T22:33:11.141073+0000","last_in_change":"2024-04-01T22:33:02.650459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T22:33:13.356568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T22:33:25.309421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T22:33:26.268050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-01T22:33:30.588103+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7bd3f25d-e3a5-4932-b381-53dcbb464dde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6811","nonce":3827395709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6813","nonce":3827395709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6817","nonce":3827395709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6815","nonce":3827395709}]},"public_addr":"172.21.15.47:6811/3827395709","cluster_addr":"172.21.15.47:6813/3827395709","heartbeat_back_addr":"172.21.15.47:6817/3827395709","heartbeat_front_addr":"172.21.15.47:6815/3827395709","state":["exists","up"]},{"osd":1,"uuid":"2aa60ba2-67ff-43c7-96c4-82ae2f3855ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6827","nonce":3152157503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6829","nonce":3152157503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6833","nonce":3152157503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6831","nonce":3152157503}]},"public_addr":"172.21.15.47:6827/3152157503","cluster_addr":"172.21.15.47:6829/3152157503","heartbeat_back_addr":"172.21.15.47:6833/3152157503","heartbeat_front_addr":"172.21.15.47:6831/3152157503","state":["exists","up"]},{"osd":2,"uuid":"d83f8a98-6db8-42b7-9ef6-5b16eb9a3492","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6803","nonce":1003968856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6805","nonce":1003968856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6809","nonce":1003968856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6807","nonce":1003968856}]},"public_addr":"172.21.15.47:6803/1003968856","cluster_addr":"172.21.15.47:6805/1003968856","heartbeat_back_addr":"172.21.15.47:6809/1003968856","heartbeat_front_addr":"172.21.15.47:6807/1003968856","state":["exists","up"]},{"osd":3,"uuid":"edc02ed5-d25c-4dc9-a0c3-7a26f20fae07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6819","nonce":2845699561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6821","nonce":2845699561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6825","nonce":2845699561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6823","nonce":2845699561}]},"public_addr":"172.21.15.47:6819/2845699561","cluster_addr":"172.21.15.47:6821/2845699561","heartbeat_back_addr":"172.21.15.47:6825/2845699561","heartbeat_front_addr":"172.21.15.47:6823/2845699561","state":["exists","up"]},{"osd":4,"uuid":"b3d67e74-f51e-4474-9c62-dd0daa60c728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6809","nonce":2961538461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6811","nonce":2961538461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6815","nonce":2961538461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6813","nonce":2961538461}]},"public_addr":"172.21.15.181:6809/2961538461","cluster_addr":"172.21.15.181:6811/2961538461","heartbeat_back_addr":"172.21.15.181:6815/2961538461","heartbeat_front_addr":"172.21.15.181:6813/2961538461","state":["exists","up"]},{"osd":5,"uuid":"d86e8f7a-99f4-4457-9949-cf2cb853e79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6817","nonce":2161566540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6819","nonce":2161566540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6823","nonce":2161566540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6821","nonce":2161566540}]},"public_addr":"172.21.15.181:6817/2161566540","cluster_addr":"172.21.15.181:6819/2161566540","heartbeat_back_addr":"172.21.15.181:6823/2161566540","heartbeat_front_addr":"172.21.15.181:6821/2161566540","state":["exists","up"]},{"osd":6,"uuid":"aa08266c-1719-4abd-afb9-e7e8ac593658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6801","nonce":3792144865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6803","nonce":3792144865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6807","nonce":3792144865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6805","nonce":3792144865}]},"public_addr":"172.21.15.181:6801/3792144865","cluster_addr":"172.21.15.181:6803/3792144865","heartbeat_back_addr":"172.21.15.181:6807/3792144865","heartbeat_front_addr":"172.21.15.181:6805/3792144865","state":["exists","up"]},{"osd":7,"uuid":"6e509762-24c8-46c3-93a1-4c50b11ebcf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6825","nonce":1760995885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6827","nonce":1760995885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6831","nonce":1760995885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6829","nonce":1760995885}]},"public_addr":"172.21.15.181:6825/1760995885","cluster_addr":"172.21.15.181:6827/1760995885","heartbeat_back_addr":"172.21.15.181:6831/1760995885","heartbeat_front_addr":"172.21.15.181:6829/1760995885","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.202426+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.255318+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.170288+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.290065+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.214871+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.176432+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.139940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.299546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T22:34:02.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.700+0000 7f2ffd655640 1 -- 172.21.15.47:0/3794060777 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f2fd806ba10 msgr2=0x7f2fd806ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:02.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.700+0000 7f2ffd655640 1 --2- 172.21.15.47:0/3794060777 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f2fd806ba10 0x7f2fd806ded0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0036000 tx=0x7f2ff003b040 comp rx=0 tx=0).stop 2024-04-01T22:34:02.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.700+0000 7f2ffd655640 1 -- 172.21.15.47:0/3794060777 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ff80ce520 msgr2=0x7f2ff8148bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:02.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.700+0000 7f2ffd655640 1 --2- 172.21.15.47:0/3794060777 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ff80ce520 0x7f2ff8148bc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2fe000c400 tx=0x7f2fe000c8c0 comp rx=0 tx=0).stop 2024-04-01T22:34:02.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.700+0000 7f2ffd655640 1 -- 172.21.15.47:0/3794060777 shutdown_connections 2024-04-01T22:34:02.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.700+0000 7f2ffd655640 1 --2- 172.21.15.47:0/3794060777 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f2fd806ba10 0x7f2fd806ded0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:02.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.700+0000 7f2ffd655640 1 --2- 172.21.15.47:0/3794060777 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ff81524c0 0x7f2ff8149100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:02.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.700+0000 7f2ffd655640 1 --2- 172.21.15.47:0/3794060777 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ff80ce520 0x7f2ff8148bc0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:02.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.700+0000 7f2ffd655640 1 --2- 172.21.15.47:0/3794060777 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ff80c9a40 0x7f2ff814cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:02.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.700+0000 7f2ffd655640 1 -- 172.21.15.47:0/3794060777 >> 172.21.15.47:0/3794060777 conn(0x7f2ff8061b90 msgr2=0x7f2ff80b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:02.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.700+0000 7f2ffd655640 1 -- 172.21.15.47:0/3794060777 shutdown_connections 2024-04-01T22:34:02.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.700+0000 7f2ffd655640 1 -- 172.21.15.47:0/3794060777 wait complete. 2024-04-01T22:34:02.711 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-01T22:34:02.711 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T22:34:02.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.813+0000 7ff1a8e15640 1 Processor -- start 2024-04-01T22:34:02.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.813+0000 7ff1a8e15640 1 -- start start 2024-04-01T22:34:02.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.814+0000 7ff1a8e15640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff1a406c250 0x7ff1a415aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:02.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.814+0000 7ff1a8e15640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1a415bb20 0x7ff1a415bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:02.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.814+0000 7ff1a8e15640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1a4154b70 con 0x7ff1a406c630 2024-04-01T22:34:02.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.814+0000 7ff1a8e15640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7ff1a40ce990 con 0x7ff1a406c250 2024-04-01T22:34:02.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.814+0000 7ff1a8e15640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7ff1a40cdac0 con 0x7ff1a415bb20 2024-04-01T22:34:02.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.815+0000 7ff1a259c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff1a406c250 0x7ff1a415aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:02.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.815+0000 7ff1a2d9d640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1a415bb20 0x7ff1a415bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:02.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.815+0000 7ff1a259c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff1a406c250 0x7ff1a415aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47658/0 (socket says 172.21.15.47:47658) 2024-04-01T22:34:02.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.815+0000 7ff1a259c640 1 -- 172.21.15.47:0/2494699229 learned_addr learned my addr 172.21.15.47:0/2494699229 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:02.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.817+0000 7ff1a2d9d640 1 -- 172.21.15.47:0/2494699229 >> v2:172.21.15.47:3300/0 conn(0x7ff1a406c250 msgr2=0x7ff1a415aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:02.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.817+0000 7ff1a2d9d640 1 --2- 172.21.15.47:0/2494699229 >> v2:172.21.15.47:3300/0 conn(0x7ff1a406c250 0x7ff1a415aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:02.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.817+0000 7ff1a2d9d640 1 -- 172.21.15.47:0/2494699229 >> v1:172.21.15.47:6789/0 conn(0x7ff1a406c630 legacy=0x7ff1a40ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:02.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.817+0000 7ff1a2d9d640 1 -- 172.21.15.47:0/2494699229 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1a40cf2a0 con 0x7ff1a415bb20 2024-04-01T22:34:02.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.819+0000 7ff1a2d9d640 1 --2- 172.21.15.47:0/2494699229 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1a415bb20 0x7ff1a415bf50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff1940097a0 tx=0x7ff19402b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87eea320e8776184 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:02.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.823+0000 7ff1a159a640 1 -- 172.21.15.47:0/2494699229 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff194034070 con 0x7ff1a415bb20 2024-04-01T22:34:02.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.823+0000 7ff1a159a640 1 -- 172.21.15.47:0/2494699229 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff194030610 con 0x7ff1a415bb20 2024-04-01T22:34:02.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.823+0000 7ff1a159a640 1 -- 172.21.15.47:0/2494699229 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1940309e0 con 0x7ff1a415bb20 2024-04-01T22:34:02.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.824+0000 7ff1a8e15640 1 -- 172.21.15.47:0/2494699229 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1a415bb20 msgr2=0x7ff1a415bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:02.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.824+0000 7ff1a8e15640 1 --2- 172.21.15.47:0/2494699229 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1a415bb20 0x7ff1a415bf50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff1940097a0 tx=0x7ff19402b960 comp rx=0 tx=0).stop 2024-04-01T22:34:02.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.824+0000 7ff1a8e15640 1 -- 172.21.15.47:0/2494699229 shutdown_connections 2024-04-01T22:34:02.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.824+0000 7ff1a8e15640 1 --2- 172.21.15.47:0/2494699229 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1a415bb20 0x7ff1a415bf50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:02.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.824+0000 7ff1a8e15640 1 --2- 172.21.15.47:0/2494699229 >> v2:172.21.15.47:3300/0 conn(0x7ff1a406c250 0x7ff1a415aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:02.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.824+0000 7ff1a8e15640 1 -- 172.21.15.47:0/2494699229 >> 172.21.15.47:0/2494699229 conn(0x7ff1a40cfdb0 msgr2=0x7ff1a40d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:02.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.824+0000 7ff1a8e15640 1 -- 172.21.15.47:0/2494699229 shutdown_connections 2024-04-01T22:34:02.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.824+0000 7ff1a8e15640 1 -- 172.21.15.47:0/2494699229 wait complete. 2024-04-01T22:34:02.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.825+0000 7ff1a8e15640 1 Processor -- start 2024-04-01T22:34:02.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.825+0000 7ff1a8e15640 1 -- start start 2024-04-01T22:34:02.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.826+0000 7ff1a8e15640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1a406c250 0x7ff1a4158d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:02.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.826+0000 7ff1a8e15640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1a406c630 0x7ff1a4151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:02.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.826+0000 7ff1a8e15640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1a415bb20 0x7ff1a4152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:02.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.826+0000 7ff1a8e15640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a40ce060 con 0x7ff1a406c630 2024-04-01T22:34:02.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.826+0000 7ff1a8e15640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a40cdd80 con 0x7ff1a415bb20 2024-04-01T22:34:02.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.826+0000 7ff1a8e15640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7ff1a40ce340 con 0x7ff1a406c250 2024-04-01T22:34:02.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.826+0000 7ff1a1d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1a406c630 0x7ff1a4151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:02.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.826+0000 7ff1a259c640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1a406c250 0x7ff1a4158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:02.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.827+0000 7ff1a2d9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1a415bb20 0x7ff1a4152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:02.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.827+0000 7ff1a1d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1a406c630 0x7ff1a4151fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47662/0 (socket says 172.21.15.47:47662) 2024-04-01T22:34:02.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.827+0000 7ff1a1d9b640 1 -- 172.21.15.47:0/3095447389 learned_addr learned my addr 172.21.15.47:0/3095447389 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:02.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.830+0000 7ff1a1d9b640 1 -- 172.21.15.47:0/3095447389 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1a406c250 msgr2=0x7ff1a4158d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:02.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.830+0000 7ff1a1d9b640 1 --2- 172.21.15.47:0/3095447389 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1a406c250 0x7ff1a4158d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:02.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.830+0000 7ff1a1d9b640 1 -- 172.21.15.47:0/3095447389 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1a415bb20 msgr2=0x7ff1a4152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:02.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.830+0000 7ff1a1d9b640 1 --2- 172.21.15.47:0/3095447389 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1a415bb20 0x7ff1a4152500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:02.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.830+0000 7ff1a1d9b640 1 -- 172.21.15.47:0/3095447389 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1a41f4a30 con 0x7ff1a406c630 2024-04-01T22:34:02.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.832+0000 7ff1a1d9b640 1 --2- 172.21.15.47:0/3095447389 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1a406c630 0x7ff1a4151fc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff18c00c430 tx=0x7ff18c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:02.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.834+0000 7ff19affd640 1 -- 172.21.15.47:0/3095447389 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff18c0052d0 con 0x7ff1a406c630 2024-04-01T22:34:02.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.834+0000 7ff1a8e15640 1 -- 172.21.15.47:0/3095447389 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1a40c63c0 con 0x7ff1a406c630 2024-04-01T22:34:02.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.834+0000 7ff1a8e15640 1 -- 172.21.15.47:0/3095447389 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1a40c6660 con 0x7ff1a406c630 2024-04-01T22:34:02.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.835+0000 7ff1a8e15640 1 -- 172.21.15.47:0/3095447389 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1a4068210 con 0x7ff1a406c630 2024-04-01T22:34:02.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.836+0000 7ff19affd640 1 -- 172.21.15.47:0/3095447389 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff18c005470 con 0x7ff1a406c630 2024-04-01T22:34:02.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:02.836+0000 7ff19affd640 1 -- 172.21.15.47:0/3095447389 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff18c020060 con 0x7ff1a406c630 2024-04-01T22:34:03.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.105+0000 7ff19affd640 1 -- 172.21.15.47:0/3095447389 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7ff18c007250 con 0x7ff1a406c630 2024-04-01T22:34:03.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.106+0000 7ff19affd640 1 --2- 172.21.15.47:0/3095447389 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff18406b990 0x7ff18406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:03.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.106+0000 7ff1a259c640 1 --2- 172.21.15.47:0/3095447389 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff18406b990 0x7ff18406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:03.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.106+0000 7ff1a259c640 1 --2- 172.21.15.47:0/3095447389 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff18406b990 0x7ff18406de50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff19c0113e0 tx=0x7ff19c00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:03.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.146+0000 7ff19affd640 1 -- 172.21.15.47:0/3095447389 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff18c0567d0 con 0x7ff1a406c630 2024-04-01T22:34:03.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.146+0000 7ff19affd640 1 -- 172.21.15.47:0/3095447389 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7ff18c058730 con 0x7ff1a406c630 2024-04-01T22:34:03.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.329+0000 7ff1a8e15640 1 -- 172.21.15.47:0/3095447389 --> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff1a40b5b50 con 0x7ff18406b990 2024-04-01T22:34:03.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.338+0000 7ff19affd640 1 -- 172.21.15.47:0/3095447389 <== mgr.4107 v2:172.21.15.47:6800/1257047371 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332614 (secure 0 0 0) 0x7ff1a40b5b50 con 0x7ff18406b990 2024-04-01T22:34:03.341 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:34:03.343 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-01T22:34:03.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.342+0000 7ff1a8e15640 1 -- 172.21.15.47:0/3095447389 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff18406b990 msgr2=0x7ff18406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:03.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.342+0000 7ff1a8e15640 1 --2- 172.21.15.47:0/3095447389 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff18406b990 0x7ff18406de50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff19c0113e0 tx=0x7ff19c00b040 comp rx=0 tx=0).stop 2024-04-01T22:34:03.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.342+0000 7ff1a8e15640 1 -- 172.21.15.47:0/3095447389 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1a406c630 msgr2=0x7ff1a4151fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:03.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.342+0000 7ff1a8e15640 1 --2- 172.21.15.47:0/3095447389 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1a406c630 0x7ff1a4151fc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff18c00c430 tx=0x7ff18c00c8f0 comp rx=0 tx=0).stop 2024-04-01T22:34:03.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.342+0000 7ff1a8e15640 1 -- 172.21.15.47:0/3095447389 shutdown_connections 2024-04-01T22:34:03.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.342+0000 7ff1a8e15640 1 --2- 172.21.15.47:0/3095447389 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff18406b990 0x7ff18406de50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:03.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.342+0000 7ff1a8e15640 1 --2- 172.21.15.47:0/3095447389 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1a415bb20 0x7ff1a4152500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:03.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.342+0000 7ff1a8e15640 1 --2- 172.21.15.47:0/3095447389 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1a406c630 0x7ff1a4151fc0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:03.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.342+0000 7ff1a8e15640 1 --2- 172.21.15.47:0/3095447389 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff1a406c250 0x7ff1a4158d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:03.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.342+0000 7ff1a8e15640 1 -- 172.21.15.47:0/3095447389 >> 172.21.15.47:0/3095447389 conn(0x7ff1a40cfdb0 msgr2=0x7ff1a40c71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:03.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.342+0000 7ff1a8e15640 1 -- 172.21.15.47:0/3095447389 shutdown_connections 2024-04-01T22:34:03.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.342+0000 7ff1a8e15640 1 -- 172.21.15.47:0/3095447389 wait complete. 2024-04-01T22:34:03.352 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2024-04-01T22:34:02.786284+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226760,"kb_used_data":2272,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754747960,"statfs":{"total":773094113280,"available":772861911040,"internally_reserved":0,"allocated":2326528,"data_stored":2029432,"data_compressed":65062,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002400"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951600+0000","last_change":"2024-04-01T22:33:26.849312+0000","last_active":"2024-04-01T22:33:34.951600+0000","last_peered":"2024-04-01T22:33:34.951600+0000","last_clean":"2024-04-01T22:33:34.951600+0000","last_became_active":"2024-04-01T22:33:26.849009+0000","last_became_peered":"2024-04-01T22:33:26.849009+0000","last_unstale":"2024-04-01T22:33:34.951600+0000","last_undegraded":"2024-04-01T22:33:34.951600+0000","last_fullsized":"2024-04-01T22:33:34.951600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:58:40.837557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.888665+0000","last_change":"2024-04-01T22:33:27.919006+0000","last_active":"2024-04-01T22:33:33.888665+0000","last_peered":"2024-04-01T22:33:33.888665+0000","last_clean":"2024-04-01T22:33:33.888665+0000","last_became_active":"2024-04-01T22:33:27.918702+0000","last_became_peered":"2024-04-01T22:33:27.918702+0000","last_unstale":"2024-04-01T22:33:33.888665+0000","last_undegraded":"2024-04-01T22:33:33.888665+0000","last_fullsized":"2024-04-01T22:33:33.888665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:08:00.537270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.888075+0000","last_change":"2024-04-01T22:33:33.255162+0000","last_active":"2024-04-01T22:33:33.888075+0000","last_peered":"2024-04-01T22:33:33.888075+0000","last_clean":"2024-04-01T22:33:33.888075+0000","last_became_active":"2024-04-01T22:33:33.254187+0000","last_became_peered":"2024-04-01T22:33:33.254187+0000","last_unstale":"2024-04-01T22:33:33.888075+0000","last_undegraded":"2024-04-01T22:33:33.888075+0000","last_fullsized":"2024-04-01T22:33:33.888075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:57:12.343606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.888862+0000","last_change":"2024-04-01T22:33:26.855377+0000","last_active":"2024-04-01T22:33:33.888862+0000","last_peered":"2024-04-01T22:33:33.888862+0000","last_clean":"2024-04-01T22:33:33.888862+0000","last_became_active":"2024-04-01T22:33:26.855119+0000","last_became_peered":"2024-04-01T22:33:26.855119+0000","last_unstale":"2024-04-01T22:33:33.888862+0000","last_undegraded":"2024-04-01T22:33:33.888862+0000","last_fullsized":"2024-04-01T22:33:33.888862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:25:41.744696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951260+0000","last_change":"2024-04-01T22:33:27.974175+0000","last_active":"2024-04-01T22:33:34.951260+0000","last_peered":"2024-04-01T22:33:34.951260+0000","last_clean":"2024-04-01T22:33:34.951260+0000","last_became_active":"2024-04-01T22:33:27.973915+0000","last_became_peered":"2024-04-01T22:33:27.973915+0000","last_unstale":"2024-04-01T22:33:34.951260+0000","last_undegraded":"2024-04-01T22:33:34.951260+0000","last_fullsized":"2024-04-01T22:33:34.951260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:43:03.166262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951358+0000","last_change":"2024-04-01T22:33:32.853556+0000","last_active":"2024-04-01T22:33:34.951358+0000","last_peered":"2024-04-01T22:33:34.951358+0000","last_clean":"2024-04-01T22:33:34.951358+0000","last_became_active":"2024-04-01T22:33:32.853215+0000","last_became_peered":"2024-04-01T22:33:32.853215+0000","last_unstale":"2024-04-01T22:33:34.951358+0000","last_undegraded":"2024-04-01T22:33:34.951358+0000","last_fullsized":"2024-04-01T22:33:34.951358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:50:09.812910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952067+0000","last_change":"2024-04-01T22:33:26.849967+0000","last_active":"2024-04-01T22:33:34.952067+0000","last_peered":"2024-04-01T22:33:34.952067+0000","last_clean":"2024-04-01T22:33:34.952067+0000","last_became_active":"2024-04-01T22:33:26.849432+0000","last_became_peered":"2024-04-01T22:33:26.849432+0000","last_unstale":"2024-04-01T22:33:34.952067+0000","last_undegraded":"2024-04-01T22:33:34.952067+0000","last_fullsized":"2024-04-01T22:33:34.952067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:47:18.407469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.928356+0000","last_change":"2024-04-01T22:33:27.972413+0000","last_active":"2024-04-01T22:33:33.928356+0000","last_peered":"2024-04-01T22:33:33.928356+0000","last_clean":"2024-04-01T22:33:33.928356+0000","last_became_active":"2024-04-01T22:33:27.972137+0000","last_became_peered":"2024-04-01T22:33:27.972137+0000","last_unstale":"2024-04-01T22:33:33.928356+0000","last_undegraded":"2024-04-01T22:33:33.928356+0000","last_fullsized":"2024-04-01T22:33:33.928356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:41:45.866834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952448+0000","last_change":"2024-04-01T22:33:32.847230+0000","last_active":"2024-04-01T22:33:34.952448+0000","last_peered":"2024-04-01T22:33:34.952448+0000","last_clean":"2024-04-01T22:33:34.952448+0000","last_became_active":"2024-04-01T22:33:32.846382+0000","last_became_peered":"2024-04-01T22:33:32.846382+0000","last_unstale":"2024-04-01T22:33:34.952448+0000","last_undegraded":"2024-04-01T22:33:34.952448+0000","last_fullsized":"2024-04-01T22:33:34.952448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:41:50.766262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951633+0000","last_change":"2024-04-01T22:33:26.852784+0000","last_active":"2024-04-01T22:33:34.951633+0000","last_peered":"2024-04-01T22:33:34.951633+0000","last_clean":"2024-04-01T22:33:34.951633+0000","last_became_active":"2024-04-01T22:33:26.852530+0000","last_became_peered":"2024-04-01T22:33:26.852530+0000","last_unstale":"2024-04-01T22:33:34.951633+0000","last_undegraded":"2024-04-01T22:33:34.951633+0000","last_fullsized":"2024-04-01T22:33:34.951633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:39:29.846272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.928438+0000","last_change":"2024-04-01T22:33:27.974358+0000","last_active":"2024-04-01T22:33:33.928438+0000","last_peered":"2024-04-01T22:33:33.928438+0000","last_clean":"2024-04-01T22:33:33.928438+0000","last_became_active":"2024-04-01T22:33:27.974117+0000","last_became_peered":"2024-04-01T22:33:27.974117+0000","last_unstale":"2024-04-01T22:33:33.928438+0000","last_undegraded":"2024-04-01T22:33:33.928438+0000","last_fullsized":"2024-04-01T22:33:33.928438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:39:28.692092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951427+0000","last_change":"2024-04-01T22:33:32.844681+0000","last_active":"2024-04-01T22:33:34.951427+0000","last_peered":"2024-04-01T22:33:34.951427+0000","last_clean":"2024-04-01T22:33:34.951427+0000","last_became_active":"2024-04-01T22:33:32.844334+0000","last_became_peered":"2024-04-01T22:33:32.844334+0000","last_unstale":"2024-04-01T22:33:34.951427+0000","last_undegraded":"2024-04-01T22:33:34.951427+0000","last_fullsized":"2024-04-01T22:33:34.951427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:56:30.852155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.460987+0000","last_change":"2024-04-01T22:33:27.918822+0000","last_active":"2024-04-01T22:33:34.460987+0000","last_peered":"2024-04-01T22:33:34.460987+0000","last_clean":"2024-04-01T22:33:34.460987+0000","last_became_active":"2024-04-01T22:33:27.918466+0000","last_became_peered":"2024-04-01T22:33:27.918466+0000","last_unstale":"2024-04-01T22:33:34.460987+0000","last_undegraded":"2024-04-01T22:33:34.460987+0000","last_fullsized":"2024-04-01T22:33:34.460987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:43:57.121738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951812+0000","last_change":"2024-04-01T22:33:26.850443+0000","last_active":"2024-04-01T22:33:34.951812+0000","last_peered":"2024-04-01T22:33:34.951812+0000","last_clean":"2024-04-01T22:33:34.951812+0000","last_became_active":"2024-04-01T22:33:26.849954+0000","last_became_peered":"2024-04-01T22:33:26.849954+0000","last_unstale":"2024-04-01T22:33:34.951812+0000","last_undegraded":"2024-04-01T22:33:34.951812+0000","last_fullsized":"2024-04-01T22:33:34.951812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:49:51.408086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952128+0000","last_change":"2024-04-01T22:33:32.853569+0000","last_active":"2024-04-01T22:33:34.952128+0000","last_peered":"2024-04-01T22:33:34.952128+0000","last_clean":"2024-04-01T22:33:34.952128+0000","last_became_active":"2024-04-01T22:33:32.853185+0000","last_became_peered":"2024-04-01T22:33:32.853185+0000","last_unstale":"2024-04-01T22:33:34.952128+0000","last_undegraded":"2024-04-01T22:33:34.952128+0000","last_fullsized":"2024-04-01T22:33:34.952128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:19:25.147938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.888760+0000","last_change":"2024-04-01T22:33:27.949789+0000","last_active":"2024-04-01T22:33:33.888760+0000","last_peered":"2024-04-01T22:33:33.888760+0000","last_clean":"2024-04-01T22:33:33.888760+0000","last_became_active":"2024-04-01T22:33:27.949518+0000","last_became_peered":"2024-04-01T22:33:27.949518+0000","last_unstale":"2024-04-01T22:33:33.888760+0000","last_undegraded":"2024-04-01T22:33:33.888760+0000","last_fullsized":"2024-04-01T22:33:33.888760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:15:08.500466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952376+0000","last_change":"2024-04-01T22:33:26.856856+0000","last_active":"2024-04-01T22:33:34.952376+0000","last_peered":"2024-04-01T22:33:34.952376+0000","last_clean":"2024-04-01T22:33:34.952376+0000","last_became_active":"2024-04-01T22:33:26.856591+0000","last_became_peered":"2024-04-01T22:33:26.856591+0000","last_unstale":"2024-04-01T22:33:34.952376+0000","last_undegraded":"2024-04-01T22:33:34.952376+0000","last_fullsized":"2024-04-01T22:33:34.952376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:38:14.576161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952740+0000","last_change":"2024-04-01T22:33:32.847352+0000","last_active":"2024-04-01T22:33:34.952740+0000","last_peered":"2024-04-01T22:33:34.952740+0000","last_clean":"2024-04-01T22:33:34.952740+0000","last_became_active":"2024-04-01T22:33:32.846849+0000","last_became_peered":"2024-04-01T22:33:32.846849+0000","last_unstale":"2024-04-01T22:33:34.952740+0000","last_undegraded":"2024-04-01T22:33:34.952740+0000","last_fullsized":"2024-04-01T22:33:34.952740+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:04:48.921372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.888269+0000","last_change":"2024-04-01T22:33:27.855387+0000","last_active":"2024-04-01T22:33:33.888269+0000","last_peered":"2024-04-01T22:33:33.888269+0000","last_clean":"2024-04-01T22:33:33.888269+0000","last_became_active":"2024-04-01T22:33:27.855123+0000","last_became_peered":"2024-04-01T22:33:27.855123+0000","last_unstale":"2024-04-01T22:33:33.888269+0000","last_undegraded":"2024-04-01T22:33:33.888269+0000","last_fullsized":"2024-04-01T22:33:33.888269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:16:58.889368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951872+0000","last_change":"2024-04-01T22:33:26.848128+0000","last_active":"2024-04-01T22:33:34.951872+0000","last_peered":"2024-04-01T22:33:34.951872+0000","last_clean":"2024-04-01T22:33:34.951872+0000","last_became_active":"2024-04-01T22:33:26.847904+0000","last_became_peered":"2024-04-01T22:33:26.847904+0000","last_unstale":"2024-04-01T22:33:34.951872+0000","last_undegraded":"2024-04-01T22:33:34.951872+0000","last_fullsized":"2024-04-01T22:33:34.951872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:41:58.838710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952167+0000","last_change":"2024-04-01T22:33:33.253906+0000","last_active":"2024-04-01T22:33:34.952167+0000","last_peered":"2024-04-01T22:33:34.952167+0000","last_clean":"2024-04-01T22:33:34.952167+0000","last_became_active":"2024-04-01T22:33:33.253475+0000","last_became_peered":"2024-04-01T22:33:33.253475+0000","last_unstale":"2024-04-01T22:33:34.952167+0000","last_undegraded":"2024-04-01T22:33:34.952167+0000","last_fullsized":"2024-04-01T22:33:34.952167+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:28:17.970808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951571+0000","last_change":"2024-04-01T22:33:27.868997+0000","last_active":"2024-04-01T22:33:34.951571+0000","last_peered":"2024-04-01T22:33:34.951571+0000","last_clean":"2024-04-01T22:33:34.951571+0000","last_became_active":"2024-04-01T22:33:27.868713+0000","last_became_peered":"2024-04-01T22:33:27.868713+0000","last_unstale":"2024-04-01T22:33:34.951571+0000","last_undegraded":"2024-04-01T22:33:34.951571+0000","last_fullsized":"2024-04-01T22:33:34.951571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:41:59.967183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951264+0000","last_change":"2024-04-01T22:33:26.848037+0000","last_active":"2024-04-01T22:33:34.951264+0000","last_peered":"2024-04-01T22:33:34.951264+0000","last_clean":"2024-04-01T22:33:34.951264+0000","last_became_active":"2024-04-01T22:33:26.847736+0000","last_became_peered":"2024-04-01T22:33:26.847736+0000","last_unstale":"2024-04-01T22:33:34.951264+0000","last_undegraded":"2024-04-01T22:33:34.951264+0000","last_fullsized":"2024-04-01T22:33:34.951264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:56:04.675231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952414+0000","last_change":"2024-04-01T22:33:32.847015+0000","last_active":"2024-04-01T22:33:34.952414+0000","last_peered":"2024-04-01T22:33:34.952414+0000","last_clean":"2024-04-01T22:33:34.952414+0000","last_became_active":"2024-04-01T22:33:32.846639+0000","last_became_peered":"2024-04-01T22:33:32.846639+0000","last_unstale":"2024-04-01T22:33:34.952414+0000","last_undegraded":"2024-04-01T22:33:34.952414+0000","last_fullsized":"2024-04-01T22:33:34.952414+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:47:09.903506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951861+0000","last_change":"2024-04-01T22:33:27.948117+0000","last_active":"2024-04-01T22:33:34.951861+0000","last_peered":"2024-04-01T22:33:34.951861+0000","last_clean":"2024-04-01T22:33:34.951861+0000","last_became_active":"2024-04-01T22:33:27.947735+0000","last_became_peered":"2024-04-01T22:33:27.947735+0000","last_unstale":"2024-04-01T22:33:34.951861+0000","last_undegraded":"2024-04-01T22:33:34.951861+0000","last_fullsized":"2024-04-01T22:33:34.951861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:16:58.889368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.461561+0000","last_change":"2024-04-01T22:33:26.849404+0000","last_active":"2024-04-01T22:33:34.461561+0000","last_peered":"2024-04-01T22:33:34.461561+0000","last_clean":"2024-04-01T22:33:34.461561+0000","last_became_active":"2024-04-01T22:33:26.849086+0000","last_became_peered":"2024-04-01T22:33:26.849086+0000","last_unstale":"2024-04-01T22:33:34.461561+0000","last_undegraded":"2024-04-01T22:33:34.461561+0000","last_fullsized":"2024-04-01T22:33:34.461561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:41:58.838710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951479+0000","last_change":"2024-04-01T22:33:33.249726+0000","last_active":"2024-04-01T22:33:34.951479+0000","last_peered":"2024-04-01T22:33:34.951479+0000","last_clean":"2024-04-01T22:33:34.951479+0000","last_became_active":"2024-04-01T22:33:33.249309+0000","last_became_peered":"2024-04-01T22:33:33.249309+0000","last_unstale":"2024-04-01T22:33:34.951479+0000","last_undegraded":"2024-04-01T22:33:34.951479+0000","last_fullsized":"2024-04-01T22:33:34.951479+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:08:20.364843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.889100+0000","last_change":"2024-04-01T22:33:27.879797+0000","last_active":"2024-04-01T22:33:33.889100+0000","last_peered":"2024-04-01T22:33:33.889100+0000","last_clean":"2024-04-01T22:33:33.889100+0000","last_became_active":"2024-04-01T22:33:27.879582+0000","last_became_peered":"2024-04-01T22:33:27.879582+0000","last_unstale":"2024-04-01T22:33:33.889100+0000","last_undegraded":"2024-04-01T22:33:33.889100+0000","last_fullsized":"2024-04-01T22:33:33.889100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:08:15.465415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951594+0000","last_change":"2024-04-01T22:33:26.847504+0000","last_active":"2024-04-01T22:33:34.951594+0000","last_peered":"2024-04-01T22:33:34.951594+0000","last_clean":"2024-04-01T22:33:34.951594+0000","last_became_active":"2024-04-01T22:33:26.847333+0000","last_became_peered":"2024-04-01T22:33:26.847333+0000","last_unstale":"2024-04-01T22:33:34.951594+0000","last_undegraded":"2024-04-01T22:33:34.951594+0000","last_fullsized":"2024-04-01T22:33:34.951594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:39:29.846272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.888017+0000","last_change":"2024-04-01T22:33:33.255030+0000","last_active":"2024-04-01T22:33:33.888017+0000","last_peered":"2024-04-01T22:33:33.888017+0000","last_clean":"2024-04-01T22:33:33.888017+0000","last_became_active":"2024-04-01T22:33:33.254621+0000","last_became_peered":"2024-04-01T22:33:33.254621+0000","last_unstale":"2024-04-01T22:33:33.888017+0000","last_undegraded":"2024-04-01T22:33:33.888017+0000","last_fullsized":"2024-04-01T22:33:33.888017+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:19:44.325870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951942+0000","last_change":"2024-04-01T22:33:27.855669+0000","last_active":"2024-04-01T22:33:34.951942+0000","last_peered":"2024-04-01T22:33:34.951942+0000","last_clean":"2024-04-01T22:33:34.951942+0000","last_became_active":"2024-04-01T22:33:27.855419+0000","last_became_peered":"2024-04-01T22:33:27.855419+0000","last_unstale":"2024-04-01T22:33:34.951942+0000","last_undegraded":"2024-04-01T22:33:34.951942+0000","last_fullsized":"2024-04-01T22:33:34.951942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:15:46.224658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952173+0000","last_change":"2024-04-01T22:33:26.850176+0000","last_active":"2024-04-01T22:33:34.952173+0000","last_peered":"2024-04-01T22:33:34.952173+0000","last_clean":"2024-04-01T22:33:34.952173+0000","last_became_active":"2024-04-01T22:33:26.849717+0000","last_became_peered":"2024-04-01T22:33:26.849717+0000","last_unstale":"2024-04-01T22:33:34.952173+0000","last_undegraded":"2024-04-01T22:33:34.952173+0000","last_fullsized":"2024-04-01T22:33:34.952173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:18:55.842886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951488+0000","last_change":"2024-04-01T22:33:33.249765+0000","last_active":"2024-04-01T22:33:34.951488+0000","last_peered":"2024-04-01T22:33:34.951488+0000","last_clean":"2024-04-01T22:33:34.951488+0000","last_became_active":"2024-04-01T22:33:33.249370+0000","last_became_peered":"2024-04-01T22:33:33.249370+0000","last_unstale":"2024-04-01T22:33:34.951488+0000","last_undegraded":"2024-04-01T22:33:34.951488+0000","last_fullsized":"2024-04-01T22:33:34.951488+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:41:50.766262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.928517+0000","last_change":"2024-04-01T22:33:27.979163+0000","last_active":"2024-04-01T22:33:33.928517+0000","last_peered":"2024-04-01T22:33:33.928517+0000","last_clean":"2024-04-01T22:33:33.928517+0000","last_became_active":"2024-04-01T22:33:27.978902+0000","last_became_peered":"2024-04-01T22:33:27.978902+0000","last_unstale":"2024-04-01T22:33:33.928517+0000","last_undegraded":"2024-04-01T22:33:33.928517+0000","last_fullsized":"2024-04-01T22:33:33.928517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:04:44.021944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952024+0000","last_change":"2024-04-01T22:33:26.846575+0000","last_active":"2024-04-01T22:33:34.952024+0000","last_peered":"2024-04-01T22:33:34.952024+0000","last_clean":"2024-04-01T22:33:34.952024+0000","last_became_active":"2024-04-01T22:33:26.846265+0000","last_became_peered":"2024-04-01T22:33:26.846265+0000","last_unstale":"2024-04-01T22:33:34.952024+0000","last_undegraded":"2024-04-01T22:33:34.952024+0000","last_fullsized":"2024-04-01T22:33:34.952024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:56:04.675231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952099+0000","last_change":"2024-04-01T22:33:32.850553+0000","last_active":"2024-04-01T22:33:34.952099+0000","last_peered":"2024-04-01T22:33:34.952099+0000","last_clean":"2024-04-01T22:33:34.952099+0000","last_became_active":"2024-04-01T22:33:32.849774+0000","last_became_peered":"2024-04-01T22:33:32.849774+0000","last_unstale":"2024-04-01T22:33:34.952099+0000","last_undegraded":"2024-04-01T22:33:34.952099+0000","last_fullsized":"2024-04-01T22:33:34.952099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:04:48.921372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952536+0000","last_change":"2024-04-01T22:33:27.949879+0000","last_active":"2024-04-01T22:33:34.952536+0000","last_peered":"2024-04-01T22:33:34.952536+0000","last_clean":"2024-04-01T22:33:34.952536+0000","last_became_active":"2024-04-01T22:33:27.949620+0000","last_became_peered":"2024-04-01T22:33:27.949620+0000","last_unstale":"2024-04-01T22:33:34.952536+0000","last_undegraded":"2024-04-01T22:33:34.952536+0000","last_fullsized":"2024-04-01T22:33:34.952536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:49:52.536559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.928411+0000","last_change":"2024-04-01T22:33:26.846346+0000","last_active":"2024-04-01T22:33:33.928411+0000","last_peered":"2024-04-01T22:33:33.928411+0000","last_clean":"2024-04-01T22:33:33.928411+0000","last_became_active":"2024-04-01T22:33:26.846052+0000","last_became_peered":"2024-04-01T22:33:26.846052+0000","last_unstale":"2024-04-01T22:33:33.928411+0000","last_undegraded":"2024-04-01T22:33:33.928411+0000","last_fullsized":"2024-04-01T22:33:33.928411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:41:58.838710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951663+0000","last_change":"2024-04-01T22:33:32.846766+0000","last_active":"2024-04-01T22:33:34.951663+0000","last_peered":"2024-04-01T22:33:34.951663+0000","last_clean":"2024-04-01T22:33:34.951663+0000","last_became_active":"2024-04-01T22:33:32.846422+0000","last_became_peered":"2024-04-01T22:33:32.846422+0000","last_unstale":"2024-04-01T22:33:34.951663+0000","last_undegraded":"2024-04-01T22:33:34.951663+0000","last_fullsized":"2024-04-01T22:33:34.951663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:41:50.766262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.950991+0000","last_change":"2024-04-01T22:33:27.855299+0000","last_active":"2024-04-01T22:33:34.950991+0000","last_peered":"2024-04-01T22:33:34.950991+0000","last_clean":"2024-04-01T22:33:34.950991+0000","last_became_active":"2024-04-01T22:33:27.855035+0000","last_became_peered":"2024-04-01T22:33:27.855035+0000","last_unstale":"2024-04-01T22:33:34.950991+0000","last_undegraded":"2024-04-01T22:33:34.950991+0000","last_fullsized":"2024-04-01T22:33:34.950991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:48:53.083180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.922839+0000","last_change":"2024-04-01T22:33:26.856300+0000","last_active":"2024-04-01T22:33:33.922839+0000","last_peered":"2024-04-01T22:33:33.922839+0000","last_clean":"2024-04-01T22:33:33.922839+0000","last_became_active":"2024-04-01T22:33:26.855864+0000","last_became_peered":"2024-04-01T22:33:26.855864+0000","last_unstale":"2024-04-01T22:33:33.922839+0000","last_undegraded":"2024-04-01T22:33:33.922839+0000","last_fullsized":"2024-04-01T22:33:33.922839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:38:14.576161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952162+0000","last_change":"2024-04-01T22:33:32.851818+0000","last_active":"2024-04-01T22:33:34.952162+0000","last_peered":"2024-04-01T22:33:34.952162+0000","last_clean":"2024-04-01T22:33:34.952162+0000","last_became_active":"2024-04-01T22:33:32.851388+0000","last_became_peered":"2024-04-01T22:33:32.851388+0000","last_unstale":"2024-04-01T22:33:34.952162+0000","last_undegraded":"2024-04-01T22:33:34.952162+0000","last_fullsized":"2024-04-01T22:33:34.952162+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:43:44.388503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951164+0000","last_change":"2024-04-01T22:33:27.949013+0000","last_active":"2024-04-01T22:33:34.951164+0000","last_peered":"2024-04-01T22:33:34.951164+0000","last_clean":"2024-04-01T22:33:34.951164+0000","last_became_active":"2024-04-01T22:33:27.948687+0000","last_became_peered":"2024-04-01T22:33:27.948687+0000","last_unstale":"2024-04-01T22:33:34.951164+0000","last_undegraded":"2024-04-01T22:33:34.951164+0000","last_fullsized":"2024-04-01T22:33:34.951164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:50:54.852207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951378+0000","last_change":"2024-04-01T22:33:26.848366+0000","last_active":"2024-04-01T22:33:34.951378+0000","last_peered":"2024-04-01T22:33:34.951378+0000","last_clean":"2024-04-01T22:33:34.951378+0000","last_became_active":"2024-04-01T22:33:26.848019+0000","last_became_peered":"2024-04-01T22:33:26.848019+0000","last_unstale":"2024-04-01T22:33:34.951378+0000","last_undegraded":"2024-04-01T22:33:34.951378+0000","last_fullsized":"2024-04-01T22:33:34.951378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:41:58.838710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951754+0000","last_change":"2024-04-01T22:33:33.253077+0000","last_active":"2024-04-01T22:33:34.951754+0000","last_peered":"2024-04-01T22:33:34.951754+0000","last_clean":"2024-04-01T22:33:34.951754+0000","last_became_active":"2024-04-01T22:33:33.252725+0000","last_became_peered":"2024-04-01T22:33:33.252725+0000","last_unstale":"2024-04-01T22:33:34.951754+0000","last_undegraded":"2024-04-01T22:33:34.951754+0000","last_fullsized":"2024-04-01T22:33:34.951754+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:28:17.970808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.888333+0000","last_change":"2024-04-01T22:33:27.975039+0000","last_active":"2024-04-01T22:33:33.888333+0000","last_peered":"2024-04-01T22:33:33.888333+0000","last_clean":"2024-04-01T22:33:33.888333+0000","last_became_active":"2024-04-01T22:33:27.974751+0000","last_became_peered":"2024-04-01T22:33:27.974751+0000","last_unstale":"2024-04-01T22:33:33.888333+0000","last_undegraded":"2024-04-01T22:33:33.888333+0000","last_fullsized":"2024-04-01T22:33:33.888333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:43:03.166262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.928301+0000","last_change":"2024-04-01T22:33:26.831690+0000","last_active":"2024-04-01T22:33:33.928301+0000","last_peered":"2024-04-01T22:33:33.928301+0000","last_clean":"2024-04-01T22:33:33.928301+0000","last_became_active":"2024-04-01T22:33:26.831398+0000","last_became_peered":"2024-04-01T22:33:26.831398+0000","last_unstale":"2024-04-01T22:33:33.928301+0000","last_undegraded":"2024-04-01T22:33:33.928301+0000","last_fullsized":"2024-04-01T22:33:33.928301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:38:14.576161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951493+0000","last_change":"2024-04-01T22:33:15.962585+0000","last_active":"2024-04-01T22:33:34.951493+0000","last_peered":"2024-04-01T22:33:34.951493+0000","last_clean":"2024-04-01T22:33:34.951493+0000","last_became_active":"2024-04-01T22:33:15.961762+0000","last_became_peered":"2024-04-01T22:33:15.961762+0000","last_unstale":"2024-04-01T22:33:34.951493+0000","last_undegraded":"2024-04-01T22:33:34.951493+0000","last_fullsized":"2024-04-01T22:33:34.951493+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:13.756389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:13.756389+0000","last_clean_scrub_stamp":"2024-04-01T22:33:13.756389+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:33:28.684533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.461330+0000","last_change":"2024-04-01T22:33:33.252863+0000","last_active":"2024-04-01T22:33:34.461330+0000","last_peered":"2024-04-01T22:33:34.461330+0000","last_clean":"2024-04-01T22:33:34.461330+0000","last_became_active":"2024-04-01T22:33:33.252494+0000","last_became_peered":"2024-04-01T22:33:33.252494+0000","last_unstale":"2024-04-01T22:33:34.461330+0000","last_undegraded":"2024-04-01T22:33:34.461330+0000","last_fullsized":"2024-04-01T22:33:34.461330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:47:09.903506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951975+0000","last_change":"2024-04-01T22:33:27.975195+0000","last_active":"2024-04-01T22:33:34.951975+0000","last_peered":"2024-04-01T22:33:34.951975+0000","last_clean":"2024-04-01T22:33:34.951975+0000","last_became_active":"2024-04-01T22:33:27.974949+0000","last_became_peered":"2024-04-01T22:33:27.974949+0000","last_unstale":"2024-04-01T22:33:34.951975+0000","last_undegraded":"2024-04-01T22:33:34.951975+0000","last_fullsized":"2024-04-01T22:33:34.951975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:08:15.465415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.922990+0000","last_change":"2024-04-01T22:33:26.832331+0000","last_active":"2024-04-01T22:33:33.922990+0000","last_peered":"2024-04-01T22:33:33.922990+0000","last_clean":"2024-04-01T22:33:33.922990+0000","last_became_active":"2024-04-01T22:33:26.832078+0000","last_became_peered":"2024-04-01T22:33:26.832078+0000","last_unstale":"2024-04-01T22:33:33.922990+0000","last_undegraded":"2024-04-01T22:33:33.922990+0000","last_fullsized":"2024-04-01T22:33:33.922990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:40:49.124240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.461078+0000","last_change":"2024-04-01T22:33:33.249696+0000","last_active":"2024-04-01T22:33:34.461078+0000","last_peered":"2024-04-01T22:33:34.461078+0000","last_clean":"2024-04-01T22:33:34.461078+0000","last_became_active":"2024-04-01T22:33:33.249313+0000","last_became_peered":"2024-04-01T22:33:33.249313+0000","last_unstale":"2024-04-01T22:33:34.461078+0000","last_undegraded":"2024-04-01T22:33:34.461078+0000","last_fullsized":"2024-04-01T22:33:34.461078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:39:33.591520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.928417+0000","last_change":"2024-04-01T22:33:27.971916+0000","last_active":"2024-04-01T22:33:33.928417+0000","last_peered":"2024-04-01T22:33:33.928417+0000","last_clean":"2024-04-01T22:33:33.928417+0000","last_became_active":"2024-04-01T22:33:27.971672+0000","last_became_peered":"2024-04-01T22:33:27.971672+0000","last_unstale":"2024-04-01T22:33:33.928417+0000","last_undegraded":"2024-04-01T22:33:33.928417+0000","last_fullsized":"2024-04-01T22:33:33.928417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:43:39.489075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952091+0000","last_change":"2024-04-01T22:33:26.849350+0000","last_active":"2024-04-01T22:33:34.952091+0000","last_peered":"2024-04-01T22:33:34.952091+0000","last_clean":"2024-04-01T22:33:34.952091+0000","last_became_active":"2024-04-01T22:33:26.849098+0000","last_became_peered":"2024-04-01T22:33:26.849098+0000","last_unstale":"2024-04-01T22:33:34.952091+0000","last_undegraded":"2024-04-01T22:33:34.952091+0000","last_fullsized":"2024-04-01T22:33:34.952091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:47:18.407469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951759+0000","last_change":"2024-04-01T22:33:32.847889+0000","last_active":"2024-04-01T22:33:34.951759+0000","last_peered":"2024-04-01T22:33:34.951759+0000","last_clean":"2024-04-01T22:33:34.951759+0000","last_became_active":"2024-04-01T22:33:32.847546+0000","last_became_peered":"2024-04-01T22:33:32.847546+0000","last_unstale":"2024-04-01T22:33:34.951759+0000","last_undegraded":"2024-04-01T22:33:34.951759+0000","last_fullsized":"2024-04-01T22:33:34.951759+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:57:05.158344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952378+0000","last_change":"2024-04-01T22:33:27.881170+0000","last_active":"2024-04-01T22:33:34.952378+0000","last_peered":"2024-04-01T22:33:34.952378+0000","last_clean":"2024-04-01T22:33:34.952378+0000","last_became_active":"2024-04-01T22:33:27.880870+0000","last_became_peered":"2024-04-01T22:33:27.880870+0000","last_unstale":"2024-04-01T22:33:34.952378+0000","last_undegraded":"2024-04-01T22:33:34.952378+0000","last_fullsized":"2024-04-01T22:33:34.952378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:43:39.489075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.923189+0000","last_change":"2024-04-01T22:33:26.856069+0000","last_active":"2024-04-01T22:33:33.923189+0000","last_peered":"2024-04-01T22:33:33.923189+0000","last_clean":"2024-04-01T22:33:33.923189+0000","last_became_active":"2024-04-01T22:33:26.855705+0000","last_became_peered":"2024-04-01T22:33:26.855705+0000","last_unstale":"2024-04-01T22:33:33.923189+0000","last_undegraded":"2024-04-01T22:33:33.923189+0000","last_fullsized":"2024-04-01T22:33:33.923189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:56:04.675231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.927900+0000","last_change":"2024-04-01T22:33:33.249689+0000","last_active":"2024-04-01T22:33:33.927900+0000","last_peered":"2024-04-01T22:33:33.927900+0000","last_clean":"2024-04-01T22:33:33.927900+0000","last_became_active":"2024-04-01T22:33:33.249315+0000","last_became_peered":"2024-04-01T22:33:33.249315+0000","last_unstale":"2024-04-01T22:33:33.927900+0000","last_undegraded":"2024-04-01T22:33:33.927900+0000","last_fullsized":"2024-04-01T22:33:33.927900+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:19:44.325870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952043+0000","last_change":"2024-04-01T22:33:27.881320+0000","last_active":"2024-04-01T22:33:34.952043+0000","last_peered":"2024-04-01T22:33:34.952043+0000","last_clean":"2024-04-01T22:33:34.952043+0000","last_became_active":"2024-04-01T22:33:27.880973+0000","last_became_peered":"2024-04-01T22:33:27.880973+0000","last_unstale":"2024-04-01T22:33:34.952043+0000","last_undegraded":"2024-04-01T22:33:34.952043+0000","last_fullsized":"2024-04-01T22:33:34.952043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:04:44.021944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952736+0000","last_change":"2024-04-01T22:33:26.845121+0000","last_active":"2024-04-01T22:33:34.952736+0000","last_peered":"2024-04-01T22:33:34.952736+0000","last_clean":"2024-04-01T22:33:34.952736+0000","last_became_active":"2024-04-01T22:33:26.844852+0000","last_became_peered":"2024-04-01T22:33:26.844852+0000","last_unstale":"2024-04-01T22:33:34.952736+0000","last_undegraded":"2024-04-01T22:33:34.952736+0000","last_fullsized":"2024-04-01T22:33:34.952736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:58:40.837557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951215+0000","last_change":"2024-04-01T22:33:32.846922+0000","last_active":"2024-04-01T22:33:34.951215+0000","last_peered":"2024-04-01T22:33:34.951215+0000","last_clean":"2024-04-01T22:33:34.951215+0000","last_became_active":"2024-04-01T22:33:32.846387+0000","last_became_peered":"2024-04-01T22:33:32.846387+0000","last_unstale":"2024-04-01T22:33:34.951215+0000","last_undegraded":"2024-04-01T22:33:34.951215+0000","last_fullsized":"2024-04-01T22:33:34.951215+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:08:05.436698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951684+0000","last_change":"2024-04-01T22:33:27.884447+0000","last_active":"2024-04-01T22:33:34.951684+0000","last_peered":"2024-04-01T22:33:34.951684+0000","last_clean":"2024-04-01T22:33:34.951684+0000","last_became_active":"2024-04-01T22:33:27.884148+0000","last_became_peered":"2024-04-01T22:33:27.884148+0000","last_unstale":"2024-04-01T22:33:34.951684+0000","last_undegraded":"2024-04-01T22:33:34.951684+0000","last_fullsized":"2024-04-01T22:33:34.951684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:08:00.537270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.922675+0000","last_change":"2024-04-01T22:33:26.844884+0000","last_active":"2024-04-01T22:33:33.922675+0000","last_peered":"2024-04-01T22:33:33.922675+0000","last_clean":"2024-04-01T22:33:33.922675+0000","last_became_active":"2024-04-01T22:33:26.844583+0000","last_became_peered":"2024-04-01T22:33:26.844583+0000","last_unstale":"2024-04-01T22:33:33.922675+0000","last_undegraded":"2024-04-01T22:33:33.922675+0000","last_fullsized":"2024-04-01T22:33:33.922675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:25:41.744696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951498+0000","last_change":"2024-04-01T22:33:32.845036+0000","last_active":"2024-04-01T22:33:34.951498+0000","last_peered":"2024-04-01T22:33:34.951498+0000","last_clean":"2024-04-01T22:33:34.951498+0000","last_became_active":"2024-04-01T22:33:32.844555+0000","last_became_peered":"2024-04-01T22:33:32.844555+0000","last_unstale":"2024-04-01T22:33:34.951498+0000","last_undegraded":"2024-04-01T22:33:34.951498+0000","last_fullsized":"2024-04-01T22:33:34.951498+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:43:44.388503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.461062+0000","last_change":"2024-04-01T22:33:27.950227+0000","last_active":"2024-04-01T22:33:34.461062+0000","last_peered":"2024-04-01T22:33:34.461062+0000","last_clean":"2024-04-01T22:33:34.461062+0000","last_became_active":"2024-04-01T22:33:27.949366+0000","last_became_peered":"2024-04-01T22:33:27.949366+0000","last_unstale":"2024-04-01T22:33:34.461062+0000","last_undegraded":"2024-04-01T22:33:34.461062+0000","last_fullsized":"2024-04-01T22:33:34.461062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:16:58.889368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.461092+0000","last_change":"2024-04-01T22:33:26.830463+0000","last_active":"2024-04-01T22:33:34.461092+0000","last_peered":"2024-04-01T22:33:34.461092+0000","last_clean":"2024-04-01T22:33:34.461092+0000","last_became_active":"2024-04-01T22:33:26.830179+0000","last_became_peered":"2024-04-01T22:33:26.830179+0000","last_unstale":"2024-04-01T22:33:34.461092+0000","last_undegraded":"2024-04-01T22:33:34.461092+0000","last_fullsized":"2024-04-01T22:33:34.461092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:38:14.576161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.889068+0000","last_change":"2024-04-01T22:33:33.252812+0000","last_active":"2024-04-01T22:33:33.889068+0000","last_peered":"2024-04-01T22:33:33.889068+0000","last_clean":"2024-04-01T22:33:33.889068+0000","last_became_active":"2024-04-01T22:33:33.252412+0000","last_became_peered":"2024-04-01T22:33:33.252412+0000","last_unstale":"2024-04-01T22:33:33.889068+0000","last_undegraded":"2024-04-01T22:33:33.889068+0000","last_fullsized":"2024-04-01T22:33:33.889068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:53:38.442260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951687+0000","last_change":"2024-04-01T22:33:27.880363+0000","last_active":"2024-04-01T22:33:34.951687+0000","last_peered":"2024-04-01T22:33:34.951687+0000","last_clean":"2024-04-01T22:33:34.951687+0000","last_became_active":"2024-04-01T22:33:27.880096+0000","last_became_peered":"2024-04-01T22:33:27.880096+0000","last_unstale":"2024-04-01T22:33:34.951687+0000","last_undegraded":"2024-04-01T22:33:34.951687+0000","last_fullsized":"2024-04-01T22:33:34.951687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:19:20.248510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.928312+0000","last_change":"2024-04-01T22:33:26.855823+0000","last_active":"2024-04-01T22:33:33.928312+0000","last_peered":"2024-04-01T22:33:33.928312+0000","last_clean":"2024-04-01T22:33:33.928312+0000","last_became_active":"2024-04-01T22:33:26.855475+0000","last_became_peered":"2024-04-01T22:33:26.855475+0000","last_unstale":"2024-04-01T22:33:33.928312+0000","last_undegraded":"2024-04-01T22:33:33.928312+0000","last_fullsized":"2024-04-01T22:33:33.928312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:39:29.846272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.888468+0000","last_change":"2024-04-01T22:33:33.249941+0000","last_active":"2024-04-01T22:33:33.888468+0000","last_peered":"2024-04-01T22:33:33.888468+0000","last_clean":"2024-04-01T22:33:33.888468+0000","last_became_active":"2024-04-01T22:33:33.249352+0000","last_became_peered":"2024-04-01T22:33:33.249352+0000","last_unstale":"2024-04-01T22:33:33.888468+0000","last_undegraded":"2024-04-01T22:33:33.888468+0000","last_fullsized":"2024-04-01T22:33:33.888468+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:36:10.226231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951586+0000","last_change":"2024-04-01T22:33:27.948988+0000","last_active":"2024-04-01T22:33:34.951586+0000","last_peered":"2024-04-01T22:33:34.951586+0000","last_clean":"2024-04-01T22:33:34.951586+0000","last_became_active":"2024-04-01T22:33:27.948691+0000","last_became_peered":"2024-04-01T22:33:27.948691+0000","last_unstale":"2024-04-01T22:33:34.951586+0000","last_undegraded":"2024-04-01T22:33:34.951586+0000","last_fullsized":"2024-04-01T22:33:34.951586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:23:08.563134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952149+0000","last_change":"2024-04-01T22:33:26.849911+0000","last_active":"2024-04-01T22:33:34.952149+0000","last_peered":"2024-04-01T22:33:34.952149+0000","last_clean":"2024-04-01T22:33:34.952149+0000","last_became_active":"2024-04-01T22:33:26.849646+0000","last_became_peered":"2024-04-01T22:33:26.849646+0000","last_unstale":"2024-04-01T22:33:34.952149+0000","last_undegraded":"2024-04-01T22:33:34.952149+0000","last_fullsized":"2024-04-01T22:33:34.952149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:29:59.992702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.928541+0000","last_change":"2024-04-01T22:33:33.250214+0000","last_active":"2024-04-01T22:33:33.928541+0000","last_peered":"2024-04-01T22:33:33.928541+0000","last_clean":"2024-04-01T22:33:33.928541+0000","last_became_active":"2024-04-01T22:33:33.249853+0000","last_became_peered":"2024-04-01T22:33:33.249853+0000","last_unstale":"2024-04-01T22:33:33.928541+0000","last_undegraded":"2024-04-01T22:33:33.928541+0000","last_fullsized":"2024-04-01T22:33:33.928541+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:57:12.343606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951878+0000","last_change":"2024-04-01T22:33:27.881155+0000","last_active":"2024-04-01T22:33:34.951878+0000","last_peered":"2024-04-01T22:33:34.951878+0000","last_clean":"2024-04-01T22:33:34.951878+0000","last_became_active":"2024-04-01T22:33:27.880881+0000","last_became_peered":"2024-04-01T22:33:27.880881+0000","last_unstale":"2024-04-01T22:33:34.951878+0000","last_undegraded":"2024-04-01T22:33:34.951878+0000","last_fullsized":"2024-04-01T22:33:34.951878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:47:05.004078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:50.387811+0000","last_change":"2024-04-01T22:33:26.855687+0000","last_active":"2024-04-01T22:33:50.387811+0000","last_peered":"2024-04-01T22:33:50.387811+0000","last_clean":"2024-04-01T22:33:50.387811+0000","last_became_active":"2024-04-01T22:33:26.855400+0000","last_became_peered":"2024-04-01T22:33:26.855400+0000","last_unstale":"2024-04-01T22:33:50.387811+0000","last_undegraded":"2024-04-01T22:33:50.387811+0000","last_fullsized":"2024-04-01T22:33:50.387811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:39:29.846272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952386+0000","last_change":"2024-04-01T22:33:32.846727+0000","last_active":"2024-04-01T22:33:34.952386+0000","last_peered":"2024-04-01T22:33:34.952386+0000","last_clean":"2024-04-01T22:33:34.952386+0000","last_became_active":"2024-04-01T22:33:32.846156+0000","last_became_peered":"2024-04-01T22:33:32.846156+0000","last_unstale":"2024-04-01T22:33:34.952386+0000","last_undegraded":"2024-04-01T22:33:34.952386+0000","last_fullsized":"2024-04-01T22:33:34.952386+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:57:05.158344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952804+0000","last_change":"2024-04-01T22:33:27.879445+0000","last_active":"2024-04-01T22:33:34.952804+0000","last_peered":"2024-04-01T22:33:34.952804+0000","last_clean":"2024-04-01T22:33:34.952804+0000","last_became_active":"2024-04-01T22:33:27.879165+0000","last_became_peered":"2024-04-01T22:33:27.879165+0000","last_unstale":"2024-04-01T22:33:34.952804+0000","last_undegraded":"2024-04-01T22:33:34.952804+0000","last_fullsized":"2024-04-01T22:33:34.952804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:18:56.971360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951928+0000","last_change":"2024-04-01T22:33:26.851767+0000","last_active":"2024-04-01T22:33:34.951928+0000","last_peered":"2024-04-01T22:33:34.951928+0000","last_clean":"2024-04-01T22:33:34.951928+0000","last_became_active":"2024-04-01T22:33:26.851489+0000","last_became_peered":"2024-04-01T22:33:26.851489+0000","last_unstale":"2024-04-01T22:33:34.951928+0000","last_undegraded":"2024-04-01T22:33:34.951928+0000","last_fullsized":"2024-04-01T22:33:34.951928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:49:51.408086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952253+0000","last_change":"2024-04-01T22:33:32.846386+0000","last_active":"2024-04-01T22:33:34.952253+0000","last_peered":"2024-04-01T22:33:34.952253+0000","last_clean":"2024-04-01T22:33:34.952253+0000","last_became_active":"2024-04-01T22:33:32.846024+0000","last_became_peered":"2024-04-01T22:33:32.846024+0000","last_unstale":"2024-04-01T22:33:34.952253+0000","last_undegraded":"2024-04-01T22:33:34.952253+0000","last_fullsized":"2024-04-01T22:33:34.952253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:39:33.591520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951498+0000","last_change":"2024-04-01T22:33:27.974120+0000","last_active":"2024-04-01T22:33:34.951498+0000","last_peered":"2024-04-01T22:33:34.951498+0000","last_clean":"2024-04-01T22:33:34.951498+0000","last_became_active":"2024-04-01T22:33:27.973846+0000","last_became_peered":"2024-04-01T22:33:27.973846+0000","last_unstale":"2024-04-01T22:33:34.951498+0000","last_undegraded":"2024-04-01T22:33:34.951498+0000","last_fullsized":"2024-04-01T22:33:34.951498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:15:46.224658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.928629+0000","last_change":"2024-04-01T22:33:26.831927+0000","last_active":"2024-04-01T22:33:33.928629+0000","last_peered":"2024-04-01T22:33:33.928629+0000","last_clean":"2024-04-01T22:33:33.928629+0000","last_became_active":"2024-04-01T22:33:26.831676+0000","last_became_peered":"2024-04-01T22:33:26.831676+0000","last_unstale":"2024-04-01T22:33:33.928629+0000","last_undegraded":"2024-04-01T22:33:33.928629+0000","last_fullsized":"2024-04-01T22:33:33.928629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:40:49.124240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.888210+0000","last_change":"2024-04-01T22:33:32.849983+0000","last_active":"2024-04-01T22:33:33.888210+0000","last_peered":"2024-04-01T22:33:33.888210+0000","last_clean":"2024-04-01T22:33:33.888210+0000","last_became_active":"2024-04-01T22:33:32.849661+0000","last_became_peered":"2024-04-01T22:33:32.849661+0000","last_unstale":"2024-04-01T22:33:33.888210+0000","last_undegraded":"2024-04-01T22:33:33.888210+0000","last_fullsized":"2024-04-01T22:33:33.888210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:41:40.370250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.928499+0000","last_change":"2024-04-01T22:33:27.972417+0000","last_active":"2024-04-01T22:33:33.928499+0000","last_peered":"2024-04-01T22:33:33.928499+0000","last_clean":"2024-04-01T22:33:33.928499+0000","last_became_active":"2024-04-01T22:33:27.972173+0000","last_became_peered":"2024-04-01T22:33:27.972173+0000","last_unstale":"2024-04-01T22:33:33.928499+0000","last_undegraded":"2024-04-01T22:33:33.928499+0000","last_fullsized":"2024-04-01T22:33:33.928499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:47:05.004078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.461467+0000","last_change":"2024-04-01T22:33:26.831934+0000","last_active":"2024-04-01T22:33:34.461467+0000","last_peered":"2024-04-01T22:33:34.461467+0000","last_clean":"2024-04-01T22:33:34.461467+0000","last_became_active":"2024-04-01T22:33:26.831702+0000","last_became_peered":"2024-04-01T22:33:26.831702+0000","last_unstale":"2024-04-01T22:33:34.461467+0000","last_undegraded":"2024-04-01T22:33:34.461467+0000","last_fullsized":"2024-04-01T22:33:34.461467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:56:04.675231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.888137+0000","last_change":"2024-04-01T22:33:33.254394+0000","last_active":"2024-04-01T22:33:33.888137+0000","last_peered":"2024-04-01T22:33:33.888137+0000","last_clean":"2024-04-01T22:33:33.888137+0000","last_became_active":"2024-04-01T22:33:33.253993+0000","last_became_peered":"2024-04-01T22:33:33.253993+0000","last_unstale":"2024-04-01T22:33:33.888137+0000","last_undegraded":"2024-04-01T22:33:33.888137+0000","last_fullsized":"2024-04-01T22:33:33.888137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:11:05.243371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951586+0000","last_change":"2024-04-01T22:33:33.253062+0000","last_active":"2024-04-01T22:33:34.951586+0000","last_peered":"2024-04-01T22:33:34.951586+0000","last_clean":"2024-04-01T22:33:34.951586+0000","last_became_active":"2024-04-01T22:33:33.252690+0000","last_became_peered":"2024-04-01T22:33:33.252690+0000","last_unstale":"2024-04-01T22:33:34.951586+0000","last_undegraded":"2024-04-01T22:33:34.951586+0000","last_fullsized":"2024-04-01T22:33:34.951586+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:04:48.921372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951704+0000","last_change":"2024-04-01T22:33:27.855871+0000","last_active":"2024-04-01T22:33:34.951704+0000","last_peered":"2024-04-01T22:33:34.951704+0000","last_clean":"2024-04-01T22:33:34.951704+0000","last_became_active":"2024-04-01T22:33:27.855609+0000","last_became_peered":"2024-04-01T22:33:27.855609+0000","last_unstale":"2024-04-01T22:33:34.951704+0000","last_undegraded":"2024-04-01T22:33:34.951704+0000","last_fullsized":"2024-04-01T22:33:34.951704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:43:03.166262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.928074+0000","last_change":"2024-04-01T22:33:26.831819+0000","last_active":"2024-04-01T22:33:33.928074+0000","last_peered":"2024-04-01T22:33:33.928074+0000","last_clean":"2024-04-01T22:33:33.928074+0000","last_became_active":"2024-04-01T22:33:26.831554+0000","last_became_peered":"2024-04-01T22:33:26.831554+0000","last_unstale":"2024-04-01T22:33:33.928074+0000","last_undegraded":"2024-04-01T22:33:33.928074+0000","last_fullsized":"2024-04-01T22:33:33.928074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:56:04.675231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.461455+0000","last_change":"2024-04-01T22:33:32.849917+0000","last_active":"2024-04-01T22:33:34.461455+0000","last_peered":"2024-04-01T22:33:34.461455+0000","last_clean":"2024-04-01T22:33:34.461455+0000","last_became_active":"2024-04-01T22:33:32.849536+0000","last_became_peered":"2024-04-01T22:33:32.849536+0000","last_unstale":"2024-04-01T22:33:34.461455+0000","last_undegraded":"2024-04-01T22:33:34.461455+0000","last_fullsized":"2024-04-01T22:33:34.461455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:41:50.766262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.888180+0000","last_change":"2024-04-01T22:33:27.950424+0000","last_active":"2024-04-01T22:33:33.888180+0000","last_peered":"2024-04-01T22:33:33.888180+0000","last_clean":"2024-04-01T22:33:33.888180+0000","last_became_active":"2024-04-01T22:33:27.950148+0000","last_became_peered":"2024-04-01T22:33:27.950148+0000","last_unstale":"2024-04-01T22:33:33.888180+0000","last_undegraded":"2024-04-01T22:33:33.888180+0000","last_fullsized":"2024-04-01T22:33:33.888180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:50:04.913482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.888390+0000","last_change":"2024-04-01T22:33:26.855715+0000","last_active":"2024-04-01T22:33:33.888390+0000","last_peered":"2024-04-01T22:33:33.888390+0000","last_clean":"2024-04-01T22:33:33.888390+0000","last_became_active":"2024-04-01T22:33:26.855136+0000","last_became_peered":"2024-04-01T22:33:26.855136+0000","last_unstale":"2024-04-01T22:33:33.888390+0000","last_undegraded":"2024-04-01T22:33:33.888390+0000","last_fullsized":"2024-04-01T22:33:33.888390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:19:52.712250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.461188+0000","last_change":"2024-04-01T22:33:26.830837+0000","last_active":"2024-04-01T22:33:34.461188+0000","last_peered":"2024-04-01T22:33:34.461188+0000","last_clean":"2024-04-01T22:33:34.461188+0000","last_became_active":"2024-04-01T22:33:26.830563+0000","last_became_peered":"2024-04-01T22:33:26.830563+0000","last_unstale":"2024-04-01T22:33:34.461188+0000","last_undegraded":"2024-04-01T22:33:34.461188+0000","last_fullsized":"2024-04-01T22:33:34.461188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:40:49.124240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951958+0000","last_change":"2024-04-01T22:33:27.951393+0000","last_active":"2024-04-01T22:33:34.951958+0000","last_peered":"2024-04-01T22:33:34.951958+0000","last_clean":"2024-04-01T22:33:34.951958+0000","last_became_active":"2024-04-01T22:33:27.951103+0000","last_became_peered":"2024-04-01T22:33:27.951103+0000","last_unstale":"2024-04-01T22:33:34.951958+0000","last_undegraded":"2024-04-01T22:33:34.951958+0000","last_fullsized":"2024-04-01T22:33:34.951958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:43:57.121738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.922872+0000","last_change":"2024-04-01T22:33:32.846734+0000","last_active":"2024-04-01T22:33:33.922872+0000","last_peered":"2024-04-01T22:33:33.922872+0000","last_clean":"2024-04-01T22:33:33.922872+0000","last_became_active":"2024-04-01T22:33:32.846376+0000","last_became_peered":"2024-04-01T22:33:32.846376+0000","last_unstale":"2024-04-01T22:33:33.922872+0000","last_undegraded":"2024-04-01T22:33:33.922872+0000","last_fullsized":"2024-04-01T22:33:33.922872+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:50:41.471405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.888862+0000","last_change":"2024-04-01T22:33:26.855529+0000","last_active":"2024-04-01T22:33:33.888862+0000","last_peered":"2024-04-01T22:33:33.888862+0000","last_clean":"2024-04-01T22:33:33.888862+0000","last_became_active":"2024-04-01T22:33:26.855101+0000","last_became_peered":"2024-04-01T22:33:26.855101+0000","last_unstale":"2024-04-01T22:33:33.888862+0000","last_undegraded":"2024-04-01T22:33:33.888862+0000","last_fullsized":"2024-04-01T22:33:33.888862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:40:49.124240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951924+0000","last_change":"2024-04-01T22:33:27.868702+0000","last_active":"2024-04-01T22:33:34.951924+0000","last_peered":"2024-04-01T22:33:34.951924+0000","last_clean":"2024-04-01T22:33:34.951924+0000","last_became_active":"2024-04-01T22:33:27.868297+0000","last_became_peered":"2024-04-01T22:33:27.868297+0000","last_unstale":"2024-04-01T22:33:34.951924+0000","last_undegraded":"2024-04-01T22:33:34.951924+0000","last_fullsized":"2024-04-01T22:33:34.951924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:39:30.974746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.888640+0000","last_change":"2024-04-01T22:33:32.848515+0000","last_active":"2024-04-01T22:33:33.888640+0000","last_peered":"2024-04-01T22:33:33.888640+0000","last_clean":"2024-04-01T22:33:33.888640+0000","last_became_active":"2024-04-01T22:33:32.848148+0000","last_became_peered":"2024-04-01T22:33:32.848148+0000","last_unstale":"2024-04-01T22:33:33.888640+0000","last_undegraded":"2024-04-01T22:33:33.888640+0000","last_fullsized":"2024-04-01T22:33:33.888640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:27:10.705431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.460987+0000","last_change":"2024-04-01T22:33:27.950106+0000","last_active":"2024-04-01T22:33:34.460987+0000","last_peered":"2024-04-01T22:33:34.460987+0000","last_clean":"2024-04-01T22:33:34.460987+0000","last_became_active":"2024-04-01T22:33:27.949843+0000","last_became_peered":"2024-04-01T22:33:27.949843+0000","last_unstale":"2024-04-01T22:33:34.460987+0000","last_undegraded":"2024-04-01T22:33:34.460987+0000","last_fullsized":"2024-04-01T22:33:34.460987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:23:08.563134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.922800+0000","last_change":"2024-04-01T22:33:27.974409+0000","last_active":"2024-04-01T22:33:33.922800+0000","last_peered":"2024-04-01T22:33:33.922800+0000","last_clean":"2024-04-01T22:33:33.922800+0000","last_became_active":"2024-04-01T22:33:27.974128+0000","last_became_peered":"2024-04-01T22:33:27.974128+0000","last_unstale":"2024-04-01T22:33:33.922800+0000","last_undegraded":"2024-04-01T22:33:33.922800+0000","last_fullsized":"2024-04-01T22:33:33.922800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:49:52.536559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.928138+0000","last_change":"2024-04-01T22:33:27.974885+0000","last_active":"2024-04-01T22:33:33.928138+0000","last_peered":"2024-04-01T22:33:33.928138+0000","last_clean":"2024-04-01T22:33:33.928138+0000","last_became_active":"2024-04-01T22:33:27.973988+0000","last_became_peered":"2024-04-01T22:33:27.973988+0000","last_unstale":"2024-04-01T22:33:33.928138+0000","last_undegraded":"2024-04-01T22:33:33.928138+0000","last_fullsized":"2024-04-01T22:33:33.928138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:56:25.952727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951857+0000","last_change":"2024-04-01T22:33:27.950817+0000","last_active":"2024-04-01T22:33:34.951857+0000","last_peered":"2024-04-01T22:33:34.951857+0000","last_clean":"2024-04-01T22:33:34.951857+0000","last_became_active":"2024-04-01T22:33:27.950515+0000","last_became_peered":"2024-04-01T22:33:27.950515+0000","last_unstale":"2024-04-01T22:33:34.951857+0000","last_undegraded":"2024-04-01T22:33:34.951857+0000","last_fullsized":"2024-04-01T22:33:34.951857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:48:53.083180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.888679+0000","last_change":"2024-04-01T22:33:27.869385+0000","last_active":"2024-04-01T22:33:33.888679+0000","last_peered":"2024-04-01T22:33:33.888679+0000","last_clean":"2024-04-01T22:33:33.888679+0000","last_became_active":"2024-04-01T22:33:27.869102+0000","last_became_peered":"2024-04-01T22:33:27.869102+0000","last_unstale":"2024-04-01T22:33:33.888679+0000","last_undegraded":"2024-04-01T22:33:33.888679+0000","last_fullsized":"2024-04-01T22:33:33.888679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:43:57.121738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951730+0000","last_change":"2024-04-01T22:33:27.856463+0000","last_active":"2024-04-01T22:33:34.951730+0000","last_peered":"2024-04-01T22:33:34.951730+0000","last_clean":"2024-04-01T22:33:34.951730+0000","last_became_active":"2024-04-01T22:33:27.856213+0000","last_became_peered":"2024-04-01T22:33:27.856213+0000","last_unstale":"2024-04-01T22:33:34.951730+0000","last_undegraded":"2024-04-01T22:33:34.951730+0000","last_fullsized":"2024-04-01T22:33:34.951730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:43:57.121738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.461341+0000","last_change":"2024-04-01T22:33:27.921487+0000","last_active":"2024-04-01T22:33:34.461341+0000","last_peered":"2024-04-01T22:33:34.461341+0000","last_clean":"2024-04-01T22:33:34.461341+0000","last_became_active":"2024-04-01T22:33:27.921229+0000","last_became_peered":"2024-04-01T22:33:27.921229+0000","last_unstale":"2024-04-01T22:33:34.461341+0000","last_undegraded":"2024-04-01T22:33:34.461341+0000","last_fullsized":"2024-04-01T22:33:34.461341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:43:03.166262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.889006+0000","last_change":"2024-04-01T22:33:27.868732+0000","last_active":"2024-04-01T22:33:33.889006+0000","last_peered":"2024-04-01T22:33:33.889006+0000","last_clean":"2024-04-01T22:33:33.889006+0000","last_became_active":"2024-04-01T22:33:27.868496+0000","last_became_peered":"2024-04-01T22:33:27.868496+0000","last_unstale":"2024-04-01T22:33:33.889006+0000","last_undegraded":"2024-04-01T22:33:33.889006+0000","last_fullsized":"2024-04-01T22:33:33.889006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:56:25.952727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.927973+0000","last_change":"2024-04-01T22:33:27.974270+0000","last_active":"2024-04-01T22:33:33.927973+0000","last_peered":"2024-04-01T22:33:33.927973+0000","last_clean":"2024-04-01T22:33:33.927973+0000","last_became_active":"2024-04-01T22:33:27.973851+0000","last_became_peered":"2024-04-01T22:33:27.973851+0000","last_unstale":"2024-04-01T22:33:33.927973+0000","last_undegraded":"2024-04-01T22:33:33.927973+0000","last_fullsized":"2024-04-01T22:33:33.927973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:43:57.121738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.888229+0000","last_change":"2024-04-01T22:33:27.868810+0000","last_active":"2024-04-01T22:33:33.888229+0000","last_peered":"2024-04-01T22:33:33.888229+0000","last_clean":"2024-04-01T22:33:33.888229+0000","last_became_active":"2024-04-01T22:33:27.868555+0000","last_became_peered":"2024-04-01T22:33:27.868555+0000","last_unstale":"2024-04-01T22:33:33.888229+0000","last_undegraded":"2024-04-01T22:33:33.888229+0000","last_fullsized":"2024-04-01T22:33:33.888229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:48:53.083180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.928102+0000","last_change":"2024-04-01T22:33:27.979380+0000","last_active":"2024-04-01T22:33:33.928102+0000","last_peered":"2024-04-01T22:33:33.928102+0000","last_clean":"2024-04-01T22:33:33.928102+0000","last_became_active":"2024-04-01T22:33:27.979108+0000","last_became_peered":"2024-04-01T22:33:27.979108+0000","last_unstale":"2024-04-01T22:33:33.928102+0000","last_undegraded":"2024-04-01T22:33:33.928102+0000","last_fullsized":"2024-04-01T22:33:33.928102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:50:04.913482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951586+0000","last_change":"2024-04-01T22:33:27.953950+0000","last_active":"2024-04-01T22:33:34.951586+0000","last_peered":"2024-04-01T22:33:34.951586+0000","last_clean":"2024-04-01T22:33:34.951586+0000","last_became_active":"2024-04-01T22:33:27.953674+0000","last_became_peered":"2024-04-01T22:33:27.953674+0000","last_unstale":"2024-04-01T22:33:34.951586+0000","last_undegraded":"2024-04-01T22:33:34.951586+0000","last_fullsized":"2024-04-01T22:33:34.951586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:01:14.826403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.461293+0000","last_change":"2024-04-01T22:33:27.919041+0000","last_active":"2024-04-01T22:33:34.461293+0000","last_peered":"2024-04-01T22:33:34.461293+0000","last_clean":"2024-04-01T22:33:34.461293+0000","last_became_active":"2024-04-01T22:33:27.918815+0000","last_became_peered":"2024-04-01T22:33:27.918815+0000","last_unstale":"2024-04-01T22:33:34.461293+0000","last_undegraded":"2024-04-01T22:33:34.461293+0000","last_fullsized":"2024-04-01T22:33:34.461293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:15:08.500466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952144+0000","last_change":"2024-04-01T22:33:27.881613+0000","last_active":"2024-04-01T22:33:34.952144+0000","last_peered":"2024-04-01T22:33:34.952144+0000","last_clean":"2024-04-01T22:33:34.952144+0000","last_became_active":"2024-04-01T22:33:27.881372+0000","last_became_peered":"2024-04-01T22:33:27.881372+0000","last_unstale":"2024-04-01T22:33:34.952144+0000","last_undegraded":"2024-04-01T22:33:34.952144+0000","last_fullsized":"2024-04-01T22:33:34.952144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:28:13.071380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.923124+0000","last_change":"2024-04-01T22:33:27.919025+0000","last_active":"2024-04-01T22:33:33.923124+0000","last_peered":"2024-04-01T22:33:33.923124+0000","last_clean":"2024-04-01T22:33:33.923124+0000","last_became_active":"2024-04-01T22:33:27.918749+0000","last_became_peered":"2024-04-01T22:33:27.918749+0000","last_unstale":"2024-04-01T22:33:33.923124+0000","last_undegraded":"2024-04-01T22:33:33.923124+0000","last_fullsized":"2024-04-01T22:33:33.923124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:47:19.535942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.928684+0000","last_change":"2024-04-01T22:33:27.979289+0000","last_active":"2024-04-01T22:33:33.928684+0000","last_peered":"2024-04-01T22:33:33.928684+0000","last_clean":"2024-04-01T22:33:33.928684+0000","last_became_active":"2024-04-01T22:33:27.979036+0000","last_became_peered":"2024-04-01T22:33:27.979036+0000","last_unstale":"2024-04-01T22:33:33.928684+0000","last_undegraded":"2024-04-01T22:33:33.928684+0000","last_fullsized":"2024-04-01T22:33:33.928684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:19:20.248510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.927816+0000","last_change":"2024-04-01T22:33:27.974214+0000","last_active":"2024-04-01T22:33:33.927816+0000","last_peered":"2024-04-01T22:33:33.927816+0000","last_clean":"2024-04-01T22:33:33.927816+0000","last_became_active":"2024-04-01T22:33:27.973962+0000","last_became_peered":"2024-04-01T22:33:27.973962+0000","last_unstale":"2024-04-01T22:33:33.927816+0000","last_undegraded":"2024-04-01T22:33:33.927816+0000","last_fullsized":"2024-04-01T22:33:33.927816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:15:08.500466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951787+0000","last_change":"2024-04-01T22:33:27.869600+0000","last_active":"2024-04-01T22:33:34.951787+0000","last_peered":"2024-04-01T22:33:34.951787+0000","last_clean":"2024-04-01T22:33:34.951787+0000","last_became_active":"2024-04-01T22:33:27.869279+0000","last_became_peered":"2024-04-01T22:33:27.869279+0000","last_unstale":"2024-04-01T22:33:34.951787+0000","last_undegraded":"2024-04-01T22:33:34.951787+0000","last_fullsized":"2024-04-01T22:33:34.951787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:16:58.889368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951503+0000","last_change":"2024-04-01T22:33:27.948313+0000","last_active":"2024-04-01T22:33:34.951503+0000","last_peered":"2024-04-01T22:33:34.951503+0000","last_clean":"2024-04-01T22:33:34.951503+0000","last_became_active":"2024-04-01T22:33:27.947834+0000","last_became_peered":"2024-04-01T22:33:27.947834+0000","last_unstale":"2024-04-01T22:33:34.951503+0000","last_undegraded":"2024-04-01T22:33:34.951503+0000","last_fullsized":"2024-04-01T22:33:34.951503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:50:36.571977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.888650+0000","last_change":"2024-04-01T22:33:27.915571+0000","last_active":"2024-04-01T22:33:33.888650+0000","last_peered":"2024-04-01T22:33:33.888650+0000","last_clean":"2024-04-01T22:33:33.888650+0000","last_became_active":"2024-04-01T22:33:27.915372+0000","last_became_peered":"2024-04-01T22:33:27.915372+0000","last_unstale":"2024-04-01T22:33:33.888650+0000","last_undegraded":"2024-04-01T22:33:33.888650+0000","last_fullsized":"2024-04-01T22:33:33.888650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:15:46.224658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952790+0000","last_change":"2024-04-01T22:33:27.915752+0000","last_active":"2024-04-01T22:33:34.952790+0000","last_peered":"2024-04-01T22:33:34.952790+0000","last_clean":"2024-04-01T22:33:34.952790+0000","last_became_active":"2024-04-01T22:33:27.915515+0000","last_became_peered":"2024-04-01T22:33:27.915515+0000","last_unstale":"2024-04-01T22:33:34.952790+0000","last_undegraded":"2024-04-01T22:33:34.952790+0000","last_fullsized":"2024-04-01T22:33:34.952790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:47:19.535942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.461251+0000","last_change":"2024-04-01T22:33:27.974798+0000","last_active":"2024-04-01T22:33:34.461251+0000","last_peered":"2024-04-01T22:33:34.461251+0000","last_clean":"2024-04-01T22:33:34.461251+0000","last_became_active":"2024-04-01T22:33:27.974558+0000","last_became_peered":"2024-04-01T22:33:27.974558+0000","last_unstale":"2024-04-01T22:33:34.461251+0000","last_undegraded":"2024-04-01T22:33:34.461251+0000","last_fullsized":"2024-04-01T22:33:34.461251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:15:46.224658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.461300+0000","last_change":"2024-04-01T22:33:27.974420+0000","last_active":"2024-04-01T22:33:34.461300+0000","last_peered":"2024-04-01T22:33:34.461300+0000","last_clean":"2024-04-01T22:33:34.461300+0000","last_became_active":"2024-04-01T22:33:27.974139+0000","last_became_peered":"2024-04-01T22:33:27.974139+0000","last_unstale":"2024-04-01T22:33:34.461300+0000","last_undegraded":"2024-04-01T22:33:34.461300+0000","last_fullsized":"2024-04-01T22:33:34.461300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:48:53.083180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952369+0000","last_change":"2024-04-01T22:33:27.972053+0000","last_active":"2024-04-01T22:33:34.952369+0000","last_peered":"2024-04-01T22:33:34.952369+0000","last_clean":"2024-04-01T22:33:34.952369+0000","last_became_active":"2024-04-01T22:33:27.971803+0000","last_became_peered":"2024-04-01T22:33:27.971803+0000","last_unstale":"2024-04-01T22:33:34.952369+0000","last_undegraded":"2024-04-01T22:33:34.952369+0000","last_fullsized":"2024-04-01T22:33:34.952369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:41:45.866834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.888087+0000","last_change":"2024-04-01T22:33:27.974447+0000","last_active":"2024-04-01T22:33:33.888087+0000","last_peered":"2024-04-01T22:33:33.888087+0000","last_clean":"2024-04-01T22:33:33.888087+0000","last_became_active":"2024-04-01T22:33:27.974205+0000","last_became_peered":"2024-04-01T22:33:27.974205+0000","last_unstale":"2024-04-01T22:33:33.888087+0000","last_undegraded":"2024-04-01T22:33:33.888087+0000","last_fullsized":"2024-04-01T22:33:33.888087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:23:08.563134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951493+0000","last_change":"2024-04-01T22:33:27.949226+0000","last_active":"2024-04-01T22:33:34.951493+0000","last_peered":"2024-04-01T22:33:34.951493+0000","last_clean":"2024-04-01T22:33:34.951493+0000","last_became_active":"2024-04-01T22:33:27.948929+0000","last_became_peered":"2024-04-01T22:33:27.948929+0000","last_unstale":"2024-04-01T22:33:34.951493+0000","last_undegraded":"2024-04-01T22:33:34.951493+0000","last_fullsized":"2024-04-01T22:33:34.951493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:50:04.913482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.927965+0000","last_change":"2024-04-01T22:33:27.974650+0000","last_active":"2024-04-01T22:33:33.927965+0000","last_peered":"2024-04-01T22:33:33.927965+0000","last_clean":"2024-04-01T22:33:33.927965+0000","last_became_active":"2024-04-01T22:33:27.973891+0000","last_became_peered":"2024-04-01T22:33:27.973891+0000","last_unstale":"2024-04-01T22:33:33.927965+0000","last_undegraded":"2024-04-01T22:33:33.927965+0000","last_fullsized":"2024-04-01T22:33:33.927965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:08:00.537270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951503+0000","last_change":"2024-04-01T22:33:27.879045+0000","last_active":"2024-04-01T22:33:34.951503+0000","last_peered":"2024-04-01T22:33:34.951503+0000","last_clean":"2024-04-01T22:33:34.951503+0000","last_became_active":"2024-04-01T22:33:27.878782+0000","last_became_peered":"2024-04-01T22:33:27.878782+0000","last_unstale":"2024-04-01T22:33:34.951503+0000","last_undegraded":"2024-04-01T22:33:34.951503+0000","last_fullsized":"2024-04-01T22:33:34.951503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:56:25.952727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.928308+0000","last_change":"2024-04-01T22:33:27.974592+0000","last_active":"2024-04-01T22:33:33.928308+0000","last_peered":"2024-04-01T22:33:33.928308+0000","last_clean":"2024-04-01T22:33:33.928308+0000","last_became_active":"2024-04-01T22:33:27.973592+0000","last_became_peered":"2024-04-01T22:33:27.973592+0000","last_unstale":"2024-04-01T22:33:33.928308+0000","last_undegraded":"2024-04-01T22:33:33.928308+0000","last_fullsized":"2024-04-01T22:33:33.928308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:08:15.465415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951233+0000","last_change":"2024-04-01T22:33:27.948715+0000","last_active":"2024-04-01T22:33:34.951233+0000","last_peered":"2024-04-01T22:33:34.951233+0000","last_clean":"2024-04-01T22:33:34.951233+0000","last_became_active":"2024-04-01T22:33:27.948371+0000","last_became_peered":"2024-04-01T22:33:27.948371+0000","last_unstale":"2024-04-01T22:33:34.951233+0000","last_undegraded":"2024-04-01T22:33:34.951233+0000","last_fullsized":"2024-04-01T22:33:34.951233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:19:48.595176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951500+0000","last_change":"2024-04-01T22:33:27.949784+0000","last_active":"2024-04-01T22:33:34.951500+0000","last_peered":"2024-04-01T22:33:34.951500+0000","last_clean":"2024-04-01T22:33:34.951500+0000","last_became_active":"2024-04-01T22:33:27.949522+0000","last_became_peered":"2024-04-01T22:33:27.949522+0000","last_unstale":"2024-04-01T22:33:34.951500+0000","last_undegraded":"2024-04-01T22:33:34.951500+0000","last_fullsized":"2024-04-01T22:33:34.951500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:15:08.500466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951854+0000","last_change":"2024-04-01T22:33:27.915533+0000","last_active":"2024-04-01T22:33:34.951854+0000","last_peered":"2024-04-01T22:33:34.951854+0000","last_clean":"2024-04-01T22:33:34.951854+0000","last_became_active":"2024-04-01T22:33:27.915245+0000","last_became_peered":"2024-04-01T22:33:27.915245+0000","last_unstale":"2024-04-01T22:33:34.951854+0000","last_undegraded":"2024-04-01T22:33:34.951854+0000","last_fullsized":"2024-04-01T22:33:34.951854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:39:28.692092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65062,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":695877,"data_compressed":32531,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":105017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":105053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":104927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":105087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31516,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340324,"statfs":{"total":96636764160,"available":96604491776,"internally_reserved":0,"allocated":344064,"data_stored":695933,"data_compressed":32531,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32531,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32531,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T22:34:03.358 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T22:34:03.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.497+0000 7f4ea8015640 1 Processor -- start 2024-04-01T22:34:03.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.497+0000 7f4ea8015640 1 -- start start 2024-04-01T22:34:03.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.498+0000 7f4ea8015640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ea015aec0 0x7f4ea006c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:03.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.498+0000 7f4ea8015640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ea0154b70 con 0x7f4ea006c250 2024-04-01T22:34:03.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.498+0000 7f4ea8015640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ea00cdac0 con 0x7f4ea015bb20 2024-04-01T22:34:03.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.498+0000 7f4ea8015640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f4ea00ce990 con 0x7f4ea015aec0 2024-04-01T22:34:03.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.499+0000 7f4ea65b2640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f4ea015bb20 0x7f4ea015bf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.47:49474/0 (socket says 172.21.15.47:49474) 2024-04-01T22:34:03.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.499+0000 7f4ea65b2640 1 -- 172.21.15.47:0/1823806676 learned_addr learned my addr 172.21.15.47:0/1823806676 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T22:34:03.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.499+0000 7f4ea55b0640 1 --2- 172.21.15.47:0/1823806676 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ea015aec0 0x7f4ea006c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:03.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.502+0000 7f4ea55b0640 1 -- 172.21.15.47:0/1823806676 >> v1:172.21.15.181:6789/0 conn(0x7f4ea015bb20 legacy=0x7f4ea015bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:03.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.502+0000 7f4ea55b0640 1 -- 172.21.15.47:0/1823806676 >> v1:172.21.15.47:6789/0 conn(0x7f4ea006c250 legacy=0x7f4ea00ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:03.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.502+0000 7f4ea55b0640 1 -- 172.21.15.47:0/1823806676 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ea00cf2a0 con 0x7f4ea015aec0 2024-04-01T22:34:03.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.504+0000 7f4ea55b0640 1 --2- 172.21.15.47:0/1823806676 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ea015aec0 0x7f4ea006c630 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4e900097d0 tx=0x7f4e9002b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61f0388a3c60a298 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:03.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.507+0000 7f4ea4daf640 1 -- 172.21.15.47:0/1823806676 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e90035020 con 0x7f4ea015aec0 2024-04-01T22:34:03.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.507+0000 7f4ea4daf640 1 -- 172.21.15.47:0/1823806676 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e90031890 con 0x7f4ea015aec0 2024-04-01T22:34:03.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.507+0000 7f4ea4daf640 1 -- 172.21.15.47:0/1823806676 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e90031c60 con 0x7f4ea015aec0 2024-04-01T22:34:03.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.508+0000 7f4ea8015640 1 -- 172.21.15.47:0/1823806676 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ea015aec0 msgr2=0x7f4ea006c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:03.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.508+0000 7f4ea8015640 1 --2- 172.21.15.47:0/1823806676 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ea015aec0 0x7f4ea006c630 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4e900097d0 tx=0x7f4e9002b930 comp rx=0 tx=0).stop 2024-04-01T22:34:03.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.508+0000 7f4ea8015640 1 -- 172.21.15.47:0/1823806676 shutdown_connections 2024-04-01T22:34:03.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.508+0000 7f4ea8015640 1 --2- 172.21.15.47:0/1823806676 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ea015aec0 0x7f4ea006c630 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:03.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.508+0000 7f4ea8015640 1 -- 172.21.15.47:0/1823806676 >> 172.21.15.47:0/1823806676 conn(0x7f4ea00cfdb0 msgr2=0x7f4ea00d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:03.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.508+0000 7f4ea8015640 1 -- 172.21.15.47:0/1823806676 shutdown_connections 2024-04-01T22:34:03.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.508+0000 7f4ea8015640 1 -- 172.21.15.47:0/1823806676 wait complete. 2024-04-01T22:34:03.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.509+0000 7f4ea8015640 1 Processor -- start 2024-04-01T22:34:03.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.509+0000 7f4ea8015640 1 -- start start 2024-04-01T22:34:03.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.510+0000 7f4ea8015640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ea006c250 0x7f4ea014e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:03.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.510+0000 7f4ea8015640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ea015aec0 0x7f4ea00b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:03.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.510+0000 7f4ea8015640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ea015bb20 0x7f4ea00b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:03.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.510+0000 7f4ea8015640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea00ce340 con 0x7f4ea015bb20 2024-04-01T22:34:03.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.510+0000 7f4ea8015640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea00ce060 con 0x7f4ea015aec0 2024-04-01T22:34:03.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.510+0000 7f4ea8015640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f4ea00ce620 con 0x7f4ea006c250 2024-04-01T22:34:03.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.511+0000 7f4ea55b0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ea015aec0 0x7f4ea00b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:03.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.511+0000 7f4ea5db1640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ea006c250 0x7f4ea014e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:03.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.511+0000 7f4ea55b0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ea015aec0 0x7f4ea00b06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:44674/0 (socket says 172.21.15.47:44674) 2024-04-01T22:34:03.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.511+0000 7f4ea5db1640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ea006c250 0x7f4ea014e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:39322/0 (socket says 172.21.15.47:39322) 2024-04-01T22:34:03.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.511+0000 7f4ea55b0640 1 -- 172.21.15.47:0/992047388 learned_addr learned my addr 172.21.15.47:0/992047388 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:03.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.516+0000 7f4ea5db1640 1 -- 172.21.15.47:0/992047388 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ea015aec0 msgr2=0x7f4ea00b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:03.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.516+0000 7f4ea5db1640 1 --2- 172.21.15.47:0/992047388 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ea015aec0 0x7f4ea00b06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:03.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.516+0000 7f4ea5db1640 1 -- 172.21.15.47:0/992047388 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ea015bb20 msgr2=0x7f4ea00b0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:03.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.516+0000 7f4ea5db1640 1 --2- 172.21.15.47:0/992047388 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ea015bb20 0x7f4ea00b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:03.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.516+0000 7f4ea5db1640 1 -- 172.21.15.47:0/992047388 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ea00b2260 con 0x7f4ea006c250 2024-04-01T22:34:03.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.519+0000 7f4ea5db1640 1 --2- 172.21.15.47:0/992047388 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ea006c250 0x7f4ea014e5e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c00c440 tx=0x7f4e9c00c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:03.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.522+0000 7f4e967fc640 1 -- 172.21.15.47:0/992047388 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c017070 con 0x7f4ea006c250 2024-04-01T22:34:03.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.522+0000 7f4e967fc640 1 -- 172.21.15.47:0/992047388 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e9c0035f0 con 0x7f4ea006c250 2024-04-01T22:34:03.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.522+0000 7f4ea8015640 1 -- 172.21.15.47:0/992047388 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ea00afb80 con 0x7f4ea006c250 2024-04-01T22:34:03.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.523+0000 7f4e967fc640 1 -- 172.21.15.47:0/992047388 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c0039e0 con 0x7f4ea006c250 2024-04-01T22:34:03.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.523+0000 7f4ea8015640 1 -- 172.21.15.47:0/992047388 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ea014eb20 con 0x7f4ea006c250 2024-04-01T22:34:03.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.524+0000 7f4ea8015640 1 -- 172.21.15.47:0/992047388 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ea0068210 con 0x7f4ea006c250 2024-04-01T22:34:03.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.769+0000 7f4e967fc640 1 -- 172.21.15.47:0/992047388 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f4e9c01a070 con 0x7f4ea006c250 2024-04-01T22:34:03.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.769+0000 7f4e967fc640 1 --2- 172.21.15.47:0/992047388 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f4e8406b9e0 0x7f4e8406dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:03.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.770+0000 7f4ea55b0640 1 --2- 172.21.15.47:0/992047388 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f4e8406b9e0 0x7f4e8406dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:03.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.770+0000 7f4ea55b0640 1 --2- 172.21.15.47:0/992047388 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f4e8406b9e0 0x7f4e8406dea0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4e90000c00 tx=0x7f4e90008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:03.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.774+0000 7f4e967fc640 1 -- 172.21.15.47:0/992047388 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4e9c0566e0 con 0x7f4ea006c250 2024-04-01T22:34:03.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.786+0000 7f4e967fc640 1 -- 172.21.15.47:0/992047388 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f4e9c021020 con 0x7f4ea006c250 2024-04-01T22:34:03.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.990+0000 7f4ea8015640 1 -- 172.21.15.47:0/992047388 --> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4ea00b5b50 con 0x7f4e8406b9e0 2024-04-01T22:34:03.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:03.998+0000 7f4e967fc640 1 -- 172.21.15.47:0/992047388 <== mgr.4107 v2:172.21.15.47:6800/1257047371 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332612 (secure 0 0 0) 0x7f4e9009b360 con 0x7f4e8406b9e0 2024-04-01T22:34:04.001 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:34:04.003 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-01T22:34:04.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.002+0000 7f4ea8015640 1 -- 172.21.15.47:0/992047388 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f4e8406b9e0 msgr2=0x7f4e8406dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:04.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.002+0000 7f4ea8015640 1 --2- 172.21.15.47:0/992047388 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f4e8406b9e0 0x7f4e8406dea0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4e90000c00 tx=0x7f4e90008030 comp rx=0 tx=0).stop 2024-04-01T22:34:04.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.002+0000 7f4ea8015640 1 -- 172.21.15.47:0/992047388 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ea006c250 msgr2=0x7f4ea014e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:04.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.002+0000 7f4ea8015640 1 --2- 172.21.15.47:0/992047388 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ea006c250 0x7f4ea014e5e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c00c440 tx=0x7f4e9c00c840 comp rx=0 tx=0).stop 2024-04-01T22:34:04.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.002+0000 7f4ea8015640 1 -- 172.21.15.47:0/992047388 shutdown_connections 2024-04-01T22:34:04.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.002+0000 7f4ea8015640 1 --2- 172.21.15.47:0/992047388 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f4e8406b9e0 0x7f4e8406dea0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:04.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.002+0000 7f4ea8015640 1 --2- 172.21.15.47:0/992047388 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ea015bb20 0x7f4ea00b0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:04.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.002+0000 7f4ea8015640 1 --2- 172.21.15.47:0/992047388 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ea015aec0 0x7f4ea00b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:04.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.002+0000 7f4ea8015640 1 --2- 172.21.15.47:0/992047388 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ea006c250 0x7f4ea014e5e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:04.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.002+0000 7f4ea8015640 1 -- 172.21.15.47:0/992047388 >> 172.21.15.47:0/992047388 conn(0x7f4ea00cfdb0 msgr2=0x7f4ea01542a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:04.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.002+0000 7f4ea8015640 1 -- 172.21.15.47:0/992047388 shutdown_connections 2024-04-01T22:34:04.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.002+0000 7f4ea8015640 1 -- 172.21.15.47:0/992047388 wait complete. 2024-04-01T22:34:04.014 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":46,"stamp":"2024-04-01T22:34:03.911136+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226760,"kb_used_data":2272,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754747960,"statfs":{"total":773094113280,"available":772861911040,"internally_reserved":0,"allocated":2326528,"data_stored":2029432,"data_compressed":65062,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.126944"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951600+0000","last_change":"2024-04-01T22:33:26.849312+0000","last_active":"2024-04-01T22:33:34.951600+0000","last_peered":"2024-04-01T22:33:34.951600+0000","last_clean":"2024-04-01T22:33:34.951600+0000","last_became_active":"2024-04-01T22:33:26.849009+0000","last_became_peered":"2024-04-01T22:33:26.849009+0000","last_unstale":"2024-04-01T22:33:34.951600+0000","last_undegraded":"2024-04-01T22:33:34.951600+0000","last_fullsized":"2024-04-01T22:33:34.951600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:58:40.837557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.888665+0000","last_change":"2024-04-01T22:33:27.919006+0000","last_active":"2024-04-01T22:33:33.888665+0000","last_peered":"2024-04-01T22:33:33.888665+0000","last_clean":"2024-04-01T22:33:33.888665+0000","last_became_active":"2024-04-01T22:33:27.918702+0000","last_became_peered":"2024-04-01T22:33:27.918702+0000","last_unstale":"2024-04-01T22:33:33.888665+0000","last_undegraded":"2024-04-01T22:33:33.888665+0000","last_fullsized":"2024-04-01T22:33:33.888665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:08:00.537270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.888075+0000","last_change":"2024-04-01T22:33:33.255162+0000","last_active":"2024-04-01T22:33:33.888075+0000","last_peered":"2024-04-01T22:33:33.888075+0000","last_clean":"2024-04-01T22:33:33.888075+0000","last_became_active":"2024-04-01T22:33:33.254187+0000","last_became_peered":"2024-04-01T22:33:33.254187+0000","last_unstale":"2024-04-01T22:33:33.888075+0000","last_undegraded":"2024-04-01T22:33:33.888075+0000","last_fullsized":"2024-04-01T22:33:33.888075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:57:12.343606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.888862+0000","last_change":"2024-04-01T22:33:26.855377+0000","last_active":"2024-04-01T22:33:33.888862+0000","last_peered":"2024-04-01T22:33:33.888862+0000","last_clean":"2024-04-01T22:33:33.888862+0000","last_became_active":"2024-04-01T22:33:26.855119+0000","last_became_peered":"2024-04-01T22:33:26.855119+0000","last_unstale":"2024-04-01T22:33:33.888862+0000","last_undegraded":"2024-04-01T22:33:33.888862+0000","last_fullsized":"2024-04-01T22:33:33.888862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:25:41.744696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951260+0000","last_change":"2024-04-01T22:33:27.974175+0000","last_active":"2024-04-01T22:33:34.951260+0000","last_peered":"2024-04-01T22:33:34.951260+0000","last_clean":"2024-04-01T22:33:34.951260+0000","last_became_active":"2024-04-01T22:33:27.973915+0000","last_became_peered":"2024-04-01T22:33:27.973915+0000","last_unstale":"2024-04-01T22:33:34.951260+0000","last_undegraded":"2024-04-01T22:33:34.951260+0000","last_fullsized":"2024-04-01T22:33:34.951260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:43:03.166262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951358+0000","last_change":"2024-04-01T22:33:32.853556+0000","last_active":"2024-04-01T22:33:34.951358+0000","last_peered":"2024-04-01T22:33:34.951358+0000","last_clean":"2024-04-01T22:33:34.951358+0000","last_became_active":"2024-04-01T22:33:32.853215+0000","last_became_peered":"2024-04-01T22:33:32.853215+0000","last_unstale":"2024-04-01T22:33:34.951358+0000","last_undegraded":"2024-04-01T22:33:34.951358+0000","last_fullsized":"2024-04-01T22:33:34.951358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:50:09.812910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952067+0000","last_change":"2024-04-01T22:33:26.849967+0000","last_active":"2024-04-01T22:33:34.952067+0000","last_peered":"2024-04-01T22:33:34.952067+0000","last_clean":"2024-04-01T22:33:34.952067+0000","last_became_active":"2024-04-01T22:33:26.849432+0000","last_became_peered":"2024-04-01T22:33:26.849432+0000","last_unstale":"2024-04-01T22:33:34.952067+0000","last_undegraded":"2024-04-01T22:33:34.952067+0000","last_fullsized":"2024-04-01T22:33:34.952067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:47:18.407469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.928356+0000","last_change":"2024-04-01T22:33:27.972413+0000","last_active":"2024-04-01T22:33:33.928356+0000","last_peered":"2024-04-01T22:33:33.928356+0000","last_clean":"2024-04-01T22:33:33.928356+0000","last_became_active":"2024-04-01T22:33:27.972137+0000","last_became_peered":"2024-04-01T22:33:27.972137+0000","last_unstale":"2024-04-01T22:33:33.928356+0000","last_undegraded":"2024-04-01T22:33:33.928356+0000","last_fullsized":"2024-04-01T22:33:33.928356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:41:45.866834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952448+0000","last_change":"2024-04-01T22:33:32.847230+0000","last_active":"2024-04-01T22:33:34.952448+0000","last_peered":"2024-04-01T22:33:34.952448+0000","last_clean":"2024-04-01T22:33:34.952448+0000","last_became_active":"2024-04-01T22:33:32.846382+0000","last_became_peered":"2024-04-01T22:33:32.846382+0000","last_unstale":"2024-04-01T22:33:34.952448+0000","last_undegraded":"2024-04-01T22:33:34.952448+0000","last_fullsized":"2024-04-01T22:33:34.952448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:41:50.766262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951633+0000","last_change":"2024-04-01T22:33:26.852784+0000","last_active":"2024-04-01T22:33:34.951633+0000","last_peered":"2024-04-01T22:33:34.951633+0000","last_clean":"2024-04-01T22:33:34.951633+0000","last_became_active":"2024-04-01T22:33:26.852530+0000","last_became_peered":"2024-04-01T22:33:26.852530+0000","last_unstale":"2024-04-01T22:33:34.951633+0000","last_undegraded":"2024-04-01T22:33:34.951633+0000","last_fullsized":"2024-04-01T22:33:34.951633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:39:29.846272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.928438+0000","last_change":"2024-04-01T22:33:27.974358+0000","last_active":"2024-04-01T22:33:33.928438+0000","last_peered":"2024-04-01T22:33:33.928438+0000","last_clean":"2024-04-01T22:33:33.928438+0000","last_became_active":"2024-04-01T22:33:27.974117+0000","last_became_peered":"2024-04-01T22:33:27.974117+0000","last_unstale":"2024-04-01T22:33:33.928438+0000","last_undegraded":"2024-04-01T22:33:33.928438+0000","last_fullsized":"2024-04-01T22:33:33.928438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:39:28.692092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951427+0000","last_change":"2024-04-01T22:33:32.844681+0000","last_active":"2024-04-01T22:33:34.951427+0000","last_peered":"2024-04-01T22:33:34.951427+0000","last_clean":"2024-04-01T22:33:34.951427+0000","last_became_active":"2024-04-01T22:33:32.844334+0000","last_became_peered":"2024-04-01T22:33:32.844334+0000","last_unstale":"2024-04-01T22:33:34.951427+0000","last_undegraded":"2024-04-01T22:33:34.951427+0000","last_fullsized":"2024-04-01T22:33:34.951427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:56:30.852155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.460987+0000","last_change":"2024-04-01T22:33:27.918822+0000","last_active":"2024-04-01T22:33:34.460987+0000","last_peered":"2024-04-01T22:33:34.460987+0000","last_clean":"2024-04-01T22:33:34.460987+0000","last_became_active":"2024-04-01T22:33:27.918466+0000","last_became_peered":"2024-04-01T22:33:27.918466+0000","last_unstale":"2024-04-01T22:33:34.460987+0000","last_undegraded":"2024-04-01T22:33:34.460987+0000","last_fullsized":"2024-04-01T22:33:34.460987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:43:57.121738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951812+0000","last_change":"2024-04-01T22:33:26.850443+0000","last_active":"2024-04-01T22:33:34.951812+0000","last_peered":"2024-04-01T22:33:34.951812+0000","last_clean":"2024-04-01T22:33:34.951812+0000","last_became_active":"2024-04-01T22:33:26.849954+0000","last_became_peered":"2024-04-01T22:33:26.849954+0000","last_unstale":"2024-04-01T22:33:34.951812+0000","last_undegraded":"2024-04-01T22:33:34.951812+0000","last_fullsized":"2024-04-01T22:33:34.951812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:49:51.408086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952128+0000","last_change":"2024-04-01T22:33:32.853569+0000","last_active":"2024-04-01T22:33:34.952128+0000","last_peered":"2024-04-01T22:33:34.952128+0000","last_clean":"2024-04-01T22:33:34.952128+0000","last_became_active":"2024-04-01T22:33:32.853185+0000","last_became_peered":"2024-04-01T22:33:32.853185+0000","last_unstale":"2024-04-01T22:33:34.952128+0000","last_undegraded":"2024-04-01T22:33:34.952128+0000","last_fullsized":"2024-04-01T22:33:34.952128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:19:25.147938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.888760+0000","last_change":"2024-04-01T22:33:27.949789+0000","last_active":"2024-04-01T22:33:33.888760+0000","last_peered":"2024-04-01T22:33:33.888760+0000","last_clean":"2024-04-01T22:33:33.888760+0000","last_became_active":"2024-04-01T22:33:27.949518+0000","last_became_peered":"2024-04-01T22:33:27.949518+0000","last_unstale":"2024-04-01T22:33:33.888760+0000","last_undegraded":"2024-04-01T22:33:33.888760+0000","last_fullsized":"2024-04-01T22:33:33.888760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:15:08.500466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952376+0000","last_change":"2024-04-01T22:33:26.856856+0000","last_active":"2024-04-01T22:33:34.952376+0000","last_peered":"2024-04-01T22:33:34.952376+0000","last_clean":"2024-04-01T22:33:34.952376+0000","last_became_active":"2024-04-01T22:33:26.856591+0000","last_became_peered":"2024-04-01T22:33:26.856591+0000","last_unstale":"2024-04-01T22:33:34.952376+0000","last_undegraded":"2024-04-01T22:33:34.952376+0000","last_fullsized":"2024-04-01T22:33:34.952376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:38:14.576161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952740+0000","last_change":"2024-04-01T22:33:32.847352+0000","last_active":"2024-04-01T22:33:34.952740+0000","last_peered":"2024-04-01T22:33:34.952740+0000","last_clean":"2024-04-01T22:33:34.952740+0000","last_became_active":"2024-04-01T22:33:32.846849+0000","last_became_peered":"2024-04-01T22:33:32.846849+0000","last_unstale":"2024-04-01T22:33:34.952740+0000","last_undegraded":"2024-04-01T22:33:34.952740+0000","last_fullsized":"2024-04-01T22:33:34.952740+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:04:48.921372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.888269+0000","last_change":"2024-04-01T22:33:27.855387+0000","last_active":"2024-04-01T22:33:33.888269+0000","last_peered":"2024-04-01T22:33:33.888269+0000","last_clean":"2024-04-01T22:33:33.888269+0000","last_became_active":"2024-04-01T22:33:27.855123+0000","last_became_peered":"2024-04-01T22:33:27.855123+0000","last_unstale":"2024-04-01T22:33:33.888269+0000","last_undegraded":"2024-04-01T22:33:33.888269+0000","last_fullsized":"2024-04-01T22:33:33.888269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:16:58.889368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951872+0000","last_change":"2024-04-01T22:33:26.848128+0000","last_active":"2024-04-01T22:33:34.951872+0000","last_peered":"2024-04-01T22:33:34.951872+0000","last_clean":"2024-04-01T22:33:34.951872+0000","last_became_active":"2024-04-01T22:33:26.847904+0000","last_became_peered":"2024-04-01T22:33:26.847904+0000","last_unstale":"2024-04-01T22:33:34.951872+0000","last_undegraded":"2024-04-01T22:33:34.951872+0000","last_fullsized":"2024-04-01T22:33:34.951872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:41:58.838710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952167+0000","last_change":"2024-04-01T22:33:33.253906+0000","last_active":"2024-04-01T22:33:34.952167+0000","last_peered":"2024-04-01T22:33:34.952167+0000","last_clean":"2024-04-01T22:33:34.952167+0000","last_became_active":"2024-04-01T22:33:33.253475+0000","last_became_peered":"2024-04-01T22:33:33.253475+0000","last_unstale":"2024-04-01T22:33:34.952167+0000","last_undegraded":"2024-04-01T22:33:34.952167+0000","last_fullsized":"2024-04-01T22:33:34.952167+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:28:17.970808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951571+0000","last_change":"2024-04-01T22:33:27.868997+0000","last_active":"2024-04-01T22:33:34.951571+0000","last_peered":"2024-04-01T22:33:34.951571+0000","last_clean":"2024-04-01T22:33:34.951571+0000","last_became_active":"2024-04-01T22:33:27.868713+0000","last_became_peered":"2024-04-01T22:33:27.868713+0000","last_unstale":"2024-04-01T22:33:34.951571+0000","last_undegraded":"2024-04-01T22:33:34.951571+0000","last_fullsized":"2024-04-01T22:33:34.951571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:41:59.967183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951264+0000","last_change":"2024-04-01T22:33:26.848037+0000","last_active":"2024-04-01T22:33:34.951264+0000","last_peered":"2024-04-01T22:33:34.951264+0000","last_clean":"2024-04-01T22:33:34.951264+0000","last_became_active":"2024-04-01T22:33:26.847736+0000","last_became_peered":"2024-04-01T22:33:26.847736+0000","last_unstale":"2024-04-01T22:33:34.951264+0000","last_undegraded":"2024-04-01T22:33:34.951264+0000","last_fullsized":"2024-04-01T22:33:34.951264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:56:04.675231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952414+0000","last_change":"2024-04-01T22:33:32.847015+0000","last_active":"2024-04-01T22:33:34.952414+0000","last_peered":"2024-04-01T22:33:34.952414+0000","last_clean":"2024-04-01T22:33:34.952414+0000","last_became_active":"2024-04-01T22:33:32.846639+0000","last_became_peered":"2024-04-01T22:33:32.846639+0000","last_unstale":"2024-04-01T22:33:34.952414+0000","last_undegraded":"2024-04-01T22:33:34.952414+0000","last_fullsized":"2024-04-01T22:33:34.952414+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:47:09.903506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951861+0000","last_change":"2024-04-01T22:33:27.948117+0000","last_active":"2024-04-01T22:33:34.951861+0000","last_peered":"2024-04-01T22:33:34.951861+0000","last_clean":"2024-04-01T22:33:34.951861+0000","last_became_active":"2024-04-01T22:33:27.947735+0000","last_became_peered":"2024-04-01T22:33:27.947735+0000","last_unstale":"2024-04-01T22:33:34.951861+0000","last_undegraded":"2024-04-01T22:33:34.951861+0000","last_fullsized":"2024-04-01T22:33:34.951861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:16:58.889368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.461561+0000","last_change":"2024-04-01T22:33:26.849404+0000","last_active":"2024-04-01T22:33:34.461561+0000","last_peered":"2024-04-01T22:33:34.461561+0000","last_clean":"2024-04-01T22:33:34.461561+0000","last_became_active":"2024-04-01T22:33:26.849086+0000","last_became_peered":"2024-04-01T22:33:26.849086+0000","last_unstale":"2024-04-01T22:33:34.461561+0000","last_undegraded":"2024-04-01T22:33:34.461561+0000","last_fullsized":"2024-04-01T22:33:34.461561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:41:58.838710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951479+0000","last_change":"2024-04-01T22:33:33.249726+0000","last_active":"2024-04-01T22:33:34.951479+0000","last_peered":"2024-04-01T22:33:34.951479+0000","last_clean":"2024-04-01T22:33:34.951479+0000","last_became_active":"2024-04-01T22:33:33.249309+0000","last_became_peered":"2024-04-01T22:33:33.249309+0000","last_unstale":"2024-04-01T22:33:34.951479+0000","last_undegraded":"2024-04-01T22:33:34.951479+0000","last_fullsized":"2024-04-01T22:33:34.951479+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:08:20.364843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.889100+0000","last_change":"2024-04-01T22:33:27.879797+0000","last_active":"2024-04-01T22:33:33.889100+0000","last_peered":"2024-04-01T22:33:33.889100+0000","last_clean":"2024-04-01T22:33:33.889100+0000","last_became_active":"2024-04-01T22:33:27.879582+0000","last_became_peered":"2024-04-01T22:33:27.879582+0000","last_unstale":"2024-04-01T22:33:33.889100+0000","last_undegraded":"2024-04-01T22:33:33.889100+0000","last_fullsized":"2024-04-01T22:33:33.889100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:08:15.465415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951594+0000","last_change":"2024-04-01T22:33:26.847504+0000","last_active":"2024-04-01T22:33:34.951594+0000","last_peered":"2024-04-01T22:33:34.951594+0000","last_clean":"2024-04-01T22:33:34.951594+0000","last_became_active":"2024-04-01T22:33:26.847333+0000","last_became_peered":"2024-04-01T22:33:26.847333+0000","last_unstale":"2024-04-01T22:33:34.951594+0000","last_undegraded":"2024-04-01T22:33:34.951594+0000","last_fullsized":"2024-04-01T22:33:34.951594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:39:29.846272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.888017+0000","last_change":"2024-04-01T22:33:33.255030+0000","last_active":"2024-04-01T22:33:33.888017+0000","last_peered":"2024-04-01T22:33:33.888017+0000","last_clean":"2024-04-01T22:33:33.888017+0000","last_became_active":"2024-04-01T22:33:33.254621+0000","last_became_peered":"2024-04-01T22:33:33.254621+0000","last_unstale":"2024-04-01T22:33:33.888017+0000","last_undegraded":"2024-04-01T22:33:33.888017+0000","last_fullsized":"2024-04-01T22:33:33.888017+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:19:44.325870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951942+0000","last_change":"2024-04-01T22:33:27.855669+0000","last_active":"2024-04-01T22:33:34.951942+0000","last_peered":"2024-04-01T22:33:34.951942+0000","last_clean":"2024-04-01T22:33:34.951942+0000","last_became_active":"2024-04-01T22:33:27.855419+0000","last_became_peered":"2024-04-01T22:33:27.855419+0000","last_unstale":"2024-04-01T22:33:34.951942+0000","last_undegraded":"2024-04-01T22:33:34.951942+0000","last_fullsized":"2024-04-01T22:33:34.951942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:15:46.224658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952173+0000","last_change":"2024-04-01T22:33:26.850176+0000","last_active":"2024-04-01T22:33:34.952173+0000","last_peered":"2024-04-01T22:33:34.952173+0000","last_clean":"2024-04-01T22:33:34.952173+0000","last_became_active":"2024-04-01T22:33:26.849717+0000","last_became_peered":"2024-04-01T22:33:26.849717+0000","last_unstale":"2024-04-01T22:33:34.952173+0000","last_undegraded":"2024-04-01T22:33:34.952173+0000","last_fullsized":"2024-04-01T22:33:34.952173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:18:55.842886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951488+0000","last_change":"2024-04-01T22:33:33.249765+0000","last_active":"2024-04-01T22:33:34.951488+0000","last_peered":"2024-04-01T22:33:34.951488+0000","last_clean":"2024-04-01T22:33:34.951488+0000","last_became_active":"2024-04-01T22:33:33.249370+0000","last_became_peered":"2024-04-01T22:33:33.249370+0000","last_unstale":"2024-04-01T22:33:34.951488+0000","last_undegraded":"2024-04-01T22:33:34.951488+0000","last_fullsized":"2024-04-01T22:33:34.951488+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:41:50.766262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.928517+0000","last_change":"2024-04-01T22:33:27.979163+0000","last_active":"2024-04-01T22:33:33.928517+0000","last_peered":"2024-04-01T22:33:33.928517+0000","last_clean":"2024-04-01T22:33:33.928517+0000","last_became_active":"2024-04-01T22:33:27.978902+0000","last_became_peered":"2024-04-01T22:33:27.978902+0000","last_unstale":"2024-04-01T22:33:33.928517+0000","last_undegraded":"2024-04-01T22:33:33.928517+0000","last_fullsized":"2024-04-01T22:33:33.928517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:04:44.021944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952024+0000","last_change":"2024-04-01T22:33:26.846575+0000","last_active":"2024-04-01T22:33:34.952024+0000","last_peered":"2024-04-01T22:33:34.952024+0000","last_clean":"2024-04-01T22:33:34.952024+0000","last_became_active":"2024-04-01T22:33:26.846265+0000","last_became_peered":"2024-04-01T22:33:26.846265+0000","last_unstale":"2024-04-01T22:33:34.952024+0000","last_undegraded":"2024-04-01T22:33:34.952024+0000","last_fullsized":"2024-04-01T22:33:34.952024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:56:04.675231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952099+0000","last_change":"2024-04-01T22:33:32.850553+0000","last_active":"2024-04-01T22:33:34.952099+0000","last_peered":"2024-04-01T22:33:34.952099+0000","last_clean":"2024-04-01T22:33:34.952099+0000","last_became_active":"2024-04-01T22:33:32.849774+0000","last_became_peered":"2024-04-01T22:33:32.849774+0000","last_unstale":"2024-04-01T22:33:34.952099+0000","last_undegraded":"2024-04-01T22:33:34.952099+0000","last_fullsized":"2024-04-01T22:33:34.952099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:04:48.921372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952536+0000","last_change":"2024-04-01T22:33:27.949879+0000","last_active":"2024-04-01T22:33:34.952536+0000","last_peered":"2024-04-01T22:33:34.952536+0000","last_clean":"2024-04-01T22:33:34.952536+0000","last_became_active":"2024-04-01T22:33:27.949620+0000","last_became_peered":"2024-04-01T22:33:27.949620+0000","last_unstale":"2024-04-01T22:33:34.952536+0000","last_undegraded":"2024-04-01T22:33:34.952536+0000","last_fullsized":"2024-04-01T22:33:34.952536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:49:52.536559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.928411+0000","last_change":"2024-04-01T22:33:26.846346+0000","last_active":"2024-04-01T22:33:33.928411+0000","last_peered":"2024-04-01T22:33:33.928411+0000","last_clean":"2024-04-01T22:33:33.928411+0000","last_became_active":"2024-04-01T22:33:26.846052+0000","last_became_peered":"2024-04-01T22:33:26.846052+0000","last_unstale":"2024-04-01T22:33:33.928411+0000","last_undegraded":"2024-04-01T22:33:33.928411+0000","last_fullsized":"2024-04-01T22:33:33.928411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:41:58.838710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951663+0000","last_change":"2024-04-01T22:33:32.846766+0000","last_active":"2024-04-01T22:33:34.951663+0000","last_peered":"2024-04-01T22:33:34.951663+0000","last_clean":"2024-04-01T22:33:34.951663+0000","last_became_active":"2024-04-01T22:33:32.846422+0000","last_became_peered":"2024-04-01T22:33:32.846422+0000","last_unstale":"2024-04-01T22:33:34.951663+0000","last_undegraded":"2024-04-01T22:33:34.951663+0000","last_fullsized":"2024-04-01T22:33:34.951663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:41:50.766262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.950991+0000","last_change":"2024-04-01T22:33:27.855299+0000","last_active":"2024-04-01T22:33:34.950991+0000","last_peered":"2024-04-01T22:33:34.950991+0000","last_clean":"2024-04-01T22:33:34.950991+0000","last_became_active":"2024-04-01T22:33:27.855035+0000","last_became_peered":"2024-04-01T22:33:27.855035+0000","last_unstale":"2024-04-01T22:33:34.950991+0000","last_undegraded":"2024-04-01T22:33:34.950991+0000","last_fullsized":"2024-04-01T22:33:34.950991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:48:53.083180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.922839+0000","last_change":"2024-04-01T22:33:26.856300+0000","last_active":"2024-04-01T22:33:33.922839+0000","last_peered":"2024-04-01T22:33:33.922839+0000","last_clean":"2024-04-01T22:33:33.922839+0000","last_became_active":"2024-04-01T22:33:26.855864+0000","last_became_peered":"2024-04-01T22:33:26.855864+0000","last_unstale":"2024-04-01T22:33:33.922839+0000","last_undegraded":"2024-04-01T22:33:33.922839+0000","last_fullsized":"2024-04-01T22:33:33.922839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:38:14.576161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952162+0000","last_change":"2024-04-01T22:33:32.851818+0000","last_active":"2024-04-01T22:33:34.952162+0000","last_peered":"2024-04-01T22:33:34.952162+0000","last_clean":"2024-04-01T22:33:34.952162+0000","last_became_active":"2024-04-01T22:33:32.851388+0000","last_became_peered":"2024-04-01T22:33:32.851388+0000","last_unstale":"2024-04-01T22:33:34.952162+0000","last_undegraded":"2024-04-01T22:33:34.952162+0000","last_fullsized":"2024-04-01T22:33:34.952162+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:43:44.388503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951164+0000","last_change":"2024-04-01T22:33:27.949013+0000","last_active":"2024-04-01T22:33:34.951164+0000","last_peered":"2024-04-01T22:33:34.951164+0000","last_clean":"2024-04-01T22:33:34.951164+0000","last_became_active":"2024-04-01T22:33:27.948687+0000","last_became_peered":"2024-04-01T22:33:27.948687+0000","last_unstale":"2024-04-01T22:33:34.951164+0000","last_undegraded":"2024-04-01T22:33:34.951164+0000","last_fullsized":"2024-04-01T22:33:34.951164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:50:54.852207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951378+0000","last_change":"2024-04-01T22:33:26.848366+0000","last_active":"2024-04-01T22:33:34.951378+0000","last_peered":"2024-04-01T22:33:34.951378+0000","last_clean":"2024-04-01T22:33:34.951378+0000","last_became_active":"2024-04-01T22:33:26.848019+0000","last_became_peered":"2024-04-01T22:33:26.848019+0000","last_unstale":"2024-04-01T22:33:34.951378+0000","last_undegraded":"2024-04-01T22:33:34.951378+0000","last_fullsized":"2024-04-01T22:33:34.951378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:41:58.838710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951754+0000","last_change":"2024-04-01T22:33:33.253077+0000","last_active":"2024-04-01T22:33:34.951754+0000","last_peered":"2024-04-01T22:33:34.951754+0000","last_clean":"2024-04-01T22:33:34.951754+0000","last_became_active":"2024-04-01T22:33:33.252725+0000","last_became_peered":"2024-04-01T22:33:33.252725+0000","last_unstale":"2024-04-01T22:33:34.951754+0000","last_undegraded":"2024-04-01T22:33:34.951754+0000","last_fullsized":"2024-04-01T22:33:34.951754+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:28:17.970808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.888333+0000","last_change":"2024-04-01T22:33:27.975039+0000","last_active":"2024-04-01T22:33:33.888333+0000","last_peered":"2024-04-01T22:33:33.888333+0000","last_clean":"2024-04-01T22:33:33.888333+0000","last_became_active":"2024-04-01T22:33:27.974751+0000","last_became_peered":"2024-04-01T22:33:27.974751+0000","last_unstale":"2024-04-01T22:33:33.888333+0000","last_undegraded":"2024-04-01T22:33:33.888333+0000","last_fullsized":"2024-04-01T22:33:33.888333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:43:03.166262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.928301+0000","last_change":"2024-04-01T22:33:26.831690+0000","last_active":"2024-04-01T22:33:33.928301+0000","last_peered":"2024-04-01T22:33:33.928301+0000","last_clean":"2024-04-01T22:33:33.928301+0000","last_became_active":"2024-04-01T22:33:26.831398+0000","last_became_peered":"2024-04-01T22:33:26.831398+0000","last_unstale":"2024-04-01T22:33:33.928301+0000","last_undegraded":"2024-04-01T22:33:33.928301+0000","last_fullsized":"2024-04-01T22:33:33.928301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:38:14.576161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951493+0000","last_change":"2024-04-01T22:33:15.962585+0000","last_active":"2024-04-01T22:33:34.951493+0000","last_peered":"2024-04-01T22:33:34.951493+0000","last_clean":"2024-04-01T22:33:34.951493+0000","last_became_active":"2024-04-01T22:33:15.961762+0000","last_became_peered":"2024-04-01T22:33:15.961762+0000","last_unstale":"2024-04-01T22:33:34.951493+0000","last_undegraded":"2024-04-01T22:33:34.951493+0000","last_fullsized":"2024-04-01T22:33:34.951493+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:13.756389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:13.756389+0000","last_clean_scrub_stamp":"2024-04-01T22:33:13.756389+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:33:28.684533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.461330+0000","last_change":"2024-04-01T22:33:33.252863+0000","last_active":"2024-04-01T22:33:34.461330+0000","last_peered":"2024-04-01T22:33:34.461330+0000","last_clean":"2024-04-01T22:33:34.461330+0000","last_became_active":"2024-04-01T22:33:33.252494+0000","last_became_peered":"2024-04-01T22:33:33.252494+0000","last_unstale":"2024-04-01T22:33:34.461330+0000","last_undegraded":"2024-04-01T22:33:34.461330+0000","last_fullsized":"2024-04-01T22:33:34.461330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:47:09.903506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951975+0000","last_change":"2024-04-01T22:33:27.975195+0000","last_active":"2024-04-01T22:33:34.951975+0000","last_peered":"2024-04-01T22:33:34.951975+0000","last_clean":"2024-04-01T22:33:34.951975+0000","last_became_active":"2024-04-01T22:33:27.974949+0000","last_became_peered":"2024-04-01T22:33:27.974949+0000","last_unstale":"2024-04-01T22:33:34.951975+0000","last_undegraded":"2024-04-01T22:33:34.951975+0000","last_fullsized":"2024-04-01T22:33:34.951975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:08:15.465415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.922990+0000","last_change":"2024-04-01T22:33:26.832331+0000","last_active":"2024-04-01T22:33:33.922990+0000","last_peered":"2024-04-01T22:33:33.922990+0000","last_clean":"2024-04-01T22:33:33.922990+0000","last_became_active":"2024-04-01T22:33:26.832078+0000","last_became_peered":"2024-04-01T22:33:26.832078+0000","last_unstale":"2024-04-01T22:33:33.922990+0000","last_undegraded":"2024-04-01T22:33:33.922990+0000","last_fullsized":"2024-04-01T22:33:33.922990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:40:49.124240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.461078+0000","last_change":"2024-04-01T22:33:33.249696+0000","last_active":"2024-04-01T22:33:34.461078+0000","last_peered":"2024-04-01T22:33:34.461078+0000","last_clean":"2024-04-01T22:33:34.461078+0000","last_became_active":"2024-04-01T22:33:33.249313+0000","last_became_peered":"2024-04-01T22:33:33.249313+0000","last_unstale":"2024-04-01T22:33:34.461078+0000","last_undegraded":"2024-04-01T22:33:34.461078+0000","last_fullsized":"2024-04-01T22:33:34.461078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:39:33.591520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.928417+0000","last_change":"2024-04-01T22:33:27.971916+0000","last_active":"2024-04-01T22:33:33.928417+0000","last_peered":"2024-04-01T22:33:33.928417+0000","last_clean":"2024-04-01T22:33:33.928417+0000","last_became_active":"2024-04-01T22:33:27.971672+0000","last_became_peered":"2024-04-01T22:33:27.971672+0000","last_unstale":"2024-04-01T22:33:33.928417+0000","last_undegraded":"2024-04-01T22:33:33.928417+0000","last_fullsized":"2024-04-01T22:33:33.928417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:43:39.489075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952091+0000","last_change":"2024-04-01T22:33:26.849350+0000","last_active":"2024-04-01T22:33:34.952091+0000","last_peered":"2024-04-01T22:33:34.952091+0000","last_clean":"2024-04-01T22:33:34.952091+0000","last_became_active":"2024-04-01T22:33:26.849098+0000","last_became_peered":"2024-04-01T22:33:26.849098+0000","last_unstale":"2024-04-01T22:33:34.952091+0000","last_undegraded":"2024-04-01T22:33:34.952091+0000","last_fullsized":"2024-04-01T22:33:34.952091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:47:18.407469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951759+0000","last_change":"2024-04-01T22:33:32.847889+0000","last_active":"2024-04-01T22:33:34.951759+0000","last_peered":"2024-04-01T22:33:34.951759+0000","last_clean":"2024-04-01T22:33:34.951759+0000","last_became_active":"2024-04-01T22:33:32.847546+0000","last_became_peered":"2024-04-01T22:33:32.847546+0000","last_unstale":"2024-04-01T22:33:34.951759+0000","last_undegraded":"2024-04-01T22:33:34.951759+0000","last_fullsized":"2024-04-01T22:33:34.951759+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:57:05.158344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952378+0000","last_change":"2024-04-01T22:33:27.881170+0000","last_active":"2024-04-01T22:33:34.952378+0000","last_peered":"2024-04-01T22:33:34.952378+0000","last_clean":"2024-04-01T22:33:34.952378+0000","last_became_active":"2024-04-01T22:33:27.880870+0000","last_became_peered":"2024-04-01T22:33:27.880870+0000","last_unstale":"2024-04-01T22:33:34.952378+0000","last_undegraded":"2024-04-01T22:33:34.952378+0000","last_fullsized":"2024-04-01T22:33:34.952378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:43:39.489075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.923189+0000","last_change":"2024-04-01T22:33:26.856069+0000","last_active":"2024-04-01T22:33:33.923189+0000","last_peered":"2024-04-01T22:33:33.923189+0000","last_clean":"2024-04-01T22:33:33.923189+0000","last_became_active":"2024-04-01T22:33:26.855705+0000","last_became_peered":"2024-04-01T22:33:26.855705+0000","last_unstale":"2024-04-01T22:33:33.923189+0000","last_undegraded":"2024-04-01T22:33:33.923189+0000","last_fullsized":"2024-04-01T22:33:33.923189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:56:04.675231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.927900+0000","last_change":"2024-04-01T22:33:33.249689+0000","last_active":"2024-04-01T22:33:33.927900+0000","last_peered":"2024-04-01T22:33:33.927900+0000","last_clean":"2024-04-01T22:33:33.927900+0000","last_became_active":"2024-04-01T22:33:33.249315+0000","last_became_peered":"2024-04-01T22:33:33.249315+0000","last_unstale":"2024-04-01T22:33:33.927900+0000","last_undegraded":"2024-04-01T22:33:33.927900+0000","last_fullsized":"2024-04-01T22:33:33.927900+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:19:44.325870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952043+0000","last_change":"2024-04-01T22:33:27.881320+0000","last_active":"2024-04-01T22:33:34.952043+0000","last_peered":"2024-04-01T22:33:34.952043+0000","last_clean":"2024-04-01T22:33:34.952043+0000","last_became_active":"2024-04-01T22:33:27.880973+0000","last_became_peered":"2024-04-01T22:33:27.880973+0000","last_unstale":"2024-04-01T22:33:34.952043+0000","last_undegraded":"2024-04-01T22:33:34.952043+0000","last_fullsized":"2024-04-01T22:33:34.952043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:04:44.021944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952736+0000","last_change":"2024-04-01T22:33:26.845121+0000","last_active":"2024-04-01T22:33:34.952736+0000","last_peered":"2024-04-01T22:33:34.952736+0000","last_clean":"2024-04-01T22:33:34.952736+0000","last_became_active":"2024-04-01T22:33:26.844852+0000","last_became_peered":"2024-04-01T22:33:26.844852+0000","last_unstale":"2024-04-01T22:33:34.952736+0000","last_undegraded":"2024-04-01T22:33:34.952736+0000","last_fullsized":"2024-04-01T22:33:34.952736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:58:40.837557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951215+0000","last_change":"2024-04-01T22:33:32.846922+0000","last_active":"2024-04-01T22:33:34.951215+0000","last_peered":"2024-04-01T22:33:34.951215+0000","last_clean":"2024-04-01T22:33:34.951215+0000","last_became_active":"2024-04-01T22:33:32.846387+0000","last_became_peered":"2024-04-01T22:33:32.846387+0000","last_unstale":"2024-04-01T22:33:34.951215+0000","last_undegraded":"2024-04-01T22:33:34.951215+0000","last_fullsized":"2024-04-01T22:33:34.951215+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:08:05.436698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951684+0000","last_change":"2024-04-01T22:33:27.884447+0000","last_active":"2024-04-01T22:33:34.951684+0000","last_peered":"2024-04-01T22:33:34.951684+0000","last_clean":"2024-04-01T22:33:34.951684+0000","last_became_active":"2024-04-01T22:33:27.884148+0000","last_became_peered":"2024-04-01T22:33:27.884148+0000","last_unstale":"2024-04-01T22:33:34.951684+0000","last_undegraded":"2024-04-01T22:33:34.951684+0000","last_fullsized":"2024-04-01T22:33:34.951684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:08:00.537270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.922675+0000","last_change":"2024-04-01T22:33:26.844884+0000","last_active":"2024-04-01T22:33:33.922675+0000","last_peered":"2024-04-01T22:33:33.922675+0000","last_clean":"2024-04-01T22:33:33.922675+0000","last_became_active":"2024-04-01T22:33:26.844583+0000","last_became_peered":"2024-04-01T22:33:26.844583+0000","last_unstale":"2024-04-01T22:33:33.922675+0000","last_undegraded":"2024-04-01T22:33:33.922675+0000","last_fullsized":"2024-04-01T22:33:33.922675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:25:41.744696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951498+0000","last_change":"2024-04-01T22:33:32.845036+0000","last_active":"2024-04-01T22:33:34.951498+0000","last_peered":"2024-04-01T22:33:34.951498+0000","last_clean":"2024-04-01T22:33:34.951498+0000","last_became_active":"2024-04-01T22:33:32.844555+0000","last_became_peered":"2024-04-01T22:33:32.844555+0000","last_unstale":"2024-04-01T22:33:34.951498+0000","last_undegraded":"2024-04-01T22:33:34.951498+0000","last_fullsized":"2024-04-01T22:33:34.951498+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:43:44.388503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.461062+0000","last_change":"2024-04-01T22:33:27.950227+0000","last_active":"2024-04-01T22:33:34.461062+0000","last_peered":"2024-04-01T22:33:34.461062+0000","last_clean":"2024-04-01T22:33:34.461062+0000","last_became_active":"2024-04-01T22:33:27.949366+0000","last_became_peered":"2024-04-01T22:33:27.949366+0000","last_unstale":"2024-04-01T22:33:34.461062+0000","last_undegraded":"2024-04-01T22:33:34.461062+0000","last_fullsized":"2024-04-01T22:33:34.461062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:16:58.889368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.461092+0000","last_change":"2024-04-01T22:33:26.830463+0000","last_active":"2024-04-01T22:33:34.461092+0000","last_peered":"2024-04-01T22:33:34.461092+0000","last_clean":"2024-04-01T22:33:34.461092+0000","last_became_active":"2024-04-01T22:33:26.830179+0000","last_became_peered":"2024-04-01T22:33:26.830179+0000","last_unstale":"2024-04-01T22:33:34.461092+0000","last_undegraded":"2024-04-01T22:33:34.461092+0000","last_fullsized":"2024-04-01T22:33:34.461092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:38:14.576161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.889068+0000","last_change":"2024-04-01T22:33:33.252812+0000","last_active":"2024-04-01T22:33:33.889068+0000","last_peered":"2024-04-01T22:33:33.889068+0000","last_clean":"2024-04-01T22:33:33.889068+0000","last_became_active":"2024-04-01T22:33:33.252412+0000","last_became_peered":"2024-04-01T22:33:33.252412+0000","last_unstale":"2024-04-01T22:33:33.889068+0000","last_undegraded":"2024-04-01T22:33:33.889068+0000","last_fullsized":"2024-04-01T22:33:33.889068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:53:38.442260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951687+0000","last_change":"2024-04-01T22:33:27.880363+0000","last_active":"2024-04-01T22:33:34.951687+0000","last_peered":"2024-04-01T22:33:34.951687+0000","last_clean":"2024-04-01T22:33:34.951687+0000","last_became_active":"2024-04-01T22:33:27.880096+0000","last_became_peered":"2024-04-01T22:33:27.880096+0000","last_unstale":"2024-04-01T22:33:34.951687+0000","last_undegraded":"2024-04-01T22:33:34.951687+0000","last_fullsized":"2024-04-01T22:33:34.951687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:19:20.248510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.928312+0000","last_change":"2024-04-01T22:33:26.855823+0000","last_active":"2024-04-01T22:33:33.928312+0000","last_peered":"2024-04-01T22:33:33.928312+0000","last_clean":"2024-04-01T22:33:33.928312+0000","last_became_active":"2024-04-01T22:33:26.855475+0000","last_became_peered":"2024-04-01T22:33:26.855475+0000","last_unstale":"2024-04-01T22:33:33.928312+0000","last_undegraded":"2024-04-01T22:33:33.928312+0000","last_fullsized":"2024-04-01T22:33:33.928312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:39:29.846272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.888468+0000","last_change":"2024-04-01T22:33:33.249941+0000","last_active":"2024-04-01T22:33:33.888468+0000","last_peered":"2024-04-01T22:33:33.888468+0000","last_clean":"2024-04-01T22:33:33.888468+0000","last_became_active":"2024-04-01T22:33:33.249352+0000","last_became_peered":"2024-04-01T22:33:33.249352+0000","last_unstale":"2024-04-01T22:33:33.888468+0000","last_undegraded":"2024-04-01T22:33:33.888468+0000","last_fullsized":"2024-04-01T22:33:33.888468+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:36:10.226231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951586+0000","last_change":"2024-04-01T22:33:27.948988+0000","last_active":"2024-04-01T22:33:34.951586+0000","last_peered":"2024-04-01T22:33:34.951586+0000","last_clean":"2024-04-01T22:33:34.951586+0000","last_became_active":"2024-04-01T22:33:27.948691+0000","last_became_peered":"2024-04-01T22:33:27.948691+0000","last_unstale":"2024-04-01T22:33:34.951586+0000","last_undegraded":"2024-04-01T22:33:34.951586+0000","last_fullsized":"2024-04-01T22:33:34.951586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:23:08.563134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952149+0000","last_change":"2024-04-01T22:33:26.849911+0000","last_active":"2024-04-01T22:33:34.952149+0000","last_peered":"2024-04-01T22:33:34.952149+0000","last_clean":"2024-04-01T22:33:34.952149+0000","last_became_active":"2024-04-01T22:33:26.849646+0000","last_became_peered":"2024-04-01T22:33:26.849646+0000","last_unstale":"2024-04-01T22:33:34.952149+0000","last_undegraded":"2024-04-01T22:33:34.952149+0000","last_fullsized":"2024-04-01T22:33:34.952149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:29:59.992702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.928541+0000","last_change":"2024-04-01T22:33:33.250214+0000","last_active":"2024-04-01T22:33:33.928541+0000","last_peered":"2024-04-01T22:33:33.928541+0000","last_clean":"2024-04-01T22:33:33.928541+0000","last_became_active":"2024-04-01T22:33:33.249853+0000","last_became_peered":"2024-04-01T22:33:33.249853+0000","last_unstale":"2024-04-01T22:33:33.928541+0000","last_undegraded":"2024-04-01T22:33:33.928541+0000","last_fullsized":"2024-04-01T22:33:33.928541+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:57:12.343606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951878+0000","last_change":"2024-04-01T22:33:27.881155+0000","last_active":"2024-04-01T22:33:34.951878+0000","last_peered":"2024-04-01T22:33:34.951878+0000","last_clean":"2024-04-01T22:33:34.951878+0000","last_became_active":"2024-04-01T22:33:27.880881+0000","last_became_peered":"2024-04-01T22:33:27.880881+0000","last_unstale":"2024-04-01T22:33:34.951878+0000","last_undegraded":"2024-04-01T22:33:34.951878+0000","last_fullsized":"2024-04-01T22:33:34.951878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:47:05.004078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:50.387811+0000","last_change":"2024-04-01T22:33:26.855687+0000","last_active":"2024-04-01T22:33:50.387811+0000","last_peered":"2024-04-01T22:33:50.387811+0000","last_clean":"2024-04-01T22:33:50.387811+0000","last_became_active":"2024-04-01T22:33:26.855400+0000","last_became_peered":"2024-04-01T22:33:26.855400+0000","last_unstale":"2024-04-01T22:33:50.387811+0000","last_undegraded":"2024-04-01T22:33:50.387811+0000","last_fullsized":"2024-04-01T22:33:50.387811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:39:29.846272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952386+0000","last_change":"2024-04-01T22:33:32.846727+0000","last_active":"2024-04-01T22:33:34.952386+0000","last_peered":"2024-04-01T22:33:34.952386+0000","last_clean":"2024-04-01T22:33:34.952386+0000","last_became_active":"2024-04-01T22:33:32.846156+0000","last_became_peered":"2024-04-01T22:33:32.846156+0000","last_unstale":"2024-04-01T22:33:34.952386+0000","last_undegraded":"2024-04-01T22:33:34.952386+0000","last_fullsized":"2024-04-01T22:33:34.952386+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:57:05.158344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952804+0000","last_change":"2024-04-01T22:33:27.879445+0000","last_active":"2024-04-01T22:33:34.952804+0000","last_peered":"2024-04-01T22:33:34.952804+0000","last_clean":"2024-04-01T22:33:34.952804+0000","last_became_active":"2024-04-01T22:33:27.879165+0000","last_became_peered":"2024-04-01T22:33:27.879165+0000","last_unstale":"2024-04-01T22:33:34.952804+0000","last_undegraded":"2024-04-01T22:33:34.952804+0000","last_fullsized":"2024-04-01T22:33:34.952804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:18:56.971360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951928+0000","last_change":"2024-04-01T22:33:26.851767+0000","last_active":"2024-04-01T22:33:34.951928+0000","last_peered":"2024-04-01T22:33:34.951928+0000","last_clean":"2024-04-01T22:33:34.951928+0000","last_became_active":"2024-04-01T22:33:26.851489+0000","last_became_peered":"2024-04-01T22:33:26.851489+0000","last_unstale":"2024-04-01T22:33:34.951928+0000","last_undegraded":"2024-04-01T22:33:34.951928+0000","last_fullsized":"2024-04-01T22:33:34.951928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:49:51.408086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952253+0000","last_change":"2024-04-01T22:33:32.846386+0000","last_active":"2024-04-01T22:33:34.952253+0000","last_peered":"2024-04-01T22:33:34.952253+0000","last_clean":"2024-04-01T22:33:34.952253+0000","last_became_active":"2024-04-01T22:33:32.846024+0000","last_became_peered":"2024-04-01T22:33:32.846024+0000","last_unstale":"2024-04-01T22:33:34.952253+0000","last_undegraded":"2024-04-01T22:33:34.952253+0000","last_fullsized":"2024-04-01T22:33:34.952253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:39:33.591520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951498+0000","last_change":"2024-04-01T22:33:27.974120+0000","last_active":"2024-04-01T22:33:34.951498+0000","last_peered":"2024-04-01T22:33:34.951498+0000","last_clean":"2024-04-01T22:33:34.951498+0000","last_became_active":"2024-04-01T22:33:27.973846+0000","last_became_peered":"2024-04-01T22:33:27.973846+0000","last_unstale":"2024-04-01T22:33:34.951498+0000","last_undegraded":"2024-04-01T22:33:34.951498+0000","last_fullsized":"2024-04-01T22:33:34.951498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:15:46.224658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.928629+0000","last_change":"2024-04-01T22:33:26.831927+0000","last_active":"2024-04-01T22:33:33.928629+0000","last_peered":"2024-04-01T22:33:33.928629+0000","last_clean":"2024-04-01T22:33:33.928629+0000","last_became_active":"2024-04-01T22:33:26.831676+0000","last_became_peered":"2024-04-01T22:33:26.831676+0000","last_unstale":"2024-04-01T22:33:33.928629+0000","last_undegraded":"2024-04-01T22:33:33.928629+0000","last_fullsized":"2024-04-01T22:33:33.928629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:40:49.124240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.888210+0000","last_change":"2024-04-01T22:33:32.849983+0000","last_active":"2024-04-01T22:33:33.888210+0000","last_peered":"2024-04-01T22:33:33.888210+0000","last_clean":"2024-04-01T22:33:33.888210+0000","last_became_active":"2024-04-01T22:33:32.849661+0000","last_became_peered":"2024-04-01T22:33:32.849661+0000","last_unstale":"2024-04-01T22:33:33.888210+0000","last_undegraded":"2024-04-01T22:33:33.888210+0000","last_fullsized":"2024-04-01T22:33:33.888210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:41:40.370250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.928499+0000","last_change":"2024-04-01T22:33:27.972417+0000","last_active":"2024-04-01T22:33:33.928499+0000","last_peered":"2024-04-01T22:33:33.928499+0000","last_clean":"2024-04-01T22:33:33.928499+0000","last_became_active":"2024-04-01T22:33:27.972173+0000","last_became_peered":"2024-04-01T22:33:27.972173+0000","last_unstale":"2024-04-01T22:33:33.928499+0000","last_undegraded":"2024-04-01T22:33:33.928499+0000","last_fullsized":"2024-04-01T22:33:33.928499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:47:05.004078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.461467+0000","last_change":"2024-04-01T22:33:26.831934+0000","last_active":"2024-04-01T22:33:34.461467+0000","last_peered":"2024-04-01T22:33:34.461467+0000","last_clean":"2024-04-01T22:33:34.461467+0000","last_became_active":"2024-04-01T22:33:26.831702+0000","last_became_peered":"2024-04-01T22:33:26.831702+0000","last_unstale":"2024-04-01T22:33:34.461467+0000","last_undegraded":"2024-04-01T22:33:34.461467+0000","last_fullsized":"2024-04-01T22:33:34.461467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:56:04.675231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.888137+0000","last_change":"2024-04-01T22:33:33.254394+0000","last_active":"2024-04-01T22:33:33.888137+0000","last_peered":"2024-04-01T22:33:33.888137+0000","last_clean":"2024-04-01T22:33:33.888137+0000","last_became_active":"2024-04-01T22:33:33.253993+0000","last_became_peered":"2024-04-01T22:33:33.253993+0000","last_unstale":"2024-04-01T22:33:33.888137+0000","last_undegraded":"2024-04-01T22:33:33.888137+0000","last_fullsized":"2024-04-01T22:33:33.888137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:11:05.243371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951586+0000","last_change":"2024-04-01T22:33:33.253062+0000","last_active":"2024-04-01T22:33:34.951586+0000","last_peered":"2024-04-01T22:33:34.951586+0000","last_clean":"2024-04-01T22:33:34.951586+0000","last_became_active":"2024-04-01T22:33:33.252690+0000","last_became_peered":"2024-04-01T22:33:33.252690+0000","last_unstale":"2024-04-01T22:33:34.951586+0000","last_undegraded":"2024-04-01T22:33:34.951586+0000","last_fullsized":"2024-04-01T22:33:34.951586+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:04:48.921372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951704+0000","last_change":"2024-04-01T22:33:27.855871+0000","last_active":"2024-04-01T22:33:34.951704+0000","last_peered":"2024-04-01T22:33:34.951704+0000","last_clean":"2024-04-01T22:33:34.951704+0000","last_became_active":"2024-04-01T22:33:27.855609+0000","last_became_peered":"2024-04-01T22:33:27.855609+0000","last_unstale":"2024-04-01T22:33:34.951704+0000","last_undegraded":"2024-04-01T22:33:34.951704+0000","last_fullsized":"2024-04-01T22:33:34.951704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:43:03.166262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.928074+0000","last_change":"2024-04-01T22:33:26.831819+0000","last_active":"2024-04-01T22:33:33.928074+0000","last_peered":"2024-04-01T22:33:33.928074+0000","last_clean":"2024-04-01T22:33:33.928074+0000","last_became_active":"2024-04-01T22:33:26.831554+0000","last_became_peered":"2024-04-01T22:33:26.831554+0000","last_unstale":"2024-04-01T22:33:33.928074+0000","last_undegraded":"2024-04-01T22:33:33.928074+0000","last_fullsized":"2024-04-01T22:33:33.928074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:56:04.675231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.461455+0000","last_change":"2024-04-01T22:33:32.849917+0000","last_active":"2024-04-01T22:33:34.461455+0000","last_peered":"2024-04-01T22:33:34.461455+0000","last_clean":"2024-04-01T22:33:34.461455+0000","last_became_active":"2024-04-01T22:33:32.849536+0000","last_became_peered":"2024-04-01T22:33:32.849536+0000","last_unstale":"2024-04-01T22:33:34.461455+0000","last_undegraded":"2024-04-01T22:33:34.461455+0000","last_fullsized":"2024-04-01T22:33:34.461455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:41:50.766262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.888180+0000","last_change":"2024-04-01T22:33:27.950424+0000","last_active":"2024-04-01T22:33:33.888180+0000","last_peered":"2024-04-01T22:33:33.888180+0000","last_clean":"2024-04-01T22:33:33.888180+0000","last_became_active":"2024-04-01T22:33:27.950148+0000","last_became_peered":"2024-04-01T22:33:27.950148+0000","last_unstale":"2024-04-01T22:33:33.888180+0000","last_undegraded":"2024-04-01T22:33:33.888180+0000","last_fullsized":"2024-04-01T22:33:33.888180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:50:04.913482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.888390+0000","last_change":"2024-04-01T22:33:26.855715+0000","last_active":"2024-04-01T22:33:33.888390+0000","last_peered":"2024-04-01T22:33:33.888390+0000","last_clean":"2024-04-01T22:33:33.888390+0000","last_became_active":"2024-04-01T22:33:26.855136+0000","last_became_peered":"2024-04-01T22:33:26.855136+0000","last_unstale":"2024-04-01T22:33:33.888390+0000","last_undegraded":"2024-04-01T22:33:33.888390+0000","last_fullsized":"2024-04-01T22:33:33.888390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:19:52.712250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.461188+0000","last_change":"2024-04-01T22:33:26.830837+0000","last_active":"2024-04-01T22:33:34.461188+0000","last_peered":"2024-04-01T22:33:34.461188+0000","last_clean":"2024-04-01T22:33:34.461188+0000","last_became_active":"2024-04-01T22:33:26.830563+0000","last_became_peered":"2024-04-01T22:33:26.830563+0000","last_unstale":"2024-04-01T22:33:34.461188+0000","last_undegraded":"2024-04-01T22:33:34.461188+0000","last_fullsized":"2024-04-01T22:33:34.461188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:40:49.124240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951958+0000","last_change":"2024-04-01T22:33:27.951393+0000","last_active":"2024-04-01T22:33:34.951958+0000","last_peered":"2024-04-01T22:33:34.951958+0000","last_clean":"2024-04-01T22:33:34.951958+0000","last_became_active":"2024-04-01T22:33:27.951103+0000","last_became_peered":"2024-04-01T22:33:27.951103+0000","last_unstale":"2024-04-01T22:33:34.951958+0000","last_undegraded":"2024-04-01T22:33:34.951958+0000","last_fullsized":"2024-04-01T22:33:34.951958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:43:57.121738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.922872+0000","last_change":"2024-04-01T22:33:32.846734+0000","last_active":"2024-04-01T22:33:33.922872+0000","last_peered":"2024-04-01T22:33:33.922872+0000","last_clean":"2024-04-01T22:33:33.922872+0000","last_became_active":"2024-04-01T22:33:32.846376+0000","last_became_peered":"2024-04-01T22:33:32.846376+0000","last_unstale":"2024-04-01T22:33:33.922872+0000","last_undegraded":"2024-04-01T22:33:33.922872+0000","last_fullsized":"2024-04-01T22:33:33.922872+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:50:41.471405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.888862+0000","last_change":"2024-04-01T22:33:26.855529+0000","last_active":"2024-04-01T22:33:33.888862+0000","last_peered":"2024-04-01T22:33:33.888862+0000","last_clean":"2024-04-01T22:33:33.888862+0000","last_became_active":"2024-04-01T22:33:26.855101+0000","last_became_peered":"2024-04-01T22:33:26.855101+0000","last_unstale":"2024-04-01T22:33:33.888862+0000","last_undegraded":"2024-04-01T22:33:33.888862+0000","last_fullsized":"2024-04-01T22:33:33.888862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:40:49.124240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951924+0000","last_change":"2024-04-01T22:33:27.868702+0000","last_active":"2024-04-01T22:33:34.951924+0000","last_peered":"2024-04-01T22:33:34.951924+0000","last_clean":"2024-04-01T22:33:34.951924+0000","last_became_active":"2024-04-01T22:33:27.868297+0000","last_became_peered":"2024-04-01T22:33:27.868297+0000","last_unstale":"2024-04-01T22:33:34.951924+0000","last_undegraded":"2024-04-01T22:33:34.951924+0000","last_fullsized":"2024-04-01T22:33:34.951924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:39:30.974746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.888640+0000","last_change":"2024-04-01T22:33:32.848515+0000","last_active":"2024-04-01T22:33:33.888640+0000","last_peered":"2024-04-01T22:33:33.888640+0000","last_clean":"2024-04-01T22:33:33.888640+0000","last_became_active":"2024-04-01T22:33:32.848148+0000","last_became_peered":"2024-04-01T22:33:32.848148+0000","last_unstale":"2024-04-01T22:33:33.888640+0000","last_undegraded":"2024-04-01T22:33:33.888640+0000","last_fullsized":"2024-04-01T22:33:33.888640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:27:10.705431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.460987+0000","last_change":"2024-04-01T22:33:27.950106+0000","last_active":"2024-04-01T22:33:34.460987+0000","last_peered":"2024-04-01T22:33:34.460987+0000","last_clean":"2024-04-01T22:33:34.460987+0000","last_became_active":"2024-04-01T22:33:27.949843+0000","last_became_peered":"2024-04-01T22:33:27.949843+0000","last_unstale":"2024-04-01T22:33:34.460987+0000","last_undegraded":"2024-04-01T22:33:34.460987+0000","last_fullsized":"2024-04-01T22:33:34.460987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:23:08.563134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.922800+0000","last_change":"2024-04-01T22:33:27.974409+0000","last_active":"2024-04-01T22:33:33.922800+0000","last_peered":"2024-04-01T22:33:33.922800+0000","last_clean":"2024-04-01T22:33:33.922800+0000","last_became_active":"2024-04-01T22:33:27.974128+0000","last_became_peered":"2024-04-01T22:33:27.974128+0000","last_unstale":"2024-04-01T22:33:33.922800+0000","last_undegraded":"2024-04-01T22:33:33.922800+0000","last_fullsized":"2024-04-01T22:33:33.922800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:49:52.536559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.928138+0000","last_change":"2024-04-01T22:33:27.974885+0000","last_active":"2024-04-01T22:33:33.928138+0000","last_peered":"2024-04-01T22:33:33.928138+0000","last_clean":"2024-04-01T22:33:33.928138+0000","last_became_active":"2024-04-01T22:33:27.973988+0000","last_became_peered":"2024-04-01T22:33:27.973988+0000","last_unstale":"2024-04-01T22:33:33.928138+0000","last_undegraded":"2024-04-01T22:33:33.928138+0000","last_fullsized":"2024-04-01T22:33:33.928138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:56:25.952727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951857+0000","last_change":"2024-04-01T22:33:27.950817+0000","last_active":"2024-04-01T22:33:34.951857+0000","last_peered":"2024-04-01T22:33:34.951857+0000","last_clean":"2024-04-01T22:33:34.951857+0000","last_became_active":"2024-04-01T22:33:27.950515+0000","last_became_peered":"2024-04-01T22:33:27.950515+0000","last_unstale":"2024-04-01T22:33:34.951857+0000","last_undegraded":"2024-04-01T22:33:34.951857+0000","last_fullsized":"2024-04-01T22:33:34.951857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:48:53.083180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.888679+0000","last_change":"2024-04-01T22:33:27.869385+0000","last_active":"2024-04-01T22:33:33.888679+0000","last_peered":"2024-04-01T22:33:33.888679+0000","last_clean":"2024-04-01T22:33:33.888679+0000","last_became_active":"2024-04-01T22:33:27.869102+0000","last_became_peered":"2024-04-01T22:33:27.869102+0000","last_unstale":"2024-04-01T22:33:33.888679+0000","last_undegraded":"2024-04-01T22:33:33.888679+0000","last_fullsized":"2024-04-01T22:33:33.888679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:43:57.121738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951730+0000","last_change":"2024-04-01T22:33:27.856463+0000","last_active":"2024-04-01T22:33:34.951730+0000","last_peered":"2024-04-01T22:33:34.951730+0000","last_clean":"2024-04-01T22:33:34.951730+0000","last_became_active":"2024-04-01T22:33:27.856213+0000","last_became_peered":"2024-04-01T22:33:27.856213+0000","last_unstale":"2024-04-01T22:33:34.951730+0000","last_undegraded":"2024-04-01T22:33:34.951730+0000","last_fullsized":"2024-04-01T22:33:34.951730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:43:57.121738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.461341+0000","last_change":"2024-04-01T22:33:27.921487+0000","last_active":"2024-04-01T22:33:34.461341+0000","last_peered":"2024-04-01T22:33:34.461341+0000","last_clean":"2024-04-01T22:33:34.461341+0000","last_became_active":"2024-04-01T22:33:27.921229+0000","last_became_peered":"2024-04-01T22:33:27.921229+0000","last_unstale":"2024-04-01T22:33:34.461341+0000","last_undegraded":"2024-04-01T22:33:34.461341+0000","last_fullsized":"2024-04-01T22:33:34.461341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:43:03.166262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.889006+0000","last_change":"2024-04-01T22:33:27.868732+0000","last_active":"2024-04-01T22:33:33.889006+0000","last_peered":"2024-04-01T22:33:33.889006+0000","last_clean":"2024-04-01T22:33:33.889006+0000","last_became_active":"2024-04-01T22:33:27.868496+0000","last_became_peered":"2024-04-01T22:33:27.868496+0000","last_unstale":"2024-04-01T22:33:33.889006+0000","last_undegraded":"2024-04-01T22:33:33.889006+0000","last_fullsized":"2024-04-01T22:33:33.889006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:56:25.952727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.927973+0000","last_change":"2024-04-01T22:33:27.974270+0000","last_active":"2024-04-01T22:33:33.927973+0000","last_peered":"2024-04-01T22:33:33.927973+0000","last_clean":"2024-04-01T22:33:33.927973+0000","last_became_active":"2024-04-01T22:33:27.973851+0000","last_became_peered":"2024-04-01T22:33:27.973851+0000","last_unstale":"2024-04-01T22:33:33.927973+0000","last_undegraded":"2024-04-01T22:33:33.927973+0000","last_fullsized":"2024-04-01T22:33:33.927973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:43:57.121738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.888229+0000","last_change":"2024-04-01T22:33:27.868810+0000","last_active":"2024-04-01T22:33:33.888229+0000","last_peered":"2024-04-01T22:33:33.888229+0000","last_clean":"2024-04-01T22:33:33.888229+0000","last_became_active":"2024-04-01T22:33:27.868555+0000","last_became_peered":"2024-04-01T22:33:27.868555+0000","last_unstale":"2024-04-01T22:33:33.888229+0000","last_undegraded":"2024-04-01T22:33:33.888229+0000","last_fullsized":"2024-04-01T22:33:33.888229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:48:53.083180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.928102+0000","last_change":"2024-04-01T22:33:27.979380+0000","last_active":"2024-04-01T22:33:33.928102+0000","last_peered":"2024-04-01T22:33:33.928102+0000","last_clean":"2024-04-01T22:33:33.928102+0000","last_became_active":"2024-04-01T22:33:27.979108+0000","last_became_peered":"2024-04-01T22:33:27.979108+0000","last_unstale":"2024-04-01T22:33:33.928102+0000","last_undegraded":"2024-04-01T22:33:33.928102+0000","last_fullsized":"2024-04-01T22:33:33.928102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:50:04.913482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951586+0000","last_change":"2024-04-01T22:33:27.953950+0000","last_active":"2024-04-01T22:33:34.951586+0000","last_peered":"2024-04-01T22:33:34.951586+0000","last_clean":"2024-04-01T22:33:34.951586+0000","last_became_active":"2024-04-01T22:33:27.953674+0000","last_became_peered":"2024-04-01T22:33:27.953674+0000","last_unstale":"2024-04-01T22:33:34.951586+0000","last_undegraded":"2024-04-01T22:33:34.951586+0000","last_fullsized":"2024-04-01T22:33:34.951586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:01:14.826403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.461293+0000","last_change":"2024-04-01T22:33:27.919041+0000","last_active":"2024-04-01T22:33:34.461293+0000","last_peered":"2024-04-01T22:33:34.461293+0000","last_clean":"2024-04-01T22:33:34.461293+0000","last_became_active":"2024-04-01T22:33:27.918815+0000","last_became_peered":"2024-04-01T22:33:27.918815+0000","last_unstale":"2024-04-01T22:33:34.461293+0000","last_undegraded":"2024-04-01T22:33:34.461293+0000","last_fullsized":"2024-04-01T22:33:34.461293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:15:08.500466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952144+0000","last_change":"2024-04-01T22:33:27.881613+0000","last_active":"2024-04-01T22:33:34.952144+0000","last_peered":"2024-04-01T22:33:34.952144+0000","last_clean":"2024-04-01T22:33:34.952144+0000","last_became_active":"2024-04-01T22:33:27.881372+0000","last_became_peered":"2024-04-01T22:33:27.881372+0000","last_unstale":"2024-04-01T22:33:34.952144+0000","last_undegraded":"2024-04-01T22:33:34.952144+0000","last_fullsized":"2024-04-01T22:33:34.952144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:28:13.071380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.923124+0000","last_change":"2024-04-01T22:33:27.919025+0000","last_active":"2024-04-01T22:33:33.923124+0000","last_peered":"2024-04-01T22:33:33.923124+0000","last_clean":"2024-04-01T22:33:33.923124+0000","last_became_active":"2024-04-01T22:33:27.918749+0000","last_became_peered":"2024-04-01T22:33:27.918749+0000","last_unstale":"2024-04-01T22:33:33.923124+0000","last_undegraded":"2024-04-01T22:33:33.923124+0000","last_fullsized":"2024-04-01T22:33:33.923124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:47:19.535942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.928684+0000","last_change":"2024-04-01T22:33:27.979289+0000","last_active":"2024-04-01T22:33:33.928684+0000","last_peered":"2024-04-01T22:33:33.928684+0000","last_clean":"2024-04-01T22:33:33.928684+0000","last_became_active":"2024-04-01T22:33:27.979036+0000","last_became_peered":"2024-04-01T22:33:27.979036+0000","last_unstale":"2024-04-01T22:33:33.928684+0000","last_undegraded":"2024-04-01T22:33:33.928684+0000","last_fullsized":"2024-04-01T22:33:33.928684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:19:20.248510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.927816+0000","last_change":"2024-04-01T22:33:27.974214+0000","last_active":"2024-04-01T22:33:33.927816+0000","last_peered":"2024-04-01T22:33:33.927816+0000","last_clean":"2024-04-01T22:33:33.927816+0000","last_became_active":"2024-04-01T22:33:27.973962+0000","last_became_peered":"2024-04-01T22:33:27.973962+0000","last_unstale":"2024-04-01T22:33:33.927816+0000","last_undegraded":"2024-04-01T22:33:33.927816+0000","last_fullsized":"2024-04-01T22:33:33.927816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:15:08.500466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951787+0000","last_change":"2024-04-01T22:33:27.869600+0000","last_active":"2024-04-01T22:33:34.951787+0000","last_peered":"2024-04-01T22:33:34.951787+0000","last_clean":"2024-04-01T22:33:34.951787+0000","last_became_active":"2024-04-01T22:33:27.869279+0000","last_became_peered":"2024-04-01T22:33:27.869279+0000","last_unstale":"2024-04-01T22:33:34.951787+0000","last_undegraded":"2024-04-01T22:33:34.951787+0000","last_fullsized":"2024-04-01T22:33:34.951787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:16:58.889368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951503+0000","last_change":"2024-04-01T22:33:27.948313+0000","last_active":"2024-04-01T22:33:34.951503+0000","last_peered":"2024-04-01T22:33:34.951503+0000","last_clean":"2024-04-01T22:33:34.951503+0000","last_became_active":"2024-04-01T22:33:27.947834+0000","last_became_peered":"2024-04-01T22:33:27.947834+0000","last_unstale":"2024-04-01T22:33:34.951503+0000","last_undegraded":"2024-04-01T22:33:34.951503+0000","last_fullsized":"2024-04-01T22:33:34.951503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:50:36.571977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.888650+0000","last_change":"2024-04-01T22:33:27.915571+0000","last_active":"2024-04-01T22:33:33.888650+0000","last_peered":"2024-04-01T22:33:33.888650+0000","last_clean":"2024-04-01T22:33:33.888650+0000","last_became_active":"2024-04-01T22:33:27.915372+0000","last_became_peered":"2024-04-01T22:33:27.915372+0000","last_unstale":"2024-04-01T22:33:33.888650+0000","last_undegraded":"2024-04-01T22:33:33.888650+0000","last_fullsized":"2024-04-01T22:33:33.888650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:15:46.224658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952790+0000","last_change":"2024-04-01T22:33:27.915752+0000","last_active":"2024-04-01T22:33:34.952790+0000","last_peered":"2024-04-01T22:33:34.952790+0000","last_clean":"2024-04-01T22:33:34.952790+0000","last_became_active":"2024-04-01T22:33:27.915515+0000","last_became_peered":"2024-04-01T22:33:27.915515+0000","last_unstale":"2024-04-01T22:33:34.952790+0000","last_undegraded":"2024-04-01T22:33:34.952790+0000","last_fullsized":"2024-04-01T22:33:34.952790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:47:19.535942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.461251+0000","last_change":"2024-04-01T22:33:27.974798+0000","last_active":"2024-04-01T22:33:34.461251+0000","last_peered":"2024-04-01T22:33:34.461251+0000","last_clean":"2024-04-01T22:33:34.461251+0000","last_became_active":"2024-04-01T22:33:27.974558+0000","last_became_peered":"2024-04-01T22:33:27.974558+0000","last_unstale":"2024-04-01T22:33:34.461251+0000","last_undegraded":"2024-04-01T22:33:34.461251+0000","last_fullsized":"2024-04-01T22:33:34.461251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:15:46.224658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.461300+0000","last_change":"2024-04-01T22:33:27.974420+0000","last_active":"2024-04-01T22:33:34.461300+0000","last_peered":"2024-04-01T22:33:34.461300+0000","last_clean":"2024-04-01T22:33:34.461300+0000","last_became_active":"2024-04-01T22:33:27.974139+0000","last_became_peered":"2024-04-01T22:33:27.974139+0000","last_unstale":"2024-04-01T22:33:34.461300+0000","last_undegraded":"2024-04-01T22:33:34.461300+0000","last_fullsized":"2024-04-01T22:33:34.461300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:48:53.083180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.952369+0000","last_change":"2024-04-01T22:33:27.972053+0000","last_active":"2024-04-01T22:33:34.952369+0000","last_peered":"2024-04-01T22:33:34.952369+0000","last_clean":"2024-04-01T22:33:34.952369+0000","last_became_active":"2024-04-01T22:33:27.971803+0000","last_became_peered":"2024-04-01T22:33:27.971803+0000","last_unstale":"2024-04-01T22:33:34.952369+0000","last_undegraded":"2024-04-01T22:33:34.952369+0000","last_fullsized":"2024-04-01T22:33:34.952369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:41:45.866834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.888087+0000","last_change":"2024-04-01T22:33:27.974447+0000","last_active":"2024-04-01T22:33:33.888087+0000","last_peered":"2024-04-01T22:33:33.888087+0000","last_clean":"2024-04-01T22:33:33.888087+0000","last_became_active":"2024-04-01T22:33:27.974205+0000","last_became_peered":"2024-04-01T22:33:27.974205+0000","last_unstale":"2024-04-01T22:33:33.888087+0000","last_undegraded":"2024-04-01T22:33:33.888087+0000","last_fullsized":"2024-04-01T22:33:33.888087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:23:08.563134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951493+0000","last_change":"2024-04-01T22:33:27.949226+0000","last_active":"2024-04-01T22:33:34.951493+0000","last_peered":"2024-04-01T22:33:34.951493+0000","last_clean":"2024-04-01T22:33:34.951493+0000","last_became_active":"2024-04-01T22:33:27.948929+0000","last_became_peered":"2024-04-01T22:33:27.948929+0000","last_unstale":"2024-04-01T22:33:34.951493+0000","last_undegraded":"2024-04-01T22:33:34.951493+0000","last_fullsized":"2024-04-01T22:33:34.951493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:50:04.913482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.927965+0000","last_change":"2024-04-01T22:33:27.974650+0000","last_active":"2024-04-01T22:33:33.927965+0000","last_peered":"2024-04-01T22:33:33.927965+0000","last_clean":"2024-04-01T22:33:33.927965+0000","last_became_active":"2024-04-01T22:33:27.973891+0000","last_became_peered":"2024-04-01T22:33:27.973891+0000","last_unstale":"2024-04-01T22:33:33.927965+0000","last_undegraded":"2024-04-01T22:33:33.927965+0000","last_fullsized":"2024-04-01T22:33:33.927965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:08:00.537270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951503+0000","last_change":"2024-04-01T22:33:27.879045+0000","last_active":"2024-04-01T22:33:34.951503+0000","last_peered":"2024-04-01T22:33:34.951503+0000","last_clean":"2024-04-01T22:33:34.951503+0000","last_became_active":"2024-04-01T22:33:27.878782+0000","last_became_peered":"2024-04-01T22:33:27.878782+0000","last_unstale":"2024-04-01T22:33:34.951503+0000","last_undegraded":"2024-04-01T22:33:34.951503+0000","last_fullsized":"2024-04-01T22:33:34.951503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:56:25.952727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:33.928308+0000","last_change":"2024-04-01T22:33:27.974592+0000","last_active":"2024-04-01T22:33:33.928308+0000","last_peered":"2024-04-01T22:33:33.928308+0000","last_clean":"2024-04-01T22:33:33.928308+0000","last_became_active":"2024-04-01T22:33:27.973592+0000","last_became_peered":"2024-04-01T22:33:27.973592+0000","last_unstale":"2024-04-01T22:33:33.928308+0000","last_undegraded":"2024-04-01T22:33:33.928308+0000","last_fullsized":"2024-04-01T22:33:33.928308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:08:15.465415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951233+0000","last_change":"2024-04-01T22:33:27.948715+0000","last_active":"2024-04-01T22:33:34.951233+0000","last_peered":"2024-04-01T22:33:34.951233+0000","last_clean":"2024-04-01T22:33:34.951233+0000","last_became_active":"2024-04-01T22:33:27.948371+0000","last_became_peered":"2024-04-01T22:33:27.948371+0000","last_unstale":"2024-04-01T22:33:34.951233+0000","last_undegraded":"2024-04-01T22:33:34.951233+0000","last_fullsized":"2024-04-01T22:33:34.951233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:19:48.595176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951500+0000","last_change":"2024-04-01T22:33:27.949784+0000","last_active":"2024-04-01T22:33:34.951500+0000","last_peered":"2024-04-01T22:33:34.951500+0000","last_clean":"2024-04-01T22:33:34.951500+0000","last_became_active":"2024-04-01T22:33:27.949522+0000","last_became_peered":"2024-04-01T22:33:27.949522+0000","last_unstale":"2024-04-01T22:33:34.951500+0000","last_undegraded":"2024-04-01T22:33:34.951500+0000","last_fullsized":"2024-04-01T22:33:34.951500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:15:08.500466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-01T22:33:34.951854+0000","last_change":"2024-04-01T22:33:27.915533+0000","last_active":"2024-04-01T22:33:34.951854+0000","last_peered":"2024-04-01T22:33:34.951854+0000","last_clean":"2024-04-01T22:33:34.951854+0000","last_became_active":"2024-04-01T22:33:27.915245+0000","last_became_peered":"2024-04-01T22:33:27.915245+0000","last_unstale":"2024-04-01T22:33:34.951854+0000","last_undegraded":"2024-04-01T22:33:34.951854+0000","last_fullsized":"2024-04-01T22:33:34.951854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:39:28.692092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65062,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":695877,"data_compressed":32531,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":105017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":105053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":104927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":105087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31516,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340324,"statfs":{"total":96636764160,"available":96604491776,"internally_reserved":0,"allocated":344064,"data_stored":695933,"data_compressed":32531,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32531,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32531,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T22:34:04.018 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-01T22:34:04.019 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-01T22:34:04.019 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-01T22:34:04.019 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-01T22:34:04.019 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-01T22:34:04.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.157+0000 7f56665e5640 1 Processor -- start 2024-04-01T22:34:04.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.157+0000 7f56665e5640 1 -- start start 2024-04-01T22:34:04.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.158+0000 7f56665e5640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f566006c250 0x7f566015aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:04.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.158+0000 7f56665e5640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f566006c630 0x7f56600ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:04.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.158+0000 7f56665e5640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f56600cf0d0 0x7f566015bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:04.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.158+0000 7f56665e5640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f56600ce990 con 0x7f566006c630 2024-04-01T22:34:04.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.158+0000 7f56665e5640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f5660154b70 con 0x7f56600cf0d0 2024-04-01T22:34:04.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.158+0000 7f56665e5640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f56600cdac0 con 0x7f566006c250 2024-04-01T22:34:04.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.159+0000 7f565f7fe640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f566006c630 0x7f56600ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:04.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.159+0000 7f565ffff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f566006c250 0x7f566015aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:04.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.159+0000 7f5664b82640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f56600cf0d0 0x7f566015bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:04.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.159+0000 7f565f7fe640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f566006c630 0x7f56600ceb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47682/0 (socket says 172.21.15.47:47682) 2024-04-01T22:34:04.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.159+0000 7f5664b82640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f56600cf0d0 0x7f566015bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:44682/0 (socket says 172.21.15.47:44682) 2024-04-01T22:34:04.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.159+0000 7f565f7fe640 1 -- 172.21.15.47:0/88029232 learned_addr learned my addr 172.21.15.47:0/88029232 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:04.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.161+0000 7f5664b82640 1 -- 172.21.15.47:0/88029232 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f566006c250 msgr2=0x7f566015aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:04.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.161+0000 7f5664b82640 1 --2- 172.21.15.47:0/88029232 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f566006c250 0x7f566015aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:04.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.161+0000 7f5664b82640 1 -- 172.21.15.47:0/88029232 >> v2:172.21.15.47:3300/0 conn(0x7f566006c630 msgr2=0x7f56600ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:04.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.161+0000 7f5664b82640 1 --2- 172.21.15.47:0/88029232 >> v2:172.21.15.47:3300/0 conn(0x7f566006c630 0x7f56600ceb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:04.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.161+0000 7f5664b82640 1 -- 172.21.15.47:0/88029232 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56600cdd80 con 0x7f56600cf0d0 2024-04-01T22:34:04.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.164+0000 7f5664b82640 1 --2- 172.21.15.47:0/88029232 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56600cf0d0 0x7f566015bb20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f56600cd730 tx=0x7f565802beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2368b2764f969fba server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:04.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.167+0000 7f565effd640 1 -- 172.21.15.47:0/88029232 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5658039070 con 0x7f56600cf0d0 2024-04-01T22:34:04.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.167+0000 7f565effd640 1 -- 172.21.15.47:0/88029232 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f565802cc60 con 0x7f56600cf0d0 2024-04-01T22:34:04.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.167+0000 7f565effd640 1 -- 172.21.15.47:0/88029232 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5658034660 con 0x7f56600cf0d0 2024-04-01T22:34:04.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.168+0000 7f56665e5640 1 -- 172.21.15.47:0/88029232 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56600cf0d0 msgr2=0x7f566015bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:04.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.168+0000 7f56665e5640 1 --2- 172.21.15.47:0/88029232 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56600cf0d0 0x7f566015bb20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f56600cd730 tx=0x7f565802beb0 comp rx=0 tx=0).stop 2024-04-01T22:34:04.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.168+0000 7f56665e5640 1 -- 172.21.15.47:0/88029232 shutdown_connections 2024-04-01T22:34:04.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.168+0000 7f56665e5640 1 --2- 172.21.15.47:0/88029232 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56600cf0d0 0x7f566015bb20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:04.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.168+0000 7f56665e5640 1 --2- 172.21.15.47:0/88029232 >> v2:172.21.15.47:3300/0 conn(0x7f566006c630 0x7f56600ceb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:04.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.168+0000 7f56665e5640 1 --2- 172.21.15.47:0/88029232 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f566006c250 0x7f566015aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:04.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.168+0000 7f56665e5640 1 -- 172.21.15.47:0/88029232 >> 172.21.15.47:0/88029232 conn(0x7f56600cfdb0 msgr2=0x7f56600d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:04.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.168+0000 7f56665e5640 1 -- 172.21.15.47:0/88029232 shutdown_connections 2024-04-01T22:34:04.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.168+0000 7f56665e5640 1 -- 172.21.15.47:0/88029232 wait complete. 2024-04-01T22:34:04.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.169+0000 7f56665e5640 1 Processor -- start 2024-04-01T22:34:04.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.169+0000 7f56665e5640 1 -- start start 2024-04-01T22:34:04.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.170+0000 7f56665e5640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f566006c250 0x7f5660152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:04.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.170+0000 7f56665e5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f566006c630 0x7f56601581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:04.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.170+0000 7f56665e5640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56600b22c0 0x7f56600b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:04.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.170+0000 7f56665e5640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f56600ce620 con 0x7f566006c630 2024-04-01T22:34:04.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.170+0000 7f56665e5640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f56600ce340 con 0x7f566006c250 2024-04-01T22:34:04.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.170+0000 7f56665e5640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f566006ca30 con 0x7f56600b22c0 2024-04-01T22:34:04.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.171+0000 7f565f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f566006c630 0x7f56601581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:04.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.171+0000 7f565ffff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f566006c250 0x7f5660152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:04.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.171+0000 7f5664b82640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56600b22c0 0x7f56600b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:04.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.171+0000 7f565f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f566006c630 0x7f56601581f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47690/0 (socket says 172.21.15.47:47690) 2024-04-01T22:34:04.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.171+0000 7f565f7fe640 1 -- 172.21.15.47:0/3595552060 learned_addr learned my addr 172.21.15.47:0/3595552060 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:04.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.174+0000 7f565ffff640 1 -- 172.21.15.47:0/3595552060 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56600b22c0 msgr2=0x7f56600b4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:04.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.174+0000 7f565ffff640 1 --2- 172.21.15.47:0/3595552060 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56600b22c0 0x7f56600b4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:04.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.174+0000 7f565ffff640 1 -- 172.21.15.47:0/3595552060 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f566006c630 msgr2=0x7f56601581f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:04.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.174+0000 7f565ffff640 1 --2- 172.21.15.47:0/3595552060 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f566006c630 0x7f56601581f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:04.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.174+0000 7f565ffff640 1 -- 172.21.15.47:0/3595552060 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56600b2970 con 0x7f566006c250 2024-04-01T22:34:04.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.176+0000 7f565ffff640 1 --2- 172.21.15.47:0/3595552060 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f566006c250 0x7f5660152230 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f565000e870 tx=0x7f565000ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:04.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.180+0000 7f565cff9640 1 -- 172.21.15.47:0/3595552060 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5650017070 con 0x7f566006c250 2024-04-01T22:34:04.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.180+0000 7f565cff9640 1 -- 172.21.15.47:0/3595552060 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f565000c940 con 0x7f566006c250 2024-04-01T22:34:04.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.180+0000 7f56665e5640 1 -- 172.21.15.47:0/3595552060 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56601f04e0 con 0x7f566006c250 2024-04-01T22:34:04.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.180+0000 7f565cff9640 1 -- 172.21.15.47:0/3595552060 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f565000ccf0 con 0x7f566006c250 2024-04-01T22:34:04.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.180+0000 7f56665e5640 1 -- 172.21.15.47:0/3595552060 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56600b2f10 con 0x7f566006c250 2024-04-01T22:34:04.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.181+0000 7f56665e5640 1 -- 172.21.15.47:0/3595552060 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5660068210 con 0x7f566006c250 2024-04-01T22:34:04.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.199+0000 7f565cff9640 1 -- 172.21.15.47:0/3595552060 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f565001a070 con 0x7f566006c250 2024-04-01T22:34:04.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.199+0000 7f565cff9640 1 --2- 172.21.15.47:0/3595552060 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f564c06b990 0x7f564c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:04.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.199+0000 7f565f7fe640 1 --2- 172.21.15.47:0/3595552060 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f564c06b990 0x7f564c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:04.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.200+0000 7f565f7fe640 1 --2- 172.21.15.47:0/3595552060 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f564c06b990 0x7f564c06de50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f56601f1490 tx=0x7f5654009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:04.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.201+0000 7f565cff9640 1 -- 172.21.15.47:0/3595552060 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f5650057560 con 0x7f566006c250 2024-04-01T22:34:04.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.437+0000 7f565cff9640 1 -- 172.21.15.47:0/3595552060 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f56500594c0 con 0x7f566006c250 2024-04-01T22:34:04.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.673+0000 7f56665e5640 1 -- 172.21.15.47:0/3595552060 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f56600b5b50 con 0x7f566006c250 2024-04-01T22:34:04.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.810+0000 7f565cff9640 1 -- 172.21.15.47:0/3595552060 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+172378 (secure 0 0 0) 0x7f565005d560 con 0x7f566006c250 2024-04-01T22:34:04.812 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:34:04.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.812+0000 7f56665e5640 1 -- 172.21.15.47:0/3595552060 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f564c06b990 msgr2=0x7f564c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:04.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.812+0000 7f56665e5640 1 --2- 172.21.15.47:0/3595552060 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f564c06b990 0x7f564c06de50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f56601f1490 tx=0x7f5654009240 comp rx=0 tx=0).stop 2024-04-01T22:34:04.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.812+0000 7f56665e5640 1 -- 172.21.15.47:0/3595552060 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f566006c250 msgr2=0x7f5660152230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:04.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.812+0000 7f56665e5640 1 --2- 172.21.15.47:0/3595552060 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f566006c250 0x7f5660152230 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f565000e870 tx=0x7f565000ed30 comp rx=0 tx=0).stop 2024-04-01T22:34:04.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.812+0000 7f56665e5640 1 -- 172.21.15.47:0/3595552060 shutdown_connections 2024-04-01T22:34:04.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.812+0000 7f56665e5640 1 --2- 172.21.15.47:0/3595552060 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f564c06b990 0x7f564c06de50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:04.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.812+0000 7f56665e5640 1 --2- 172.21.15.47:0/3595552060 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f56600b22c0 0x7f56600b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:04.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.812+0000 7f56665e5640 1 --2- 172.21.15.47:0/3595552060 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f566006c630 0x7f56601581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:04.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.812+0000 7f56665e5640 1 --2- 172.21.15.47:0/3595552060 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f566006c250 0x7f5660152230 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:04.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.812+0000 7f56665e5640 1 -- 172.21.15.47:0/3595552060 >> 172.21.15.47:0/3595552060 conn(0x7f56600cfdb0 msgr2=0x7f56601541c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:04.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.812+0000 7f56665e5640 1 -- 172.21.15.47:0/3595552060 shutdown_connections 2024-04-01T22:34:04.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.812+0000 7f56665e5640 1 -- 172.21.15.47:0/3595552060 wait complete. 2024-04-01T22:34:04.823 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":1257047371},{"type":"v1","addr":"172.21.15.47:6801","nonce":1257047371}]},"active_addr":"172.21.15.47:6801/1257047371","active_change":"2024-04-01T22:33:02.604859+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4106,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":3416254746}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":2878558505}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":3797215807}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":592796816}]}]} 2024-04-01T22:34:04.826 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-01T22:34:04.826 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-01T22:34:04.826 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T22:34:04.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.937+0000 7f552f74f640 1 Processor -- start 2024-04-01T22:34:04.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.938+0000 7f552f74f640 1 -- start start 2024-04-01T22:34:04.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.939+0000 7f552f74f640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f552806c250 0x7f552815aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:04.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.939+0000 7f552f74f640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f552815bb20 0x7f552815bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:04.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.939+0000 7f552f74f640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5528154b70 con 0x7f552806c630 2024-04-01T22:34:04.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.939+0000 7f552f74f640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f55280ce990 con 0x7f552815bb20 2024-04-01T22:34:04.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.939+0000 7f552f74f640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f55280cdac0 con 0x7f552806c250 2024-04-01T22:34:04.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.944+0000 7f552d4eb640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f552806c250 0x7f552815aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:04.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.944+0000 7f552d4eb640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f552806c250 0x7f552815aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:44712/0 (socket says 172.21.15.47:44712) 2024-04-01T22:34:04.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.944+0000 7f552d4eb640 1 -- 172.21.15.47:0/1888094927 learned_addr learned my addr 172.21.15.47:0/1888094927 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:04.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.946+0000 7f552dcec640 1 --2- 172.21.15.47:0/1888094927 >> v2:172.21.15.47:3300/0 conn(0x7f552815bb20 0x7f552815bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:04.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.946+0000 7f552d4eb640 1 -- 172.21.15.47:0/1888094927 >> v2:172.21.15.47:3300/0 conn(0x7f552815bb20 msgr2=0x7f552815bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:04.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.946+0000 7f552d4eb640 1 --2- 172.21.15.47:0/1888094927 >> v2:172.21.15.47:3300/0 conn(0x7f552815bb20 0x7f552815bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:04.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.946+0000 7f552d4eb640 1 -- 172.21.15.47:0/1888094927 >> v1:172.21.15.47:6789/0 conn(0x7f552806c630 legacy=0x7f55280ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:04.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.946+0000 7f552d4eb640 1 -- 172.21.15.47:0/1888094927 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55280cf2a0 con 0x7f552806c250 2024-04-01T22:34:04.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.950+0000 7f552d4eb640 1 --2- 172.21.15.47:0/1888094927 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f552806c250 0x7f552815aec0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f552806b660 tx=0x7f552402b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16ba8ebb88f78daa server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:04.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.957+0000 7f551ffff640 1 -- 172.21.15.47:0/1888094927 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5524034070 con 0x7f552806c250 2024-04-01T22:34:04.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.957+0000 7f551ffff640 1 -- 172.21.15.47:0/1888094927 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5524030860 con 0x7f552806c250 2024-04-01T22:34:04.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.957+0000 7f551ffff640 1 -- 172.21.15.47:0/1888094927 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5524030c30 con 0x7f552806c250 2024-04-01T22:34:04.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.958+0000 7f552f74f640 1 -- 172.21.15.47:0/1888094927 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f552806c250 msgr2=0x7f552815aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:04.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.958+0000 7f552f74f640 1 --2- 172.21.15.47:0/1888094927 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f552806c250 0x7f552815aec0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f552806b660 tx=0x7f552402b9a0 comp rx=0 tx=0).stop 2024-04-01T22:34:04.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.958+0000 7f552f74f640 1 -- 172.21.15.47:0/1888094927 shutdown_connections 2024-04-01T22:34:04.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.958+0000 7f552f74f640 1 --2- 172.21.15.47:0/1888094927 >> v2:172.21.15.47:3300/0 conn(0x7f552815bb20 0x7f552815bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:04.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.958+0000 7f552f74f640 1 --2- 172.21.15.47:0/1888094927 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f552806c250 0x7f552815aec0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:04.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.958+0000 7f552f74f640 1 -- 172.21.15.47:0/1888094927 >> 172.21.15.47:0/1888094927 conn(0x7f55280cfdb0 msgr2=0x7f55280d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:04.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.958+0000 7f552f74f640 1 -- 172.21.15.47:0/1888094927 shutdown_connections 2024-04-01T22:34:04.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.958+0000 7f552f74f640 1 -- 172.21.15.47:0/1888094927 wait complete. 2024-04-01T22:34:04.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.960+0000 7f552f74f640 1 Processor -- start 2024-04-01T22:34:04.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.960+0000 7f552f74f640 1 -- start start 2024-04-01T22:34:04.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.961+0000 7f552f74f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f552806c250 0x7f55281524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:04.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.961+0000 7f552f74f640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f552806c630 0x7f55280b0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:04.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.961+0000 7f552f74f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f552815bb20 0x7f55280b1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:04.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.961+0000 7f552f74f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f55280ce340 con 0x7f552815bb20 2024-04-01T22:34:04.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.961+0000 7f552f74f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f55280ce060 con 0x7f552806c250 2024-04-01T22:34:04.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.961+0000 7f552f74f640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f55280ce620 con 0x7f552806c630 2024-04-01T22:34:04.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.961+0000 7f552d4eb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f552806c250 0x7f55281524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:04.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.961+0000 7f552ccea640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f552806c630 0x7f55280b0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:04.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.962+0000 7f552d4eb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f552806c250 0x7f55281524f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:44716/0 (socket says 172.21.15.47:44716) 2024-04-01T22:34:04.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.962+0000 7f552d4eb640 1 -- 172.21.15.47:0/2827297326 learned_addr learned my addr 172.21.15.47:0/2827297326 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:04.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.963+0000 7f552dcec640 1 --2- 172.21.15.47:0/2827297326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f552815bb20 0x7f55280b1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:04.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.965+0000 7f552d4eb640 1 -- 172.21.15.47:0/2827297326 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f552806c630 msgr2=0x7f55280b0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:04.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.965+0000 7f552d4eb640 1 --2- 172.21.15.47:0/2827297326 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f552806c630 0x7f55280b0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:04.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.965+0000 7f552d4eb640 1 -- 172.21.15.47:0/2827297326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f552815bb20 msgr2=0x7f55280b1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:04.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.965+0000 7f552d4eb640 1 --2- 172.21.15.47:0/2827297326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f552815bb20 0x7f55280b1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:04.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.965+0000 7f552d4eb640 1 -- 172.21.15.47:0/2827297326 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55280b1d80 con 0x7f552806c250 2024-04-01T22:34:04.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.967+0000 7f552d4eb640 1 --2- 172.21.15.47:0/2827297326 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f552806c250 0x7f55281524f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5524000c00 tx=0x7f5524004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:04.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.975+0000 7f551dffb640 1 -- 172.21.15.47:0/2827297326 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5524048070 con 0x7f552806c250 2024-04-01T22:34:04.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.975+0000 7f551dffb640 1 -- 172.21.15.47:0/2827297326 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5524039d90 con 0x7f552806c250 2024-04-01T22:34:04.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.975+0000 7f551dffb640 1 -- 172.21.15.47:0/2827297326 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5524034040 con 0x7f552806c250 2024-04-01T22:34:04.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.975+0000 7f552f74f640 1 -- 172.21.15.47:0/2827297326 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55281f1380 con 0x7f552806c250 2024-04-01T22:34:04.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.975+0000 7f552f74f640 1 -- 172.21.15.47:0/2827297326 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55280b2020 con 0x7f552806c250 2024-04-01T22:34:04.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:04.976+0000 7f552f74f640 1 -- 172.21.15.47:0/2827297326 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5528068210 con 0x7f552806c250 2024-04-01T22:34:05.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.290+0000 7f551dffb640 1 -- 172.21.15.47:0/2827297326 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f552404b070 con 0x7f552806c250 2024-04-01T22:34:05.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.290+0000 7f551dffb640 1 --2- 172.21.15.47:0/2827297326 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f550c06b9c0 0x7f550c06de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:05.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.291+0000 7f552ccea640 1 --2- 172.21.15.47:0/2827297326 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f550c06b9c0 0x7f550c06de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:05.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.291+0000 7f552ccea640 1 --2- 172.21.15.47:0/2827297326 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f550c06b9c0 0x7f550c06de80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5528159e20 tx=0x7f5518009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:05.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.294+0000 7f551dffb640 1 -- 172.21.15.47:0/2827297326 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f5524079630 con 0x7f552806c250 2024-04-01T22:34:05.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.305+0000 7f551dffb640 1 -- 172.21.15.47:0/2827297326 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f5524052080 con 0x7f552806c250 2024-04-01T22:34:05.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.492+0000 7f552f74f640 1 -- 172.21.15.47:0/2827297326 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f55280b5b50 con 0x7f552806c250 2024-04-01T22:34:05.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.534+0000 7f551dffb640 1 -- 172.21.15.47:0/2827297326 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18914 (secure 0 0 0) 0x7f552407b590 con 0x7f552806c250 2024-04-01T22:34:05.534 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:34:05.534 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":27,"fsid":"a6998a48-38bc-4e42-b0d9-04f2fb5c3c87","created":"2024-04-01T22:32:57.112033+0000","modified":"2024-04-01T22:34:04.850029+0000","last_up_change":"2024-04-01T22:33:11.141073+0000","last_in_change":"2024-04-01T22:33:02.650459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T22:33:13.356568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T22:33:25.309421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T22:33:26.268050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-01T22:33:30.588103+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7bd3f25d-e3a5-4932-b381-53dcbb464dde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6811","nonce":3827395709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6813","nonce":3827395709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6817","nonce":3827395709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6815","nonce":3827395709}]},"public_addr":"172.21.15.47:6811/3827395709","cluster_addr":"172.21.15.47:6813/3827395709","heartbeat_back_addr":"172.21.15.47:6817/3827395709","heartbeat_front_addr":"172.21.15.47:6815/3827395709","state":["exists","up"]},{"osd":1,"uuid":"2aa60ba2-67ff-43c7-96c4-82ae2f3855ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6827","nonce":3152157503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6829","nonce":3152157503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6833","nonce":3152157503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6831","nonce":3152157503}]},"public_addr":"172.21.15.47:6827/3152157503","cluster_addr":"172.21.15.47:6829/3152157503","heartbeat_back_addr":"172.21.15.47:6833/3152157503","heartbeat_front_addr":"172.21.15.47:6831/3152157503","state":["exists","up"]},{"osd":2,"uuid":"d83f8a98-6db8-42b7-9ef6-5b16eb9a3492","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6803","nonce":1003968856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6805","nonce":1003968856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6809","nonce":1003968856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6807","nonce":1003968856}]},"public_addr":"172.21.15.47:6803/1003968856","cluster_addr":"172.21.15.47:6805/1003968856","heartbeat_back_addr":"172.21.15.47:6809/1003968856","heartbeat_front_addr":"172.21.15.47:6807/1003968856","state":["exists","up"]},{"osd":3,"uuid":"edc02ed5-d25c-4dc9-a0c3-7a26f20fae07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6819","nonce":2845699561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6821","nonce":2845699561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6825","nonce":2845699561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6823","nonce":2845699561}]},"public_addr":"172.21.15.47:6819/2845699561","cluster_addr":"172.21.15.47:6821/2845699561","heartbeat_back_addr":"172.21.15.47:6825/2845699561","heartbeat_front_addr":"172.21.15.47:6823/2845699561","state":["exists","up"]},{"osd":4,"uuid":"b3d67e74-f51e-4474-9c62-dd0daa60c728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6809","nonce":2961538461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6811","nonce":2961538461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6815","nonce":2961538461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6813","nonce":2961538461}]},"public_addr":"172.21.15.181:6809/2961538461","cluster_addr":"172.21.15.181:6811/2961538461","heartbeat_back_addr":"172.21.15.181:6815/2961538461","heartbeat_front_addr":"172.21.15.181:6813/2961538461","state":["exists","up"]},{"osd":5,"uuid":"d86e8f7a-99f4-4457-9949-cf2cb853e79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6817","nonce":2161566540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6819","nonce":2161566540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6823","nonce":2161566540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6821","nonce":2161566540}]},"public_addr":"172.21.15.181:6817/2161566540","cluster_addr":"172.21.15.181:6819/2161566540","heartbeat_back_addr":"172.21.15.181:6823/2161566540","heartbeat_front_addr":"172.21.15.181:6821/2161566540","state":["exists","up"]},{"osd":6,"uuid":"aa08266c-1719-4abd-afb9-e7e8ac593658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6801","nonce":3792144865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6803","nonce":3792144865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6807","nonce":3792144865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6805","nonce":3792144865}]},"public_addr":"172.21.15.181:6801/3792144865","cluster_addr":"172.21.15.181:6803/3792144865","heartbeat_back_addr":"172.21.15.181:6807/3792144865","heartbeat_front_addr":"172.21.15.181:6805/3792144865","state":["exists","up"]},{"osd":7,"uuid":"6e509762-24c8-46c3-93a1-4c50b11ebcf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6825","nonce":1760995885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6827","nonce":1760995885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6831","nonce":1760995885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6829","nonce":1760995885}]},"public_addr":"172.21.15.181:6825/1760995885","cluster_addr":"172.21.15.181:6827/1760995885","heartbeat_back_addr":"172.21.15.181:6831/1760995885","heartbeat_front_addr":"172.21.15.181:6829/1760995885","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.202426+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.255318+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.170288+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.290065+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.214871+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.176432+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.139940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.299546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.15","mappings":[{"from":7,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T22:34:05.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.536+0000 7f552f74f640 1 -- 172.21.15.47:0/2827297326 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f550c06b9c0 msgr2=0x7f550c06de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:05.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.536+0000 7f552f74f640 1 --2- 172.21.15.47:0/2827297326 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f550c06b9c0 0x7f550c06de80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5528159e20 tx=0x7f5518009040 comp rx=0 tx=0).stop 2024-04-01T22:34:05.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.536+0000 7f552f74f640 1 -- 172.21.15.47:0/2827297326 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f552806c250 msgr2=0x7f55281524f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:05.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.536+0000 7f552f74f640 1 --2- 172.21.15.47:0/2827297326 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f552806c250 0x7f55281524f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5524000c00 tx=0x7f5524004730 comp rx=0 tx=0).stop 2024-04-01T22:34:05.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.536+0000 7f552f74f640 1 -- 172.21.15.47:0/2827297326 shutdown_connections 2024-04-01T22:34:05.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.536+0000 7f552f74f640 1 --2- 172.21.15.47:0/2827297326 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f550c06b9c0 0x7f550c06de80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:05.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.536+0000 7f552f74f640 1 --2- 172.21.15.47:0/2827297326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f552815bb20 0x7f55280b1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:05.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.536+0000 7f552f74f640 1 --2- 172.21.15.47:0/2827297326 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f552806c630 0x7f55280b0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:05.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.536+0000 7f552f74f640 1 --2- 172.21.15.47:0/2827297326 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f552806c250 0x7f55281524f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:05.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.536+0000 7f552f74f640 1 -- 172.21.15.47:0/2827297326 >> 172.21.15.47:0/2827297326 conn(0x7f55280cfdb0 msgr2=0x7f5528158c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:05.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.536+0000 7f552f74f640 1 -- 172.21.15.47:0/2827297326 shutdown_connections 2024-04-01T22:34:05.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.536+0000 7f552f74f640 1 -- 172.21.15.47:0/2827297326 wait complete. 2024-04-01T22:34:05.547 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-01T22:34:05.548 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T22:34:05.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.649+0000 7f727bdae640 1 Processor -- start 2024-04-01T22:34:05.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.649+0000 7f727bdae640 1 -- start start 2024-04-01T22:34:05.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.650+0000 7f727bdae640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f727415c230 0x7f727406c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:05.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.650+0000 7f727bdae640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7274154b70 con 0x7f727406c250 2024-04-01T22:34:05.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.650+0000 7f727bdae640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72740cdac0 con 0x7f727415aec0 2024-04-01T22:34:05.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.650+0000 7f727bdae640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f72740ce990 con 0x7f727415c230 2024-04-01T22:34:05.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.651+0000 7f7279b4a640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f727406c250 0x7f72740ceb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:56318/0 (socket says 172.21.15.47:56318) 2024-04-01T22:34:05.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.651+0000 7f7279b4a640 1 -- 172.21.15.47:0/4025243709 learned_addr learned my addr 172.21.15.47:0/4025243709 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T22:34:05.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.651+0000 7f727a34b640 1 --2- 172.21.15.47:0/4025243709 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f727415c230 0x7f727406c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:05.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.653+0000 7f7278b48640 1 -- 172.21.15.47:0/4025243709 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3935187625 0 0) 0x7f72740cdac0 con 0x7f727415aec0 2024-04-01T22:34:05.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.653+0000 7f7278b48640 1 -- 172.21.15.47:0/4025243709 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7260003520 con 0x7f727415aec0 2024-04-01T22:34:05.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.654+0000 7f7278b48640 1 -- 172.21.15.47:0/4025243709 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 35757524 0 0) 0x7f7274154b70 con 0x7f727406c250 2024-04-01T22:34:05.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.654+0000 7f727a34b640 1 -- 172.21.15.47:0/4025243709 >> v1:172.21.15.181:6789/0 conn(0x7f727415aec0 legacy=0x7f727415bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:05.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.654+0000 7f727a34b640 1 -- 172.21.15.47:0/4025243709 >> v1:172.21.15.47:6789/0 conn(0x7f727406c250 legacy=0x7f72740ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:05.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.654+0000 7f727a34b640 1 -- 172.21.15.47:0/4025243709 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72740cf2a0 con 0x7f727415c230 2024-04-01T22:34:05.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.656+0000 7f727a34b640 1 --2- 172.21.15.47:0/4025243709 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f727415c230 0x7f727406c630 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f726c009dc0 tx=0x7f726c02bfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8ad8697ce0bcca0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:05.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.659+0000 7f7278b48640 1 -- 172.21.15.47:0/4025243709 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726c039070 con 0x7f727415c230 2024-04-01T22:34:05.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.659+0000 7f7278b48640 1 -- 172.21.15.47:0/4025243709 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f726c02cd50 con 0x7f727415c230 2024-04-01T22:34:05.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.659+0000 7f7278b48640 1 -- 172.21.15.47:0/4025243709 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726c034660 con 0x7f727415c230 2024-04-01T22:34:05.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.660+0000 7f727bdae640 1 -- 172.21.15.47:0/4025243709 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f727415c230 msgr2=0x7f727406c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:05.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.660+0000 7f727bdae640 1 --2- 172.21.15.47:0/4025243709 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f727415c230 0x7f727406c630 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f726c009dc0 tx=0x7f726c02bfa0 comp rx=0 tx=0).stop 2024-04-01T22:34:05.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.660+0000 7f727bdae640 1 -- 172.21.15.47:0/4025243709 shutdown_connections 2024-04-01T22:34:05.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.660+0000 7f727bdae640 1 --2- 172.21.15.47:0/4025243709 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f727415c230 0x7f727406c630 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:05.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.660+0000 7f727bdae640 1 -- 172.21.15.47:0/4025243709 >> 172.21.15.47:0/4025243709 conn(0x7f72740cfdb0 msgr2=0x7f72740d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:05.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.660+0000 7f727bdae640 1 -- 172.21.15.47:0/4025243709 shutdown_connections 2024-04-01T22:34:05.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.660+0000 7f727bdae640 1 -- 172.21.15.47:0/4025243709 wait complete. 2024-04-01T22:34:05.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.661+0000 7f727bdae640 1 Processor -- start 2024-04-01T22:34:05.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.661+0000 7f727bdae640 1 -- start start 2024-04-01T22:34:05.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.662+0000 7f727bdae640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f727406c250 0x7f72740b4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:05.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.662+0000 7f727bdae640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f727415aec0 0x7f72740b5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:05.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.662+0000 7f727bdae640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f727415c230 0x7f7274152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:05.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.662+0000 7f727bdae640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f72740ce340 con 0x7f727406c250 2024-04-01T22:34:05.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.662+0000 7f727bdae640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f72740ce060 con 0x7f727415c230 2024-04-01T22:34:05.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.662+0000 7f727bdae640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f72740ce620 con 0x7f727415aec0 2024-04-01T22:34:05.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.662+0000 7f7279b4a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f727406c250 0x7f72740b4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:05.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.663+0000 7f727a34b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f727415c230 0x7f7274152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:05.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.663+0000 7f7279349640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f727415aec0 0x7f72740b5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:05.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.663+0000 7f7279b4a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f727406c250 0x7f72740b4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47710/0 (socket says 172.21.15.47:47710) 2024-04-01T22:34:05.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.663+0000 7f7279b4a640 1 -- 172.21.15.47:0/1353031274 learned_addr learned my addr 172.21.15.47:0/1353031274 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:05.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.666+0000 7f7279b4a640 1 -- 172.21.15.47:0/1353031274 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f727415aec0 msgr2=0x7f72740b5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:05.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.666+0000 7f7279b4a640 1 --2- 172.21.15.47:0/1353031274 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f727415aec0 0x7f72740b5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:05.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.666+0000 7f7279b4a640 1 -- 172.21.15.47:0/1353031274 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f727415c230 msgr2=0x7f7274152210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:05.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.666+0000 7f7279b4a640 1 --2- 172.21.15.47:0/1353031274 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f727415c230 0x7f7274152210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:05.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.666+0000 7f7279b4a640 1 -- 172.21.15.47:0/1353031274 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72741f4060 con 0x7f727406c250 2024-04-01T22:34:05.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.668+0000 7f7279b4a640 1 --2- 172.21.15.47:0/1353031274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f727406c250 0x7f72740b4ab0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f727000c4d0 tx=0x7f727000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:05.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.672+0000 7f726a7fc640 1 -- 172.21.15.47:0/1353031274 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7270018070 con 0x7f727406c250 2024-04-01T22:34:05.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.673+0000 7f726a7fc640 1 -- 172.21.15.47:0/1353031274 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72700074e0 con 0x7f727406c250 2024-04-01T22:34:05.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.673+0000 7f726a7fc640 1 -- 172.21.15.47:0/1353031274 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7270004a20 con 0x7f727406c250 2024-04-01T22:34:05.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.673+0000 7f727bdae640 1 -- 172.21.15.47:0/1353031274 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72741f4320 con 0x7f727406c250 2024-04-01T22:34:05.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.673+0000 7f727bdae640 1 -- 172.21.15.47:0/1353031274 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72740b44a0 con 0x7f727406c250 2024-04-01T22:34:05.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.674+0000 7f727bdae640 1 -- 172.21.15.47:0/1353031274 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7274068210 con 0x7f727406c250 2024-04-01T22:34:05.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.940+0000 7f726a7fc640 1 -- 172.21.15.47:0/1353031274 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f727001b070 con 0x7f727406c250 2024-04-01T22:34:05.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.940+0000 7f726a7fc640 1 --2- 172.21.15.47:0/1353031274 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f725806ba10 0x7f725806ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:05.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.941+0000 7f7279349640 1 --2- 172.21.15.47:0/1353031274 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f725806ba10 0x7f725806ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:05.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.941+0000 7f7279349640 1 --2- 172.21.15.47:0/1353031274 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f725806ba10 0x7f725806ded0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7274159bf0 tx=0x7f7264009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:05.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.956+0000 7f726a7fc640 1 -- 172.21.15.47:0/1353031274 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f7270056640 con 0x7f727406c250 2024-04-01T22:34:05.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:05.957+0000 7f726a7fc640 1 -- 172.21.15.47:0/1353031274 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f7270022020 con 0x7f727406c250 2024-04-01T22:34:06.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.144+0000 7f727bdae640 1 -- 172.21.15.47:0/1353031274 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f72740af310 con 0x7f727406c250 2024-04-01T22:34:06.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.193+0000 7f726a7fc640 1 -- 172.21.15.47:0/1353031274 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18914 (secure 0 0 0) 0x7f72700585a0 con 0x7f727406c250 2024-04-01T22:34:06.193 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:34:06.193 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":27,"fsid":"a6998a48-38bc-4e42-b0d9-04f2fb5c3c87","created":"2024-04-01T22:32:57.112033+0000","modified":"2024-04-01T22:34:04.850029+0000","last_up_change":"2024-04-01T22:33:11.141073+0000","last_in_change":"2024-04-01T22:33:02.650459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T22:33:13.356568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T22:33:25.309421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T22:33:26.268050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-01T22:33:30.588103+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7bd3f25d-e3a5-4932-b381-53dcbb464dde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6811","nonce":3827395709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6813","nonce":3827395709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6817","nonce":3827395709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6815","nonce":3827395709}]},"public_addr":"172.21.15.47:6811/3827395709","cluster_addr":"172.21.15.47:6813/3827395709","heartbeat_back_addr":"172.21.15.47:6817/3827395709","heartbeat_front_addr":"172.21.15.47:6815/3827395709","state":["exists","up"]},{"osd":1,"uuid":"2aa60ba2-67ff-43c7-96c4-82ae2f3855ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6827","nonce":3152157503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6829","nonce":3152157503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6833","nonce":3152157503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6831","nonce":3152157503}]},"public_addr":"172.21.15.47:6827/3152157503","cluster_addr":"172.21.15.47:6829/3152157503","heartbeat_back_addr":"172.21.15.47:6833/3152157503","heartbeat_front_addr":"172.21.15.47:6831/3152157503","state":["exists","up"]},{"osd":2,"uuid":"d83f8a98-6db8-42b7-9ef6-5b16eb9a3492","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6803","nonce":1003968856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6805","nonce":1003968856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6809","nonce":1003968856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6807","nonce":1003968856}]},"public_addr":"172.21.15.47:6803/1003968856","cluster_addr":"172.21.15.47:6805/1003968856","heartbeat_back_addr":"172.21.15.47:6809/1003968856","heartbeat_front_addr":"172.21.15.47:6807/1003968856","state":["exists","up"]},{"osd":3,"uuid":"edc02ed5-d25c-4dc9-a0c3-7a26f20fae07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6819","nonce":2845699561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6821","nonce":2845699561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6825","nonce":2845699561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6823","nonce":2845699561}]},"public_addr":"172.21.15.47:6819/2845699561","cluster_addr":"172.21.15.47:6821/2845699561","heartbeat_back_addr":"172.21.15.47:6825/2845699561","heartbeat_front_addr":"172.21.15.47:6823/2845699561","state":["exists","up"]},{"osd":4,"uuid":"b3d67e74-f51e-4474-9c62-dd0daa60c728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6809","nonce":2961538461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6811","nonce":2961538461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6815","nonce":2961538461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6813","nonce":2961538461}]},"public_addr":"172.21.15.181:6809/2961538461","cluster_addr":"172.21.15.181:6811/2961538461","heartbeat_back_addr":"172.21.15.181:6815/2961538461","heartbeat_front_addr":"172.21.15.181:6813/2961538461","state":["exists","up"]},{"osd":5,"uuid":"d86e8f7a-99f4-4457-9949-cf2cb853e79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6817","nonce":2161566540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6819","nonce":2161566540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6823","nonce":2161566540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6821","nonce":2161566540}]},"public_addr":"172.21.15.181:6817/2161566540","cluster_addr":"172.21.15.181:6819/2161566540","heartbeat_back_addr":"172.21.15.181:6823/2161566540","heartbeat_front_addr":"172.21.15.181:6821/2161566540","state":["exists","up"]},{"osd":6,"uuid":"aa08266c-1719-4abd-afb9-e7e8ac593658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6801","nonce":3792144865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6803","nonce":3792144865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6807","nonce":3792144865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6805","nonce":3792144865}]},"public_addr":"172.21.15.181:6801/3792144865","cluster_addr":"172.21.15.181:6803/3792144865","heartbeat_back_addr":"172.21.15.181:6807/3792144865","heartbeat_front_addr":"172.21.15.181:6805/3792144865","state":["exists","up"]},{"osd":7,"uuid":"6e509762-24c8-46c3-93a1-4c50b11ebcf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6825","nonce":1760995885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6827","nonce":1760995885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6831","nonce":1760995885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6829","nonce":1760995885}]},"public_addr":"172.21.15.181:6825/1760995885","cluster_addr":"172.21.15.181:6827/1760995885","heartbeat_back_addr":"172.21.15.181:6831/1760995885","heartbeat_front_addr":"172.21.15.181:6829/1760995885","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.202426+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.255318+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.170288+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.290065+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.214871+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.176432+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.139940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.299546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.15","mappings":[{"from":7,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T22:34:06.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.195+0000 7f727bdae640 1 -- 172.21.15.47:0/1353031274 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f725806ba10 msgr2=0x7f725806ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.195+0000 7f727bdae640 1 --2- 172.21.15.47:0/1353031274 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f725806ba10 0x7f725806ded0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7274159bf0 tx=0x7f7264009040 comp rx=0 tx=0).stop 2024-04-01T22:34:06.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.195+0000 7f727bdae640 1 -- 172.21.15.47:0/1353031274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f727406c250 msgr2=0x7f72740b4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.195+0000 7f727bdae640 1 --2- 172.21.15.47:0/1353031274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f727406c250 0x7f72740b4ab0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f727000c4d0 tx=0x7f727000c990 comp rx=0 tx=0).stop 2024-04-01T22:34:06.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.195+0000 7f727bdae640 1 -- 172.21.15.47:0/1353031274 shutdown_connections 2024-04-01T22:34:06.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.195+0000 7f727bdae640 1 --2- 172.21.15.47:0/1353031274 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f725806ba10 0x7f725806ded0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.195+0000 7f727bdae640 1 --2- 172.21.15.47:0/1353031274 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f727415c230 0x7f7274152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.195+0000 7f727bdae640 1 --2- 172.21.15.47:0/1353031274 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f727415aec0 0x7f72740b5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.195+0000 7f727bdae640 1 --2- 172.21.15.47:0/1353031274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f727406c250 0x7f72740b4ab0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.195+0000 7f727bdae640 1 -- 172.21.15.47:0/1353031274 >> 172.21.15.47:0/1353031274 conn(0x7f72740cfdb0 msgr2=0x7f7274154130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:06.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.195+0000 7f727bdae640 1 -- 172.21.15.47:0/1353031274 shutdown_connections 2024-04-01T22:34:06.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.195+0000 7f727bdae640 1 -- 172.21.15.47:0/1353031274 wait complete. 2024-04-01T22:34:06.206 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-01T22:34:06.207 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-01T22:34:06.207 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-01T22:34:06.208 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-01T22:34:06.208 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-01T22:34:06.208 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-01T22:34:06.209 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-01T22:34:06.209 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-01T22:34:06.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.383+0000 7fcc5165e640 1 Processor -- start 2024-04-01T22:34:06.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.384+0000 7fcc5165e640 1 -- start start 2024-04-01T22:34:06.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.386+0000 7fcc5165e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fcc44037180 0x7fcc440e2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.386+0000 7fcc4bfff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fcc440d92c0 0x7fcc44038650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:56328/0 (socket says 172.21.15.47:56328) 2024-04-01T22:34:06.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.386+0000 7fcc4bfff640 1 -- 172.21.15.47:0/3122277903 learned_addr learned my addr 172.21.15.47:0/3122277903 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T22:34:06.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.386+0000 7fcc5165e640 1 -- 172.21.15.47:0/3122277903 --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc440376e0 con 0x7fcc440d92c0 2024-04-01T22:34:06.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.386+0000 7fcc5165e640 1 -- 172.21.15.47:0/3122277903 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc440502d0 con 0x7fcc44038d60 2024-04-01T22:34:06.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.386+0000 7fcc5165e640 1 -- 172.21.15.47:0/3122277903 --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fcc440505b0 con 0x7fcc44037180 2024-04-01T22:34:06.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.388+0000 7f7178b43640 1 Processor -- start 2024-04-01T22:34:06.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.389+0000 7fcc50e5d640 1 --2- 172.21.15.47:0/3122277903 >> v2:172.21.15.47:3300/0 conn(0x7fcc44037180 0x7fcc440e2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.388+0000 7f7178b43640 1 -- start start 2024-04-01T22:34:06.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.389+0000 7f7178b43640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f71740cb920 0x7f7174156230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.389+0000 7f7178b43640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f71740cbd00 0x7f7174159820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.389+0000 7f7178b43640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f717415a040 con 0x7f717414fd90 2024-04-01T22:34:06.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.389+0000 7f7178b43640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f71740c6af0 con 0x7f71740cb920 2024-04-01T22:34:06.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.389+0000 7f7178b43640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f717415a2e0 con 0x7f71740cbd00 2024-04-01T22:34:06.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.390+0000 7f7171d9b640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f71740cbd00 0x7f7174159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.390+0000 7f7171d9b640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f71740cbd00 0x7f7174159820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:39392/0 (socket says 172.21.15.47:39392) 2024-04-01T22:34:06.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.390+0000 7f7171d9b640 1 -- 172.21.15.47:0/1287103196 learned_addr learned my addr 172.21.15.47:0/1287103196 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:06.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.389+0000 7f399313e640 1 Processor -- start 2024-04-01T22:34:06.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.389+0000 7f399313e640 1 -- start start 2024-04-01T22:34:06.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.391+0000 7f399313e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f39840fc9b0 0x7f398404b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.391+0000 7f399313e640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f398404b600 0x7f3984045250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.391+0000 7f399313e640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39840066e0 con 0x7f39840f6d80 2024-04-01T22:34:06.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.391+0000 7f399313e640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f39840f7160 con 0x7f39840fc9b0 2024-04-01T22:34:06.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.391+0000 7f399313e640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f39840075d0 con 0x7f398404b600 2024-04-01T22:34:06.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.391+0000 7fcc4affd640 1 -- 172.21.15.47:0/3122277903 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3945822894 0 0) 0x7fcc440502d0 con 0x7fcc44038d60 2024-04-01T22:34:06.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.391+0000 7fcc4affd640 1 -- 172.21.15.47:0/3122277903 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc3c003520 con 0x7fcc44038d60 2024-04-01T22:34:06.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.392+0000 7fa6af59e640 1 Processor -- start 2024-04-01T22:34:06.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.392+0000 7fa6af59e640 1 -- start start 2024-04-01T22:34:06.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.393+0000 7f7171d9b640 1 -- 172.21.15.47:0/1287103196 >> v2:172.21.15.47:3300/0 conn(0x7f71740cb920 msgr2=0x7f7174156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:06.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.393+0000 7f7171d9b640 1 --2- 172.21.15.47:0/1287103196 >> v2:172.21.15.47:3300/0 conn(0x7f71740cb920 0x7f7174156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.393+0000 7f7171d9b640 1 -- 172.21.15.47:0/1287103196 >> v1:172.21.15.181:6789/0 conn(0x7f717414fd90 legacy=0x7f71740c7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:06.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.393+0000 7f7171d9b640 1 -- 172.21.15.47:0/1287103196 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f717415a5c0 con 0x7f71740cbd00 2024-04-01T22:34:06.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.393+0000 7fa6af59e640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa6b00cc410 0x7fa6b015e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.394+0000 7fa6af59e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa6b006f0e0 0x7fa6b015eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.394+0000 7fa6af59e640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6b0158cf0 con 0x7fa6b0158910 2024-04-01T22:34:06.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.394+0000 7fa6af59e640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fa6b006f5b0 con 0x7fa6b006f0e0 2024-04-01T22:34:06.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.394+0000 7fa6af59e640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fa6b006f890 con 0x7fa6b00cc410 2024-04-01T22:34:06.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.394+0000 7fa6a7fff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa6b00cc410 0x7fa6b015e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.395+0000 7fa6a7fff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa6b00cc410 0x7fa6b015e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:39402/0 (socket says 172.21.15.47:39402) 2024-04-01T22:34:06.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.395+0000 7fa6a7fff640 1 -- 172.21.15.47:0/1001992055 learned_addr learned my addr 172.21.15.47:0/1001992055 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:06.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.395+0000 7fcc50e5d640 1 -- 172.21.15.47:0/3122277903 >> v1:172.21.15.181:6789/0 conn(0x7fcc44038d60 legacy=0x7fcc440e2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.395+0000 7fcc50e5d640 1 -- 172.21.15.47:0/3122277903 >> v1:172.21.15.47:6789/0 conn(0x7fcc440d92c0 legacy=0x7fcc44038650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.395+0000 7fcc50e5d640 1 -- 172.21.15.47:0/3122277903 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc44050890 con 0x7fcc44037180 2024-04-01T22:34:06.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.396+0000 7f7171d9b640 1 --2- 172.21.15.47:0/1287103196 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f71740cbd00 0x7f7174159820 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f71740cc260 tx=0x7f716802cb70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60daf9750cf4a66a server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:06.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.398+0000 7f9a722b5640 1 Processor -- start 2024-04-01T22:34:06.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.398+0000 7f9a722b5640 1 -- start start 2024-04-01T22:34:06.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.398+0000 7f39916db640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f398404b600 0x7f3984045250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.398+0000 7fa6a7fff640 1 -- 172.21.15.47:0/1001992055 >> v2:172.21.15.47:3300/0 conn(0x7fa6b006f0e0 msgr2=0x7fa6b015eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:06.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.398+0000 7fa6a7fff640 1 --2- 172.21.15.47:0/1001992055 >> v2:172.21.15.47:3300/0 conn(0x7fa6b006f0e0 0x7fa6b015eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.398+0000 7fa6a7fff640 1 -- 172.21.15.47:0/1001992055 >> v1:172.21.15.181:6789/0 conn(0x7fa6b0158910 legacy=0x7fa6b00c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:06.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.398+0000 7fa6a7fff640 1 -- 172.21.15.47:0/1001992055 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6b006fb70 con 0x7fa6b00cc410 2024-04-01T22:34:06.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.399+0000 7f3990eda640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f39840f6d80 0x7f3984005ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.47:49508/0 (socket says 172.21.15.47:49508) 2024-04-01T22:34:06.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.399+0000 7f3990eda640 1 -- 172.21.15.47:0/304745293 learned_addr learned my addr 172.21.15.47:0/304745293 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T22:34:06.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.399+0000 7f9a722b5640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9a6c152210 0x7f9a6c0c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.399+0000 7f9a722b5640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f9a6c0cac90 0x7f9a6c15bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.399+0000 7f9a722b5640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a6c1585a0 con 0x7f9a6c0c8ce0 2024-04-01T22:34:06.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.399+0000 7fcc50e5d640 1 --2- 172.21.15.47:0/3122277903 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc44037180 0x7fcc440e2a20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcc380097a0 tx=0x7fcc3802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2f010cb91ffc20f server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:06.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.399+0000 7f9a722b5640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f9a6c158880 con 0x7f9a6c152210 2024-04-01T22:34:06.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.399+0000 7f9a722b5640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f9a6c158b60 con 0x7f9a6c0cac90 2024-04-01T22:34:06.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.400+0000 7f2ecea30640 1 Processor -- start 2024-04-01T22:34:06.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.400+0000 7f5bf8602640 1 Processor -- start 2024-04-01T22:34:06.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.400+0000 7f5bf8602640 1 -- start start 2024-04-01T22:34:06.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.400+0000 7f2ecea30640 1 -- start start 2024-04-01T22:34:06.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.401+0000 7f2ecea30640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ec8158a00 0x7f2ec815eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.401+0000 7f2ecea30640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2ec80c6be0 0x7f2ec80cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.401+0000 7f5bf8602640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5bf0154400 0x7f5bf015a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.401+0000 7f2ecea30640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ec80c79b0 con 0x7f2ec80cbb80 2024-04-01T22:34:06.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.401+0000 7f2ecea30640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f2ec815f430 con 0x7f2ec80c6be0 2024-04-01T22:34:06.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.401+0000 7f2ecea30640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f2ec80c7760 con 0x7f2ec8158a00 2024-04-01T22:34:06.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.401+0000 7f5bf8602640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5bf0072df0 0x7f5bf0073240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.401+0000 7f5bf8602640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bf015ab90 con 0x7f5bf00ad8c0 2024-04-01T22:34:06.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.401+0000 7f5bf8602640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f5bf0073780 con 0x7f5bf0072df0 2024-04-01T22:34:06.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.401+0000 7f5bf8602640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f5bf015ae70 con 0x7f5bf0154400 2024-04-01T22:34:06.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.401+0000 7f9a70852640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f9a6c0cac90 0x7f9a6c15bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.403+0000 7f39916db640 1 -- 172.21.15.47:0/304745293 >> v2:172.21.15.47:3300/0 conn(0x7f39840fc9b0 msgr2=0x7f398404b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:06.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.403+0000 7f39916db640 1 --2- 172.21.15.47:0/304745293 >> v2:172.21.15.47:3300/0 conn(0x7f39840fc9b0 0x7f398404b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.403+0000 7f39916db640 1 -- 172.21.15.47:0/304745293 >> v1:172.21.15.181:6789/0 conn(0x7f39840f6d80 legacy=0x7f3984005ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.403+0000 7f39916db640 1 -- 172.21.15.47:0/304745293 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39840069c0 con 0x7f398404b600 2024-04-01T22:34:06.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.403+0000 7f717159a640 1 -- 172.21.15.47:0/1287103196 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716803a070 con 0x7f71740cbd00 2024-04-01T22:34:06.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.403+0000 7f717159a640 1 -- 172.21.15.47:0/1287103196 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f716802d920 con 0x7f71740cbd00 2024-04-01T22:34:06.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.403+0000 7fa6a7fff640 1 --2- 172.21.15.47:0/1001992055 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa6b00cc410 0x7fa6b015e5c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa6a0009870 tx=0x7fa6a002b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=481bae82024e4824 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:06.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.404+0000 7f717159a640 1 -- 172.21.15.47:0/1287103196 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716802dcf0 con 0x7f71740cbd00 2024-04-01T22:34:06.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.404+0000 7f7178b43640 1 -- 172.21.15.47:0/1287103196 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f71740cbd00 msgr2=0x7f7174159820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.404+0000 7f7178b43640 1 --2- 172.21.15.47:0/1287103196 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f71740cbd00 0x7f7174159820 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f71740cc260 tx=0x7f716802cb70 comp rx=0 tx=0).stop 2024-04-01T22:34:06.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.404+0000 7f9a70852640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f9a6c0cac90 0x7f9a6c15bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:44744/0 (socket says 172.21.15.47:44744) 2024-04-01T22:34:06.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.404+0000 7f9a70852640 1 -- 172.21.15.47:0/1854540587 learned_addr learned my addr 172.21.15.47:0/1854540587 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:06.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.404+0000 7f7178b43640 1 -- 172.21.15.47:0/1287103196 shutdown_connections 2024-04-01T22:34:06.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.404+0000 7f7178b43640 1 --2- 172.21.15.47:0/1287103196 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f71740cbd00 0x7f7174159820 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f71740cc260 tx=0x7f716802cb70 comp rx=0 tx=0).stop 2024-04-01T22:34:06.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.404+0000 7f7178b43640 1 --2- 172.21.15.47:0/1287103196 >> v2:172.21.15.47:3300/0 conn(0x7f71740cb920 0x7f7174156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.404+0000 7f7178b43640 1 -- 172.21.15.47:0/1287103196 >> 172.21.15.47:0/1287103196 conn(0x7f7174062220 msgr2=0x7f717406ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:06.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.404+0000 7f7178b43640 1 -- 172.21.15.47:0/1287103196 shutdown_connections 2024-04-01T22:34:06.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.404+0000 7f7178b43640 1 -- 172.21.15.47:0/1287103196 wait complete. 2024-04-01T22:34:06.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.406+0000 7f7178b43640 1 Processor -- start 2024-04-01T22:34:06.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.406+0000 7f7178b43640 1 -- start start 2024-04-01T22:34:06.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.407+0000 7f39916db640 1 --2- 172.21.15.47:0/304745293 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f398404b600 0x7f3984045250 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3984051200 tx=0x7f398002ce60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d135791a5670f83f server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:06.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.408+0000 7f7178b43640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71740cb920 0x7f71741f4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.408+0000 7f7178b43640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f717414fd90 0x7f71740c7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.408+0000 7f7178b43640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7174072530 0x7f71741f7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.408+0000 7f7178b43640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f71740c3d80 con 0x7f71740cb920 2024-04-01T22:34:06.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.408+0000 7f7178b43640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7174159d60 con 0x7f717414fd90 2024-04-01T22:34:06.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.408+0000 7f7178b43640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f71740c8cb0 con 0x7f7174072530 2024-04-01T22:34:06.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.408+0000 7fa6add9b640 1 -- 172.21.15.47:0/1001992055 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a00317c0 con 0x7fa6b00cc410 2024-04-01T22:34:06.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.408+0000 7f2ec77fe640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2ec80c6be0 0x7f2ec80cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.408+0000 7fa6add9b640 1 -- 172.21.15.47:0/1001992055 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6a0037070 con 0x7fa6b00cc410 2024-04-01T22:34:06.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.408+0000 7fa6add9b640 1 -- 172.21.15.47:0/1001992055 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a0031b80 con 0x7fa6b00cc410 2024-04-01T22:34:06.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.408+0000 7f2ec7fff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ec8158a00 0x7f2ec815eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.408+0000 7f2ec7fff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ec8158a00 0x7f2ec815eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:39414/0 (socket says 172.21.15.47:39414) 2024-04-01T22:34:06.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.408+0000 7f2ec7fff640 1 -- 172.21.15.47:0/1985342315 learned_addr learned my addr 172.21.15.47:0/1985342315 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:06.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.409+0000 7f6f1759e640 1 Processor -- start 2024-04-01T22:34:06.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.409+0000 7f6f1759e640 1 -- start start 2024-04-01T22:34:06.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.409+0000 7fa6af59e640 1 -- 172.21.15.47:0/1001992055 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa6b00cc410 msgr2=0x7fa6b015e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.409+0000 7fa6af59e640 1 --2- 172.21.15.47:0/1001992055 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa6b00cc410 0x7fa6b015e5c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa6a0009870 tx=0x7fa6a002b860 comp rx=0 tx=0).stop 2024-04-01T22:34:06.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.409+0000 7f9a70852640 1 -- 172.21.15.47:0/1854540587 >> v2:172.21.15.47:3300/0 conn(0x7f9a6c152210 msgr2=0x7f9a6c0c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:06.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.409+0000 7f9a70852640 1 --2- 172.21.15.47:0/1854540587 >> v2:172.21.15.47:3300/0 conn(0x7f9a6c152210 0x7f9a6c0c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.409+0000 7f9a70852640 1 -- 172.21.15.47:0/1854540587 >> v1:172.21.15.47:6789/0 conn(0x7f9a6c0c8ce0 legacy=0x7f9a6c0ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:06.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.409+0000 7f9a70852640 1 -- 172.21.15.47:0/1854540587 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a6c158e40 con 0x7f9a6c0cac90 2024-04-01T22:34:06.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.409+0000 7fa6af59e640 1 -- 172.21.15.47:0/1001992055 shutdown_connections 2024-04-01T22:34:06.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.409+0000 7fa6af59e640 1 --2- 172.21.15.47:0/1001992055 >> v2:172.21.15.47:3300/0 conn(0x7fa6b006f0e0 0x7fa6b015eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.409+0000 7fa6af59e640 1 --2- 172.21.15.47:0/1001992055 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa6b00cc410 0x7fa6b015e5c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.409+0000 7fa6af59e640 1 -- 172.21.15.47:0/1001992055 >> 172.21.15.47:0/1001992055 conn(0x7fa6b00cb8f0 msgr2=0x7fa6b00cbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:06.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.410+0000 7f7172d9d640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7174072530 0x7f71741f7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.410+0000 7fa6af59e640 1 -- 172.21.15.47:0/1001992055 shutdown_connections 2024-04-01T22:34:06.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.410+0000 7fa6af59e640 1 -- 172.21.15.47:0/1001992055 wait complete. 2024-04-01T22:34:06.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.410+0000 7f6f1759e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6f100d9090 0x7f6f100e2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.410+0000 7f6f1759e640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f10047c80 0x7f6f1004bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.410+0000 7f6f1759e640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f10048110 con 0x7f6f10047690 2024-04-01T22:34:06.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.410+0000 7f6f1759e640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f6f100def70 con 0x7f6f100d9090 2024-04-01T22:34:06.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.410+0000 7f6f1759e640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6f100df250 con 0x7f6f10047c80 2024-04-01T22:34:06.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.411+0000 7fa6af59e640 1 Processor -- start 2024-04-01T22:34:06.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.411+0000 7fa6af59e640 1 -- start start 2024-04-01T22:34:06.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.411+0000 7f2ec7fff640 1 -- 172.21.15.47:0/1985342315 >> v2:172.21.15.47:3300/0 conn(0x7f2ec80c6be0 msgr2=0x7f2ec80cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:06.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.411+0000 7f2ec7fff640 1 --2- 172.21.15.47:0/1985342315 >> v2:172.21.15.47:3300/0 conn(0x7f2ec80c6be0 0x7f2ec80cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.411+0000 7f2ec7fff640 1 -- 172.21.15.47:0/1985342315 >> v1:172.21.15.181:6789/0 conn(0x7f2ec80cbb80 legacy=0x7f2ec80c7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:06.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.411+0000 7f2ec7fff640 1 -- 172.21.15.47:0/1985342315 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ec8161c30 con 0x7f2ec8158a00 2024-04-01T22:34:06.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.412+0000 7fa6af59e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6b006f0e0 0x7fa6b015efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.412+0000 7fa6af59e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6b00cc410 0x7fa6b01f42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.412+0000 7fa6af59e640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa6b0158910 0x7fa6b0156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.412+0000 7fa6af59e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa6b00c62b0 con 0x7fa6b00cc410 2024-04-01T22:34:06.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.412+0000 7fa6af59e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa6b00c6e30 con 0x7fa6b006f0e0 2024-04-01T22:34:06.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.412+0000 7fa6af59e640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fa6b00c6430 con 0x7fa6b0158910 2024-04-01T22:34:06.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.412+0000 7f7172d9d640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7174072530 0x7f71741f7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:39428/0 (socket says 172.21.15.47:39428) 2024-04-01T22:34:06.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.412+0000 7f7172d9d640 1 -- 172.21.15.47:0/3866953092 learned_addr learned my addr 172.21.15.47:0/3866953092 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:06.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.413+0000 7f9a70852640 1 --2- 172.21.15.47:0/1854540587 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9a6c0cac90 0x7f9a6c15bd80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c0b0a60 tx=0x7f9a6402bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9decf4f3e806754 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:06.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.414+0000 7fcc4affd640 1 -- 172.21.15.47:0/3122277903 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc38034070 con 0x7fcc44037180 2024-04-01T22:34:06.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.414+0000 7fcc4affd640 1 -- 172.21.15.47:0/3122277903 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc38030610 con 0x7fcc44037180 2024-04-01T22:34:06.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.414+0000 7fcc4affd640 1 -- 172.21.15.47:0/3122277903 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc380309e0 con 0x7fcc44037180 2024-04-01T22:34:06.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.415+0000 7f2ec7fff640 1 --2- 172.21.15.47:0/1985342315 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ec8158a00 0x7f2ec815eef0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc009870 tx=0x7f2ebc02b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ee5e807d431ee21 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:06.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.415+0000 7fcc5165e640 1 -- 172.21.15.47:0/3122277903 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc44037180 msgr2=0x7fcc440e2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.415+0000 7fcc5165e640 1 --2- 172.21.15.47:0/3122277903 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc44037180 0x7fcc440e2a20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcc380097a0 tx=0x7fcc3802b960 comp rx=0 tx=0).stop 2024-04-01T22:34:06.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.415+0000 7fcc5165e640 1 -- 172.21.15.47:0/3122277903 shutdown_connections 2024-04-01T22:34:06.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.415+0000 7fcc5165e640 1 --2- 172.21.15.47:0/3122277903 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc44037180 0x7fcc440e2a20 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.415+0000 7fcc5165e640 1 -- 172.21.15.47:0/3122277903 >> 172.21.15.47:0/3122277903 conn(0x7fcc44054610 msgr2=0x7fcc44054a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:06.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.415+0000 7fcc5165e640 1 -- 172.21.15.47:0/3122277903 shutdown_connections 2024-04-01T22:34:06.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.415+0000 7fcc5165e640 1 -- 172.21.15.47:0/3122277903 wait complete. 2024-04-01T22:34:06.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.415+0000 7f5bf639e640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5bf0154400 0x7f5bf015a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.416+0000 7f5bf5b9d640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5bf0072df0 0x7f5bf0073240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.417+0000 7fcc5165e640 1 Processor -- start 2024-04-01T22:34:06.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.417+0000 7fcc5165e640 1 -- start start 2024-04-01T22:34:06.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.417+0000 7f5bf639e640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5bf0154400 0x7f5bf015a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:44750/0 (socket says 172.21.15.47:44750) 2024-04-01T22:34:06.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.417+0000 7f5bf639e640 1 -- 172.21.15.47:0/3540012881 learned_addr learned my addr 172.21.15.47:0/3540012881 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:06.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.418+0000 7f7171d9b640 1 --2- 172.21.15.47:0/3866953092 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f717414fd90 0x7f71740c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.418+0000 7fcc5165e640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcc44037180 0x7fcc440db170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.418+0000 7fcc5165e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc44038d60 0x7fcc4416a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.418+0000 7fcc5165e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc440d92c0 0x7fcc44174e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.418+0000 7fcc5165e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcc440e2f60 con 0x7fcc440d92c0 2024-04-01T22:34:06.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.418+0000 7fcc5165e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcc44038130 con 0x7fcc44038d60 2024-04-01T22:34:06.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.418+0000 7fcc5165e640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fcc440e30e0 con 0x7fcc44037180 2024-04-01T22:34:06.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.419+0000 7f398b7fe640 1 -- 172.21.15.47:0/304745293 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398002dc10 con 0x7f398404b600 2024-04-01T22:34:06.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.419+0000 7f398b7fe640 1 -- 172.21.15.47:0/304745293 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f398002ddb0 con 0x7f398404b600 2024-04-01T22:34:06.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.419+0000 7f398b7fe640 1 -- 172.21.15.47:0/304745293 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398000a310 con 0x7f398404b600 2024-04-01T22:34:06.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.420+0000 7f7172d9d640 1 -- 172.21.15.47:0/3866953092 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f717414fd90 msgr2=0x7f71740c7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.420+0000 7f7172d9d640 1 --2- 172.21.15.47:0/3866953092 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f717414fd90 0x7f71740c7800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.420+0000 7f7172d9d640 1 -- 172.21.15.47:0/3866953092 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71740cb920 msgr2=0x7f71741f4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.420+0000 7f7172d9d640 1 --2- 172.21.15.47:0/3866953092 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71740cb920 0x7f71741f4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.420+0000 7f7172d9d640 1 -- 172.21.15.47:0/3866953092 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f717414b780 con 0x7f7174072530 2024-04-01T22:34:06.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.420+0000 7f399313e640 1 -- 172.21.15.47:0/304745293 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f398404b600 msgr2=0x7f3984045250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.420+0000 7f399313e640 1 --2- 172.21.15.47:0/304745293 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f398404b600 0x7f3984045250 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3984051200 tx=0x7f398002ce60 comp rx=0 tx=0).stop 2024-04-01T22:34:06.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.420+0000 7f399313e640 1 -- 172.21.15.47:0/304745293 shutdown_connections 2024-04-01T22:34:06.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.420+0000 7f399313e640 1 --2- 172.21.15.47:0/304745293 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f398404b600 0x7f3984045250 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.420+0000 7f399313e640 1 --2- 172.21.15.47:0/304745293 >> v2:172.21.15.47:3300/0 conn(0x7f39840fc9b0 0x7f398404b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.420+0000 7f399313e640 1 -- 172.21.15.47:0/304745293 >> 172.21.15.47:0/304745293 conn(0x7f39840501b0 msgr2=0x7f39840505c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:06.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.420+0000 7f399313e640 1 -- 172.21.15.47:0/304745293 shutdown_connections 2024-04-01T22:34:06.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.420+0000 7f399313e640 1 -- 172.21.15.47:0/304745293 wait complete. 2024-04-01T22:34:06.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.421+0000 7f399313e640 1 Processor -- start 2024-04-01T22:34:06.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.421+0000 7fa6ae59c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6b006f0e0 0x7fa6b015efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.421+0000 7f399313e640 1 -- start start 2024-04-01T22:34:06.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.422+0000 7f5bf5b9d640 1 -- 172.21.15.47:0/3540012881 >> v2:172.21.15.181:3300/0 conn(0x7f5bf0154400 msgr2=0x7f5bf015a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:06.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.422+0000 7f5bf5b9d640 1 --2- 172.21.15.47:0/3540012881 >> v2:172.21.15.181:3300/0 conn(0x7f5bf0154400 0x7f5bf015a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.422+0000 7f5bf5b9d640 1 -- 172.21.15.47:0/3540012881 >> v1:172.21.15.181:6789/0 conn(0x7f5bf00ad8c0 legacy=0x7f5bf00adcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.422+0000 7f5bf5b9d640 1 -- 172.21.15.47:0/3540012881 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bf015b150 con 0x7f5bf0072df0 2024-04-01T22:34:06.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.422+0000 7fcc4b7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc44038d60 0x7fcc4416a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.422+0000 7f399313e640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f398404b600 0x7f39840355a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.422+0000 7f399313e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39840f6d80 0x7f39840f9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.422+0000 7f399313e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f39840fc9b0 0x7f39841984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.422+0000 7f399313e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3984007260 con 0x7f39840f6d80 2024-04-01T22:34:06.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.422+0000 7f399313e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3984006f80 con 0x7f39840fc9b0 2024-04-01T22:34:06.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.422+0000 7f399313e640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f398404c750 con 0x7f398404b600 2024-04-01T22:34:06.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.423+0000 7fa6ae59c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6b006f0e0 0x7fa6b015efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:44764/0 (socket says 172.21.15.47:44764) 2024-04-01T22:34:06.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.423+0000 7fa6ae59c640 1 -- 172.21.15.47:0/3816318634 learned_addr learned my addr 172.21.15.47:0/3816318634 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:06.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.424+0000 7fcc4b7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc44038d60 0x7fcc4416a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:44770/0 (socket says 172.21.15.47:44770) 2024-04-01T22:34:06.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.424+0000 7fcc4b7fe640 1 -- 172.21.15.47:0/1767083342 learned_addr learned my addr 172.21.15.47:0/1767083342 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:06.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.424+0000 7f2ec6ffd640 1 -- 172.21.15.47:0/1985342315 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc0317c0 con 0x7f2ec8158a00 2024-04-01T22:34:06.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.424+0000 7f2ec6ffd640 1 -- 172.21.15.47:0/1985342315 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ebc037070 con 0x7f2ec8158a00 2024-04-01T22:34:06.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.424+0000 7f2ec6ffd640 1 -- 172.21.15.47:0/1985342315 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc031b80 con 0x7f2ec8158a00 2024-04-01T22:34:06.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.425+0000 7f6f16d9d640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f10047c80 0x7f6f1004bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.425+0000 7f3990eda640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f398404b600 0x7f39840355a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.425+0000 7f2ecea30640 1 -- 172.21.15.47:0/1985342315 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ec8158a00 msgr2=0x7f2ec815eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.425+0000 7f2ecea30640 1 --2- 172.21.15.47:0/1985342315 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ec8158a00 0x7f2ec815eef0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc009870 tx=0x7f2ebc02b860 comp rx=0 tx=0).stop 2024-04-01T22:34:06.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.425+0000 7f2ecea30640 1 -- 172.21.15.47:0/1985342315 shutdown_connections 2024-04-01T22:34:06.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.425+0000 7f2ecea30640 1 --2- 172.21.15.47:0/1985342315 >> v2:172.21.15.47:3300/0 conn(0x7f2ec80c6be0 0x7f2ec80cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.425+0000 7f2ecea30640 1 --2- 172.21.15.47:0/1985342315 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ec8158a00 0x7f2ec815eef0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.425+0000 7f2ecea30640 1 -- 172.21.15.47:0/1985342315 >> 172.21.15.47:0/1985342315 conn(0x7f2ec806ef00 msgr2=0x7f2ec806f310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:06.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.425+0000 7f7172d9d640 1 --2- 172.21.15.47:0/3866953092 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7174072530 0x7f71741f7610 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f716c00c780 tx=0x7f716c00cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:06.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.425+0000 7f2ecea30640 1 -- 172.21.15.47:0/1985342315 shutdown_connections 2024-04-01T22:34:06.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.425+0000 7f2ecea30640 1 -- 172.21.15.47:0/1985342315 wait complete. 2024-04-01T22:34:06.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.426+0000 7f6f16d9d640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f10047c80 0x7f6f1004bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:39444/0 (socket says 172.21.15.47:39444) 2024-04-01T22:34:06.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.426+0000 7f6f16d9d640 1 -- 172.21.15.47:0/3265749256 learned_addr learned my addr 172.21.15.47:0/3265749256 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:06.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.426+0000 7f5bf5b9d640 1 --2- 172.21.15.47:0/3540012881 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5bf0072df0 0x7f5bf0073240 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5bf00cd1b0 tx=0x7f5be002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=841d31c12106fd server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:06.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.427+0000 7f2ecea30640 1 Processor -- start 2024-04-01T22:34:06.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.427+0000 7f3990eda640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f398404b600 0x7f39840355a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:39464/0 (socket says 172.21.15.47:39464) 2024-04-01T22:34:06.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.427+0000 7f3990eda640 1 -- 172.21.15.47:0/3755157743 learned_addr learned my addr 172.21.15.47:0/3755157743 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:06.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.427+0000 7f2ecea30640 1 -- start start 2024-04-01T22:34:06.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.428+0000 7f2ecea30640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ec80c6be0 0x7f2ec814ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.428+0000 7f2ecea30640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ec80cbb80 0x7f2ec80c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.428+0000 7f2ecea30640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ec8158a00 0x7f2ec80ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.428+0000 7f2ecea30640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec81624d0 con 0x7f2ec80c6be0 2024-04-01T22:34:06.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.428+0000 7fa6ae59c640 1 -- 172.21.15.47:0/3816318634 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa6b0158910 msgr2=0x7fa6b0156d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.428+0000 7f2ecea30640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec81621f0 con 0x7f2ec8158a00 2024-04-01T22:34:06.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.428+0000 7fa6ae59c640 1 --2- 172.21.15.47:0/3816318634 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa6b0158910 0x7fa6b0156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.428+0000 7fa6ae59c640 1 -- 172.21.15.47:0/3816318634 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6b00cc410 msgr2=0x7fa6b01f42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.428+0000 7fa6ae59c640 1 --2- 172.21.15.47:0/3816318634 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6b00cc410 0x7fa6b01f42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.428+0000 7fa6ae59c640 1 -- 172.21.15.47:0/3816318634 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6b014c270 con 0x7fa6b006f0e0 2024-04-01T22:34:06.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.428+0000 7f2ecea30640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f2ec80c2770 con 0x7f2ec80cbb80 2024-04-01T22:34:06.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.430+0000 7f398bfff640 1 --2- 172.21.15.47:0/3755157743 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39840f6d80 0x7f39840f9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.431+0000 7f6f16d9d640 1 -- 172.21.15.47:0/3265749256 >> v2:172.21.15.47:3300/0 conn(0x7f6f100d9090 msgr2=0x7f6f100e2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:06.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.431+0000 7f6f16d9d640 1 --2- 172.21.15.47:0/3265749256 >> v2:172.21.15.47:3300/0 conn(0x7f6f100d9090 0x7f6f100e2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.431+0000 7f6f16d9d640 1 -- 172.21.15.47:0/3265749256 >> v1:172.21.15.47:6789/0 conn(0x7f6f10047690 legacy=0x7f6f10046350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:06.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.431+0000 7f6f16d9d640 1 -- 172.21.15.47:0/3265749256 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f100df530 con 0x7f6f10047c80 2024-04-01T22:34:06.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.433+0000 7fcc4b7fe640 1 -- 172.21.15.47:0/1767083342 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcc44037180 msgr2=0x7fcc440db170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.433+0000 7fcc4b7fe640 1 --2- 172.21.15.47:0/1767083342 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcc44037180 0x7fcc440db170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.433+0000 7fcc4b7fe640 1 -- 172.21.15.47:0/1767083342 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc440d92c0 msgr2=0x7fcc44174e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.433+0000 7fcc4b7fe640 1 --2- 172.21.15.47:0/1767083342 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc440d92c0 0x7fcc44174e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.433+0000 7fcc4b7fe640 1 -- 172.21.15.47:0/1767083342 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc44178360 con 0x7fcc44038d60 2024-04-01T22:34:06.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.433+0000 7f2ec7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ec80c6be0 0x7f2ec814ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.434+0000 7f7162ffd640 1 -- 172.21.15.47:0/3866953092 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716c004b60 con 0x7f7174072530 2024-04-01T22:34:06.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.434+0000 7f7162ffd640 1 -- 172.21.15.47:0/3866953092 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f716c004d00 con 0x7f7174072530 2024-04-01T22:34:06.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.434+0000 7f7162ffd640 1 -- 172.21.15.47:0/3866953092 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716c00aa90 con 0x7f7174072530 2024-04-01T22:34:06.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.434+0000 7f7178b43640 1 -- 172.21.15.47:0/3866953092 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71741f41c0 con 0x7f7174072530 2024-04-01T22:34:06.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.434+0000 7f7178b43640 1 -- 172.21.15.47:0/3866953092 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f717414b4a0 con 0x7f7174072530 2024-04-01T22:34:06.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.435+0000 7f7178b43640 1 -- 172.21.15.47:0/3866953092 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7174075770 con 0x7f7174072530 2024-04-01T22:34:06.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.436+0000 7f398bfff640 1 -- 172.21.15.47:0/3755157743 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f398404b600 msgr2=0x7f39840355a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.436+0000 7f398bfff640 1 --2- 172.21.15.47:0/3755157743 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f398404b600 0x7f39840355a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.436+0000 7f398bfff640 1 -- 172.21.15.47:0/3755157743 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f39840fc9b0 msgr2=0x7f39841984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.436+0000 7f398bfff640 1 --2- 172.21.15.47:0/3755157743 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f39840fc9b0 0x7f39841984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.436+0000 7f398bfff640 1 -- 172.21.15.47:0/3755157743 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39840feff0 con 0x7f39840f6d80 2024-04-01T22:34:06.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.437+0000 7f2ec7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ec80c6be0 0x7f2ec814ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47846/0 (socket says 172.21.15.47:47846) 2024-04-01T22:34:06.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.437+0000 7f2ec7fff640 1 -- 172.21.15.47:0/2703527978 learned_addr learned my addr 172.21.15.47:0/2703527978 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:06.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.441+0000 7fa6ae59c640 1 --2- 172.21.15.47:0/3816318634 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6b006f0e0 0x7fa6b015efc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa69800b410 tx=0x7fa69800b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:06.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.442+0000 7fcc4b7fe640 1 --2- 172.21.15.47:0/1767083342 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc44038d60 0x7fcc4416a800 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c073ad0 tx=0x7fcc4c068e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:06.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.443+0000 7f2ec7fff640 1 -- 172.21.15.47:0/2703527978 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ec80cbb80 msgr2=0x7f2ec80c94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.443+0000 7f2ec7fff640 1 --2- 172.21.15.47:0/2703527978 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2ec80cbb80 0x7f2ec80c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.443+0000 7f2ec7fff640 1 -- 172.21.15.47:0/2703527978 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ec8158a00 msgr2=0x7f2ec80ca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.443+0000 7f2ec7fff640 1 --2- 172.21.15.47:0/2703527978 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ec8158a00 0x7f2ec80ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.443+0000 7f2ec7fff640 1 -- 172.21.15.47:0/2703527978 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ec81f76c0 con 0x7f2ec80c6be0 2024-04-01T22:34:06.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.445+0000 7f398bfff640 1 --2- 172.21.15.47:0/3755157743 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39840f6d80 0x7f39840f9c60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f397800b3f0 tx=0x7f397800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:06.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.448+0000 7f2ec7fff640 1 --2- 172.21.15.47:0/2703527978 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ec80c6be0 0x7f2ec814ae00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc000c00 tx=0x7f2ebc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:06.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.449+0000 7f9a6affd640 1 -- 172.21.15.47:0/1854540587 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6402ca80 con 0x7f9a6c0cac90 2024-04-01T22:34:06.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.449+0000 7f9a6affd640 1 -- 172.21.15.47:0/1854540587 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a6402cc20 con 0x7f9a6c0cac90 2024-04-01T22:34:06.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.449+0000 7f9a6affd640 1 -- 172.21.15.47:0/1854540587 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a640343f0 con 0x7f9a6c0cac90 2024-04-01T22:34:06.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.450+0000 7f9a722b5640 1 -- 172.21.15.47:0/1854540587 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9a6c0cac90 msgr2=0x7f9a6c15bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.450+0000 7f9a722b5640 1 --2- 172.21.15.47:0/1854540587 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9a6c0cac90 0x7f9a6c15bd80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c0b0a60 tx=0x7f9a6402bee0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.450+0000 7f9a722b5640 1 -- 172.21.15.47:0/1854540587 shutdown_connections 2024-04-01T22:34:06.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.450+0000 7f9a722b5640 1 --2- 172.21.15.47:0/1854540587 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9a6c0cac90 0x7f9a6c15bd80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.450+0000 7f9a722b5640 1 --2- 172.21.15.47:0/1854540587 >> v2:172.21.15.47:3300/0 conn(0x7f9a6c152210 0x7f9a6c0c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.450+0000 7f9a722b5640 1 -- 172.21.15.47:0/1854540587 >> 172.21.15.47:0/1854540587 conn(0x7f9a6c071310 msgr2=0x7f9a6c071720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:06.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.450+0000 7f9a722b5640 1 -- 172.21.15.47:0/1854540587 shutdown_connections 2024-04-01T22:34:06.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.450+0000 7f9a722b5640 1 -- 172.21.15.47:0/1854540587 wait complete. 2024-04-01T22:34:06.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.451+0000 7f5bf539c640 1 -- 172.21.15.47:0/3540012881 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be0034070 con 0x7f5bf0072df0 2024-04-01T22:34:06.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.452+0000 7f5bf539c640 1 -- 172.21.15.47:0/3540012881 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5be0030610 con 0x7f5bf0072df0 2024-04-01T22:34:06.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.452+0000 7f5bf539c640 1 -- 172.21.15.47:0/3540012881 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be00309e0 con 0x7f5bf0072df0 2024-04-01T22:34:06.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.452+0000 7fa6a6ffd640 1 -- 172.21.15.47:0/3816318634 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa698015020 con 0x7fa6b006f0e0 2024-04-01T22:34:06.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.452+0000 7fa6a6ffd640 1 -- 172.21.15.47:0/3816318634 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa698011830 con 0x7fa6b006f0e0 2024-04-01T22:34:06.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.452+0000 7fa6af59e640 1 -- 172.21.15.47:0/3816318634 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6b01f7940 con 0x7fa6b006f0e0 2024-04-01T22:34:06.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.452+0000 7fa6a6ffd640 1 -- 172.21.15.47:0/3816318634 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa698011c20 con 0x7fa6b006f0e0 2024-04-01T22:34:06.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.452+0000 7fa6af59e640 1 -- 172.21.15.47:0/3816318634 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6b014bf90 con 0x7fa6b006f0e0 2024-04-01T22:34:06.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.453+0000 7f9a722b5640 1 Processor -- start 2024-04-01T22:34:06.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.452+0000 7f5bf8602640 1 -- 172.21.15.47:0/3540012881 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5bf0072df0 msgr2=0x7f5bf0073240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.452+0000 7f5bf8602640 1 --2- 172.21.15.47:0/3540012881 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5bf0072df0 0x7f5bf0073240 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5bf00cd1b0 tx=0x7f5be002b960 comp rx=0 tx=0).stop 2024-04-01T22:34:06.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.453+0000 7f5bf8602640 1 -- 172.21.15.47:0/3540012881 shutdown_connections 2024-04-01T22:34:06.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.453+0000 7fcc48ff9640 1 -- 172.21.15.47:0/1767083342 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc4c071760 con 0x7fcc44038d60 2024-04-01T22:34:06.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.453+0000 7f5bf8602640 1 --2- 172.21.15.47:0/3540012881 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5bf0072df0 0x7f5bf0073240 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.453+0000 7f5bf8602640 1 --2- 172.21.15.47:0/3540012881 >> v2:172.21.15.181:3300/0 conn(0x7f5bf0154400 0x7f5bf015a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.453+0000 7fcc48ff9640 1 -- 172.21.15.47:0/1767083342 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc4c071920 con 0x7fcc44038d60 2024-04-01T22:34:06.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.453+0000 7f5bf8602640 1 -- 172.21.15.47:0/3540012881 >> 172.21.15.47:0/3540012881 conn(0x7f5bf00c8bf0 msgr2=0x7f5bf00c8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:06.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.453+0000 7fcc48ff9640 1 -- 172.21.15.47:0/1767083342 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc4c071d10 con 0x7fcc44038d60 2024-04-01T22:34:06.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.453+0000 7fcc5165e640 1 -- 172.21.15.47:0/1767083342 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc44178640 con 0x7fcc44038d60 2024-04-01T22:34:06.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.453+0000 7f5bf8602640 1 -- 172.21.15.47:0/3540012881 shutdown_connections 2024-04-01T22:34:06.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.453+0000 7f5bf8602640 1 -- 172.21.15.47:0/3540012881 wait complete. 2024-04-01T22:34:06.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.453+0000 7fcc5165e640 1 -- 172.21.15.47:0/1767083342 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc44178c00 con 0x7fcc44038d60 2024-04-01T22:34:06.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.453+0000 7f9a722b5640 1 -- start start 2024-04-01T22:34:06.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.453+0000 7fa6af59e640 1 -- 172.21.15.47:0/3816318634 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa6b0162ab0 con 0x7fa6b006f0e0 2024-04-01T22:34:06.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.454+0000 7fcc5165e640 1 -- 172.21.15.47:0/1767083342 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcc44178110 con 0x7fcc44038d60 2024-04-01T22:34:06.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.454+0000 7f5bf8602640 1 Processor -- start 2024-04-01T22:34:06.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.455+0000 7f5bf8602640 1 -- start start 2024-04-01T22:34:06.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.455+0000 7f9a722b5640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9a6c0c8ce0 0x7f9a6c06c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.455+0000 7f9a722b5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a6c0cac90 0x7f9a6c0ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.455+0000 7f9a722b5640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9a6c152210 0x7f9a6c1f3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.455+0000 7f9a722b5640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9a6c0ca250 con 0x7f9a6c0cac90 2024-04-01T22:34:06.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.455+0000 7f9a722b5640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9a6c15b860 con 0x7f9a6c0c8ce0 2024-04-01T22:34:06.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.455+0000 7f9a722b5640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f9a6c158270 con 0x7f9a6c152210 2024-04-01T22:34:06.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.455+0000 7f5bf8602640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5bf0072df0 0x7f5bf014d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.455+0000 7f5bf8602640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5bf00ad8c0 0x7f5bf00c1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.456+0000 7f5bf8602640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5bf0154400 0x7f5bf00c1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.456+0000 7f5bf8602640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf00728d0 con 0x7f5bf0154400 2024-04-01T22:34:06.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.456+0000 7f5bf8602640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf00725f0 con 0x7f5bf0072df0 2024-04-01T22:34:06.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.456+0000 7f5bf8602640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f5bf0062150 con 0x7f5bf00ad8c0 2024-04-01T22:34:06.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.457+0000 7f2ec4ff9640 1 -- 172.21.15.47:0/2703527978 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc032860 con 0x7f2ec80c6be0 2024-04-01T22:34:06.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.457+0000 7f2ec4ff9640 1 -- 172.21.15.47:0/2703527978 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ebc032a20 con 0x7f2ec80c6be0 2024-04-01T22:34:06.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.457+0000 7f2ecea30640 1 -- 172.21.15.47:0/2703527978 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ec81f3fa0 con 0x7f2ec80c6be0 2024-04-01T22:34:06.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.457+0000 7f2ec4ff9640 1 -- 172.21.15.47:0/2703527978 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc032e10 con 0x7f2ec80c6be0 2024-04-01T22:34:06.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.457+0000 7f2ecea30640 1 -- 172.21.15.47:0/2703527978 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ec81f4560 con 0x7f2ec80c6be0 2024-04-01T22:34:06.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.458+0000 7f2ecea30640 1 -- 172.21.15.47:0/2703527978 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2ec80757e0 con 0x7f2ec80c6be0 2024-04-01T22:34:06.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.459+0000 7f39897fa640 1 -- 172.21.15.47:0/3755157743 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3978015020 con 0x7f39840f6d80 2024-04-01T22:34:06.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.459+0000 7f39897fa640 1 -- 172.21.15.47:0/3755157743 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3978011830 con 0x7f39840f6d80 2024-04-01T22:34:06.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.459+0000 7f399313e640 1 -- 172.21.15.47:0/3755157743 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39840ff2d0 con 0x7f39840f6d80 2024-04-01T22:34:06.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.459+0000 7f399313e640 1 -- 172.21.15.47:0/3755157743 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39840ff890 con 0x7f39840f6d80 2024-04-01T22:34:06.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.460+0000 7f39897fa640 1 -- 172.21.15.47:0/3755157743 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3978011c20 con 0x7f39840f6d80 2024-04-01T22:34:06.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.460+0000 7f9a6b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a6c0cac90 0x7f9a6c0ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.460+0000 7f7162ffd640 1 -- 172.21.15.47:0/3866953092 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f716c00ac30 con 0x7f7174072530 2024-04-01T22:34:06.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.460+0000 7f7162ffd640 1 --2- 172.21.15.47:0/3866953092 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f715406b9c0 0x7f715406de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.460+0000 7f399313e640 1 -- 172.21.15.47:0/3755157743 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f39840feda0 con 0x7f39840f6d80 2024-04-01T22:34:06.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.460+0000 7f717259c640 1 --2- 172.21.15.47:0/3866953092 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f715406b9c0 0x7f715406de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.461+0000 7f717259c640 1 --2- 172.21.15.47:0/3866953092 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f715406b9c0 0x7f715406de80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7164009670 tx=0x7f7164006bf0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:06.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.461+0000 7f5bf6b9f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5bf0154400 0x7f5bf00c1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.463+0000 7f7162ffd640 1 -- 172.21.15.47:0/3866953092 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f716c057820 con 0x7f7174072530 2024-04-01T22:34:06.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.463+0000 7f7162ffd640 1 --2- 172.21.15.47:0/3866953092 >> [v2:172.21.15.47:6810/3827395709,v1:172.21.15.47:6811/3827395709] conn(0x7f71540752d0 0x7f7154077770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.463+0000 7f7162ffd640 1 -- 172.21.15.47:0/3866953092 --> [v2:172.21.15.47:6810/3827395709,v1:172.21.15.47:6811/3827395709] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7154077e40 con 0x7f71540752d0 2024-04-01T22:34:06.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.463+0000 7f7171d9b640 1 --2- 172.21.15.47:0/3866953092 >> [v2:172.21.15.47:6810/3827395709,v1:172.21.15.47:6811/3827395709] conn(0x7f71540752d0 0x7f7154077770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.464+0000 7f6f16d9d640 1 --2- 172.21.15.47:0/3265749256 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f10047c80 0x7f6f1004bd10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6f18069820 tx=0x7f6f180a7650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c26292eea1bb595 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:06.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.464+0000 7f7171d9b640 1 --2- 172.21.15.47:0/3866953092 >> [v2:172.21.15.47:6810/3827395709,v1:172.21.15.47:6811/3827395709] conn(0x7f71540752d0 0x7f7154077770 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:06.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.465+0000 7f7162ffd640 1 -- 172.21.15.47:0/3866953092 <== osd.0 v2:172.21.15.47:6810/3827395709 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7154077e40 con 0x7f71540752d0 2024-04-01T22:34:06.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.467+0000 7f7162ffd640 1 -- 172.21.15.47:0/3866953092 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f716c055a20 con 0x7f7174072530 2024-04-01T22:34:06.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.469+0000 7f9a6b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a6c0cac90 0x7f9a6c0ccd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47848/0 (socket says 172.21.15.47:47848) 2024-04-01T22:34:06.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.469+0000 7f9a6b7fe640 1 -- 172.21.15.47:0/494499163 learned_addr learned my addr 172.21.15.47:0/494499163 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:06.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.475+0000 7f9a70852640 1 --2- 172.21.15.47:0/494499163 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9a6c152210 0x7f9a6c1f3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.476+0000 7f5bf6b9f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5bf0154400 0x7f5bf00c1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47862/0 (socket says 172.21.15.47:47862) 2024-04-01T22:34:06.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.476+0000 7f5bf6b9f640 1 -- 172.21.15.47:0/2648567959 learned_addr learned my addr 172.21.15.47:0/2648567959 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:06.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.477+0000 7f6f1559a640 1 -- 172.21.15.47:0/3265749256 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f180ac7d0 con 0x7f6f10047c80 2024-04-01T22:34:06.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.477+0000 7f6f1559a640 1 -- 172.21.15.47:0/3265749256 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f180ac970 con 0x7f6f10047c80 2024-04-01T22:34:06.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.477+0000 7f6f1559a640 1 -- 172.21.15.47:0/3265749256 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f180acde0 con 0x7f6f10047c80 2024-04-01T22:34:06.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.478+0000 7f6f1759e640 1 -- 172.21.15.47:0/3265749256 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f10047c80 msgr2=0x7f6f1004bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.478+0000 7f6f1759e640 1 --2- 172.21.15.47:0/3265749256 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f10047c80 0x7f6f1004bd10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6f18069820 tx=0x7f6f180a7650 comp rx=0 tx=0).stop 2024-04-01T22:34:06.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.478+0000 7f5bf5b9d640 1 --2- 172.21.15.47:0/2648567959 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5bf00ad8c0 0x7f5bf00c1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.478+0000 7f6f1759e640 1 -- 172.21.15.47:0/3265749256 shutdown_connections 2024-04-01T22:34:06.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.478+0000 7f6f1759e640 1 --2- 172.21.15.47:0/3265749256 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f10047c80 0x7f6f1004bd10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.478+0000 7f6f1759e640 1 --2- 172.21.15.47:0/3265749256 >> v2:172.21.15.47:3300/0 conn(0x7f6f100d9090 0x7f6f100e2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.478+0000 7f6f1759e640 1 -- 172.21.15.47:0/3265749256 >> 172.21.15.47:0/3265749256 conn(0x7f6f10051290 msgr2=0x7f6f100516a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:06.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.478+0000 7f6f1759e640 1 -- 172.21.15.47:0/3265749256 shutdown_connections 2024-04-01T22:34:06.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.478+0000 7f6f1759e640 1 -- 172.21.15.47:0/3265749256 wait complete. 2024-04-01T22:34:06.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.479+0000 7f7178b43640 1 -- 172.21.15.47:0/3866953092 --> [v2:172.21.15.47:6810/3827395709,v1:172.21.15.47:6811/3827395709] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f71740c5950 con 0x7f71540752d0 2024-04-01T22:34:06.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.480+0000 7f7162ffd640 1 -- 172.21.15.47:0/3866953092 <== osd.0 v2:172.21.15.47:6810/3827395709 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f71740c5950 con 0x7f71540752d0 2024-04-01T22:34:06.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.480+0000 7f6f1759e640 1 Processor -- start 2024-04-01T22:34:06.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.480+0000 7f6f1759e640 1 -- start start 2024-04-01T22:34:06.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.480+0000 7f7178b43640 1 -- 172.21.15.47:0/3866953092 >> [v2:172.21.15.47:6810/3827395709,v1:172.21.15.47:6811/3827395709] conn(0x7f71540752d0 msgr2=0x7f7154077770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.480+0000 7f7178b43640 1 --2- 172.21.15.47:0/3866953092 >> [v2:172.21.15.47:6810/3827395709,v1:172.21.15.47:6811/3827395709] conn(0x7f71540752d0 0x7f7154077770 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.480+0000 7f7178b43640 1 -- 172.21.15.47:0/3866953092 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f715406b9c0 msgr2=0x7f715406de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.480+0000 7f9a70852640 1 -- 172.21.15.47:0/494499163 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9a6c0c8ce0 msgr2=0x7f9a6c06c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.480+0000 7f9a70852640 1 --2- 172.21.15.47:0/494499163 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9a6c0c8ce0 0x7f9a6c06c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.480+0000 7f9a70852640 1 -- 172.21.15.47:0/494499163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a6c0cac90 msgr2=0x7f9a6c0ccd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.480+0000 7f9a70852640 1 --2- 172.21.15.47:0/494499163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a6c0cac90 0x7f9a6c0ccd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.480+0000 7f9a70852640 1 -- 172.21.15.47:0/494499163 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a6c1e2310 con 0x7f9a6c152210 2024-04-01T22:34:06.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.480+0000 7f7178b43640 1 --2- 172.21.15.47:0/3866953092 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f715406b9c0 0x7f715406de80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7164009670 tx=0x7f7164006bf0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.480+0000 7f7178b43640 1 -- 172.21.15.47:0/3866953092 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7174072530 msgr2=0x7f71741f7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.480+0000 7f7178b43640 1 --2- 172.21.15.47:0/3866953092 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7174072530 0x7f71741f7610 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f716c00c780 tx=0x7f716c00cc40 comp rx=0 tx=0).stop 2024-04-01T22:34:06.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.480+0000 7f7172d9d640 1 -- 172.21.15.47:0/3866953092 reap_dead start 2024-04-01T22:34:06.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.480+0000 7f7178b43640 1 -- 172.21.15.47:0/3866953092 shutdown_connections 2024-04-01T22:34:06.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.480+0000 7f7178b43640 1 -- 172.21.15.47:0/3866953092 >> 172.21.15.47:0/3866953092 conn(0x7f7174062220 msgr2=0x7f717414dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:06.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.480+0000 7f7178b43640 1 -- 172.21.15.47:0/3866953092 shutdown_connections 2024-04-01T22:34:06.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.481+0000 7f7178b43640 1 -- 172.21.15.47:0/3866953092 wait complete. 2024-04-01T22:34:06.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.481+0000 7f6f1759e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f10047690 0x7f6f10036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.481+0000 7f6f1759e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f10047c80 0x7f6f10178a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.481+0000 7f6f1759e640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f100d9090 0x7f6f10178fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.481+0000 7f6f1759e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6f100d9470 con 0x7f6f10047c80 2024-04-01T22:34:06.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.481+0000 7f6f1759e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6f100dfaf0 con 0x7f6f10047690 2024-04-01T22:34:06.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.481+0000 7f6f1759e640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f6f10046a60 con 0x7f6f100d9090 2024-04-01T22:34:06.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.484+0000 7f9a70852640 1 --2- 172.21.15.47:0/494499163 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9a6c152210 0x7f9a6c1f3970 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9a64032000 tx=0x7f9a64004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:06.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.485+0000 7fcc48ff9640 1 -- 172.21.15.47:0/1767083342 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7fcc4c093400 con 0x7fcc44038d60 2024-04-01T22:34:06.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.485+0000 7fcc48ff9640 1 --2- 172.21.15.47:0/1767083342 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fcc3006b9e0 0x7fcc3006dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.485+0000 7fcc4bfff640 1 --2- 172.21.15.47:0/1767083342 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fcc3006b9e0 0x7fcc3006dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.486+0000 7fcc4bfff640 1 --2- 172.21.15.47:0/1767083342 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fcc3006b9e0 0x7fcc3006dea0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcc400014d0 tx=0x7fcc400078b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:06.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.486+0000 7f5bf5b9d640 1 -- 172.21.15.47:0/2648567959 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5bf0072df0 msgr2=0x7f5bf014d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.486+0000 7f5bf5b9d640 1 --2- 172.21.15.47:0/2648567959 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5bf0072df0 0x7f5bf014d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.486+0000 7f5bf5b9d640 1 -- 172.21.15.47:0/2648567959 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5bf0154400 msgr2=0x7f5bf00c1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.486+0000 7f5bf5b9d640 1 --2- 172.21.15.47:0/2648567959 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5bf0154400 0x7f5bf00c1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.486+0000 7f5bf5b9d640 1 -- 172.21.15.47:0/2648567959 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bf00c5460 con 0x7f5bf00ad8c0 2024-04-01T22:34:06.491 INFO:teuthology.orchestra.run.smithi047.stdout:55834574862 2024-04-01T22:34:06.491 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-01T22:34:06.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.493+0000 7f9a68ff9640 1 -- 172.21.15.47:0/494499163 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a64043020 con 0x7f9a6c152210 2024-04-01T22:34:06.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.493+0000 7f9a68ff9640 1 -- 172.21.15.47:0/494499163 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a6403e450 con 0x7f9a6c152210 2024-04-01T22:34:06.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.493+0000 7f9a68ff9640 1 -- 172.21.15.47:0/494499163 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a64009510 con 0x7f9a6c152210 2024-04-01T22:34:06.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.493+0000 7f9a722b5640 1 -- 172.21.15.47:0/494499163 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a6c06dba0 con 0x7f9a6c152210 2024-04-01T22:34:06.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.493+0000 7f9a722b5640 1 -- 172.21.15.47:0/494499163 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a6c06e120 con 0x7f9a6c152210 2024-04-01T22:34:06.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.494+0000 7f5bf5b9d640 1 --2- 172.21.15.47:0/2648567959 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5bf00ad8c0 0x7f5bf00c1110 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5bf006ebe0 tx=0x7f5be00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:06.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.494+0000 7f9a722b5640 1 -- 172.21.15.47:0/494499163 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9a6c1f3550 con 0x7f9a6c152210 2024-04-01T22:34:06.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.499+0000 7fa6a6ffd640 1 -- 172.21.15.47:0/3816318634 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7fa698018020 con 0x7fa6b006f0e0 2024-04-01T22:34:06.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.500+0000 7fa6a6ffd640 1 --2- 172.21.15.47:0/3816318634 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fa69006b990 0x7fa69006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.500+0000 7fa6a7fff640 1 --2- 172.21.15.47:0/3816318634 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fa69006b990 0x7fa69006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.500+0000 7fa6a7fff640 1 --2- 172.21.15.47:0/3816318634 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fa69006b990 0x7fa69006de50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa6a0036000 tx=0x7fa6a0030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:06.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.502+0000 7f39897fa640 1 -- 172.21.15.47:0/3755157743 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f3978018020 con 0x7f39840f6d80 2024-04-01T22:34:06.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.502+0000 7f39897fa640 1 --2- 172.21.15.47:0/3755157743 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f397006b9c0 0x7f397006de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.503+0000 7f3990eda640 1 --2- 172.21.15.47:0/3755157743 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f397006b9c0 0x7f397006de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.503+0000 7f3990eda640 1 --2- 172.21.15.47:0/3755157743 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f397006b9c0 0x7f397006de80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f398c06b070 tx=0x7f398c069e40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:06.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.505+0000 7fcc48ff9640 1 -- 172.21.15.47:0/1767083342 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fcc4c0d2dc0 con 0x7fcc44038d60 2024-04-01T22:34:06.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.505+0000 7fcc48ff9640 1 --2- 172.21.15.47:0/1767083342 >> [v2:172.21.15.181:6824/1760995885,v1:172.21.15.181:6825/1760995885] conn(0x7fcc30075370 0x7fcc30077810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.505+0000 7fcc48ff9640 1 -- 172.21.15.47:0/1767083342 --> [v2:172.21.15.181:6824/1760995885,v1:172.21.15.181:6825/1760995885] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcc30077ee0 con 0x7fcc30075370 2024-04-01T22:34:06.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.505+0000 7fcc50e5d640 1 --2- 172.21.15.47:0/1767083342 >> [v2:172.21.15.181:6824/1760995885,v1:172.21.15.181:6825/1760995885] conn(0x7fcc30075370 0x7fcc30077810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.506+0000 7fcc50e5d640 1 --2- 172.21.15.47:0/1767083342 >> [v2:172.21.15.181:6824/1760995885,v1:172.21.15.181:6825/1760995885] conn(0x7fcc30075370 0x7fcc30077810 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:06.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.507+0000 7fcc48ff9640 1 -- 172.21.15.47:0/1767083342 <== osd.7 v2:172.21.15.181:6824/1760995885 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcc30077ee0 con 0x7fcc30075370 2024-04-01T22:34:06.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.509+0000 7fa6a6ffd640 1 -- 172.21.15.47:0/3816318634 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fa698057420 con 0x7fa6b006f0e0 2024-04-01T22:34:06.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.509+0000 7fa6a6ffd640 1 --2- 172.21.15.47:0/3816318634 >> [v2:172.21.15.181:6808/2961538461,v1:172.21.15.181:6809/2961538461] conn(0x7fa6900752a0 0x7fa690077740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.509+0000 7fa6a6ffd640 1 -- 172.21.15.47:0/3816318634 --> [v2:172.21.15.181:6808/2961538461,v1:172.21.15.181:6809/2961538461] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa698006730 con 0x7fa6900752a0 2024-04-01T22:34:06.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.510+0000 7fcc48ff9640 1 -- 172.21.15.47:0/1767083342 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcc4c0d0fc0 con 0x7fcc44038d60 2024-04-01T22:34:06.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.510+0000 7fa6aed9d640 1 --2- 172.21.15.47:0/3816318634 >> [v2:172.21.15.181:6808/2961538461,v1:172.21.15.181:6809/2961538461] conn(0x7fa6900752a0 0x7fa690077740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.510+0000 7fa6a6ffd640 1 -- 172.21.15.47:0/3816318634 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa698055620 con 0x7fa6b006f0e0 2024-04-01T22:34:06.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.510+0000 7fa6aed9d640 1 --2- 172.21.15.47:0/3816318634 >> [v2:172.21.15.181:6808/2961538461,v1:172.21.15.181:6809/2961538461] conn(0x7fa6900752a0 0x7fa690077740 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:06.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.511+0000 7fa6a6ffd640 1 -- 172.21.15.47:0/3816318634 <== osd.4 v2:172.21.15.181:6808/2961538461 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa698006730 con 0x7fa6900752a0 2024-04-01T22:34:06.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.512+0000 7f39897fa640 1 -- 172.21.15.47:0/3755157743 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f39780572c0 con 0x7f39840f6d80 2024-04-01T22:34:06.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.512+0000 7f39897fa640 1 --2- 172.21.15.47:0/3755157743 >> [v2:172.21.15.47:6818/2845699561,v1:172.21.15.47:6819/2845699561] conn(0x7f3970075350 0x7f39700777f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.512+0000 7f39897fa640 1 -- 172.21.15.47:0/3755157743 --> [v2:172.21.15.47:6818/2845699561,v1:172.21.15.47:6819/2845699561] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3978006820 con 0x7f3970075350 2024-04-01T22:34:06.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.512+0000 7f39897fa640 1 -- 172.21.15.47:0/3755157743 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f39780554c0 con 0x7f39840f6d80 2024-04-01T22:34:06.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.512+0000 7f39916db640 1 --2- 172.21.15.47:0/3755157743 >> [v2:172.21.15.47:6818/2845699561,v1:172.21.15.47:6819/2845699561] conn(0x7f3970075350 0x7f39700777f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.512+0000 7f6f15d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f10047c80 0x7f6f10178a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.513+0000 7f39916db640 1 --2- 172.21.15.47:0/3755157743 >> [v2:172.21.15.47:6818/2845699561,v1:172.21.15.47:6819/2845699561] conn(0x7f3970075350 0x7f39700777f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:06.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.513+0000 7f6f15d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f10047c80 0x7f6f10178a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47868/0 (socket says 172.21.15.47:47868) 2024-04-01T22:34:06.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.513+0000 7f6f15d9b640 1 -- 172.21.15.47:0/3170569568 learned_addr learned my addr 172.21.15.47:0/3170569568 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:06.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.514+0000 7f39897fa640 1 -- 172.21.15.47:0/3755157743 <== osd.3 v2:172.21.15.47:6818/2845699561 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3978006820 con 0x7f3970075350 2024-04-01T22:34:06.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.516+0000 7f6f1659c640 1 --2- 172.21.15.47:0/3170569568 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f10047690 0x7f6f10036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.519+0000 7f6f15d9b640 1 -- 172.21.15.47:0/3170569568 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f100d9090 msgr2=0x7f6f10178fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.519+0000 7f6f15d9b640 1 --2- 172.21.15.47:0/3170569568 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f6f100d9090 0x7f6f10178fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.519+0000 7f6f15d9b640 1 -- 172.21.15.47:0/3170569568 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f10047690 msgr2=0x7f6f10036b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.519+0000 7f6f15d9b640 1 --2- 172.21.15.47:0/3170569568 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f10047690 0x7f6f10036b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.519+0000 7f6f15d9b640 1 -- 172.21.15.47:0/3170569568 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f10035060 con 0x7f6f10047c80 2024-04-01T22:34:06.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.526+0000 7f9a68ff9640 1 -- 172.21.15.47:0/494499163 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f9a64046020 con 0x7f9a6c152210 2024-04-01T22:34:06.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.526+0000 7f9a68ff9640 1 --2- 172.21.15.47:0/494499163 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f9a5806b990 0x7f9a5806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.527+0000 7f9a6bfff640 1 --2- 172.21.15.47:0/494499163 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f9a5806b990 0x7f9a5806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.527+0000 7f9a6bfff640 1 --2- 172.21.15.47:0/494499163 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f9a5806b990 0x7f9a5806de50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c009670 tx=0x7f9a5c006bf0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:06.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.528+0000 7f9a68ff9640 1 -- 172.21.15.47:0/494499163 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f9a64079b30 con 0x7f9a6c152210 2024-04-01T22:34:06.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.528+0000 7f9a68ff9640 1 --2- 172.21.15.47:0/494499163 >> [v2:172.21.15.47:6826/3152157503,v1:172.21.15.47:6827/3152157503] conn(0x7f9a580752a0 0x7f9a58077740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.528+0000 7f9a68ff9640 1 -- 172.21.15.47:0/494499163 --> [v2:172.21.15.47:6826/3152157503,v1:172.21.15.47:6827/3152157503] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9a58077e10 con 0x7f9a580752a0 2024-04-01T22:34:06.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.528+0000 7f9a68ff9640 1 -- 172.21.15.47:0/494499163 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9a64077d30 con 0x7f9a6c152210 2024-04-01T22:34:06.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.528+0000 7f9a6b7fe640 1 --2- 172.21.15.47:0/494499163 >> [v2:172.21.15.47:6826/3152157503,v1:172.21.15.47:6827/3152157503] conn(0x7f9a580752a0 0x7f9a58077740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.529+0000 7f9a6b7fe640 1 --2- 172.21.15.47:0/494499163 >> [v2:172.21.15.47:6826/3152157503,v1:172.21.15.47:6827/3152157503] conn(0x7f9a580752a0 0x7f9a58077740 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:06.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.530+0000 7f9a68ff9640 1 -- 172.21.15.47:0/494499163 <== osd.1 v2:172.21.15.47:6826/3152157503 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9a58077e10 con 0x7f9a580752a0 2024-04-01T22:34:06.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.531+0000 7f5be6ffd640 1 -- 172.21.15.47:0/2648567959 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be0034040 con 0x7f5bf00ad8c0 2024-04-01T22:34:06.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.531+0000 7f5be6ffd640 1 -- 172.21.15.47:0/2648567959 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5be003ada0 con 0x7f5bf00ad8c0 2024-04-01T22:34:06.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.531+0000 7f5bf8602640 1 -- 172.21.15.47:0/2648567959 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bf01f0a80 con 0x7f5bf00ad8c0 2024-04-01T22:34:06.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.531+0000 7f5bf8602640 1 -- 172.21.15.47:0/2648567959 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bf00b0220 con 0x7f5bf00ad8c0 2024-04-01T22:34:06.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.532+0000 7f5be6ffd640 1 -- 172.21.15.47:0/2648567959 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be0006e10 con 0x7f5bf00ad8c0 2024-04-01T22:34:06.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.533+0000 7f5bf8602640 1 -- 172.21.15.47:0/2648567959 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5bf0068920 con 0x7f5bf00ad8c0 2024-04-01T22:34:06.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.536+0000 7fa6af59e640 1 -- 172.21.15.47:0/3816318634 --> [v2:172.21.15.181:6808/2961538461,v1:172.21.15.181:6809/2961538461] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa6b00757e0 con 0x7fa6900752a0 2024-04-01T22:34:06.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.536+0000 7fa6a6ffd640 1 -- 172.21.15.47:0/3816318634 <== osd.4 v2:172.21.15.181:6808/2961538461 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa6b00757e0 con 0x7fa6900752a0 2024-04-01T22:34:06.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.537+0000 7fa6af59e640 1 -- 172.21.15.47:0/3816318634 >> [v2:172.21.15.181:6808/2961538461,v1:172.21.15.181:6809/2961538461] conn(0x7fa6900752a0 msgr2=0x7fa690077740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.537+0000 7fa6af59e640 1 --2- 172.21.15.47:0/3816318634 >> [v2:172.21.15.181:6808/2961538461,v1:172.21.15.181:6809/2961538461] conn(0x7fa6900752a0 0x7fa690077740 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.537+0000 7fa6af59e640 1 -- 172.21.15.47:0/3816318634 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fa69006b990 msgr2=0x7fa69006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.537+0000 7fa6af59e640 1 --2- 172.21.15.47:0/3816318634 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fa69006b990 0x7fa69006de50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa6a0036000 tx=0x7fa6a0030000 comp rx=0 tx=0).stop 2024-04-01T22:34:06.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.537+0000 7fa6af59e640 1 -- 172.21.15.47:0/3816318634 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6b006f0e0 msgr2=0x7fa6b015efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.537+0000 7fa6af59e640 1 --2- 172.21.15.47:0/3816318634 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6b006f0e0 0x7fa6b015efc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa69800b410 tx=0x7fa69800b8d0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.537+0000 7f399313e640 1 -- 172.21.15.47:0/3755157743 --> [v2:172.21.15.47:6818/2845699561,v1:172.21.15.47:6819/2845699561] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f39840053c0 con 0x7f3970075350 2024-04-01T22:34:06.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.537+0000 7fa6aed9d640 1 -- 172.21.15.47:0/3816318634 reap_dead start 2024-04-01T22:34:06.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.538+0000 7fa6af59e640 1 -- 172.21.15.47:0/3816318634 shutdown_connections 2024-04-01T22:34:06.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.538+0000 7fcc5165e640 1 -- 172.21.15.47:0/1767083342 --> [v2:172.21.15.181:6824/1760995885,v1:172.21.15.181:6825/1760995885] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcc44178fe0 con 0x7fcc30075370 2024-04-01T22:34:06.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.538+0000 7fa6af59e640 1 -- 172.21.15.47:0/3816318634 >> 172.21.15.47:0/3816318634 conn(0x7fa6b00cb8f0 msgr2=0x7fa6b0150e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:06.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.538+0000 7f39897fa640 1 -- 172.21.15.47:0/3755157743 <== osd.3 v2:172.21.15.47:6818/2845699561 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f39840053c0 con 0x7f3970075350 2024-04-01T22:34:06.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.538+0000 7fa6af59e640 1 -- 172.21.15.47:0/3816318634 shutdown_connections 2024-04-01T22:34:06.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.538+0000 7fa6af59e640 1 -- 172.21.15.47:0/3816318634 wait complete. 2024-04-01T22:34:06.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.539+0000 7fcc48ff9640 1 -- 172.21.15.47:0/1767083342 <== osd.7 v2:172.21.15.181:6824/1760995885 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcc44178fe0 con 0x7fcc30075370 2024-04-01T22:34:06.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.539+0000 7f399313e640 1 -- 172.21.15.47:0/3755157743 >> [v2:172.21.15.47:6818/2845699561,v1:172.21.15.47:6819/2845699561] conn(0x7f3970075350 msgr2=0x7f39700777f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.539+0000 7f399313e640 1 --2- 172.21.15.47:0/3755157743 >> [v2:172.21.15.47:6818/2845699561,v1:172.21.15.47:6819/2845699561] conn(0x7f3970075350 0x7f39700777f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.539+0000 7f399313e640 1 -- 172.21.15.47:0/3755157743 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f397006b9c0 msgr2=0x7f397006de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.539+0000 7f399313e640 1 --2- 172.21.15.47:0/3755157743 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f397006b9c0 0x7f397006de80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f398c06b070 tx=0x7f398c069e40 comp rx=0 tx=0).stop 2024-04-01T22:34:06.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.539+0000 7f399313e640 1 -- 172.21.15.47:0/3755157743 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39840f6d80 msgr2=0x7f39840f9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.539+0000 7f399313e640 1 --2- 172.21.15.47:0/3755157743 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39840f6d80 0x7f39840f9c60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f397800b3f0 tx=0x7f397800b8b0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.539+0000 7f39916db640 1 -- 172.21.15.47:0/3755157743 reap_dead start 2024-04-01T22:34:06.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.539+0000 7fcc5165e640 1 -- 172.21.15.47:0/1767083342 >> [v2:172.21.15.181:6824/1760995885,v1:172.21.15.181:6825/1760995885] conn(0x7fcc30075370 msgr2=0x7fcc30077810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.539+0000 7fcc5165e640 1 --2- 172.21.15.47:0/1767083342 >> [v2:172.21.15.181:6824/1760995885,v1:172.21.15.181:6825/1760995885] conn(0x7fcc30075370 0x7fcc30077810 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.539+0000 7fcc5165e640 1 -- 172.21.15.47:0/1767083342 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fcc3006b9e0 msgr2=0x7fcc3006dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.539+0000 7fcc5165e640 1 --2- 172.21.15.47:0/1767083342 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fcc3006b9e0 0x7fcc3006dea0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcc400014d0 tx=0x7fcc400078b0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.539+0000 7fcc5165e640 1 -- 172.21.15.47:0/1767083342 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc44038d60 msgr2=0x7fcc4416a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.539+0000 7fcc5165e640 1 --2- 172.21.15.47:0/1767083342 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc44038d60 0x7fcc4416a800 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c073ad0 tx=0x7fcc4c068e30 comp rx=0 tx=0).stop 2024-04-01T22:34:06.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.539+0000 7fcc50e5d640 1 -- 172.21.15.47:0/1767083342 reap_dead start 2024-04-01T22:34:06.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.540+0000 7fcc5165e640 1 -- 172.21.15.47:0/1767083342 shutdown_connections 2024-04-01T22:34:06.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.540+0000 7fcc5165e640 1 -- 172.21.15.47:0/1767083342 >> 172.21.15.47:0/1767083342 conn(0x7fcc44054610 msgr2=0x7fcc440d3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:06.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.540+0000 7fcc5165e640 1 -- 172.21.15.47:0/1767083342 shutdown_connections 2024-04-01T22:34:06.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.540+0000 7fcc5165e640 1 -- 172.21.15.47:0/1767083342 wait complete. 2024-04-01T22:34:06.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.540+0000 7f399313e640 1 -- 172.21.15.47:0/3755157743 shutdown_connections 2024-04-01T22:34:06.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.540+0000 7f399313e640 1 -- 172.21.15.47:0/3755157743 >> 172.21.15.47:0/3755157743 conn(0x7f39840501b0 msgr2=0x7f39840fb550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:06.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.540+0000 7f399313e640 1 -- 172.21.15.47:0/3755157743 shutdown_connections 2024-04-01T22:34:06.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.540+0000 7f399313e640 1 -- 172.21.15.47:0/3755157743 wait complete. 2024-04-01T22:34:06.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.541+0000 7f2ec4ff9640 1 -- 172.21.15.47:0/2703527978 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f2ebc0453f0 con 0x7f2ec80c6be0 2024-04-01T22:34:06.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.542+0000 7f2ec4ff9640 1 --2- 172.21.15.47:0/2703527978 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f2eac06b9e0 0x7f2eac06dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.542+0000 7f2ec77fe640 1 --2- 172.21.15.47:0/2703527978 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f2eac06b9e0 0x7f2eac06dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.543+0000 7f2ec77fe640 1 --2- 172.21.15.47:0/2703527978 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f2eac06b9e0 0x7f2eac06dea0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8161c00 tx=0x7f2eb40095a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:06.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.546+0000 7f6f15d9b640 1 --2- 172.21.15.47:0/3170569568 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f10047c80 0x7f6f10178a90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c00b410 tx=0x7f6f0c00b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:06.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.547+0000 7f2ec4ff9640 1 -- 172.21.15.47:0/2703527978 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f2ebc079650 con 0x7f2ec80c6be0 2024-04-01T22:34:06.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.547+0000 7f2ec4ff9640 1 --2- 172.21.15.47:0/2703527978 >> [v2:172.21.15.181:6816/2161566540,v1:172.21.15.181:6817/2161566540] conn(0x7f2eac0753f0 0x7f2eac077890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.547+0000 7f2ec4ff9640 1 -- 172.21.15.47:0/2703527978 --> [v2:172.21.15.181:6816/2161566540,v1:172.21.15.181:6817/2161566540] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2ebc036ec0 con 0x7f2eac0753f0 2024-04-01T22:34:06.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.547+0000 7f2ec4ff9640 1 -- 172.21.15.47:0/2703527978 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2ebc077850 con 0x7f2ec80c6be0 2024-04-01T22:34:06.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.547+0000 7f2eccfcd640 1 --2- 172.21.15.47:0/2703527978 >> [v2:172.21.15.181:6816/2161566540,v1:172.21.15.181:6817/2161566540] conn(0x7f2eac0753f0 0x7f2eac077890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.548+0000 7f2eccfcd640 1 --2- 172.21.15.47:0/2703527978 >> [v2:172.21.15.181:6816/2161566540,v1:172.21.15.181:6817/2161566540] conn(0x7f2eac0753f0 0x7f2eac077890 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:06.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.548+0000 7f2ec4ff9640 1 -- 172.21.15.47:0/2703527978 <== osd.5 v2:172.21.15.181:6816/2161566540 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2ebc036ec0 con 0x7f2eac0753f0 2024-04-01T22:34:06.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.556+0000 7f5be6ffd640 1 -- 172.21.15.47:0/2648567959 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f5be0037070 con 0x7f5bf00ad8c0 2024-04-01T22:34:06.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.556+0000 7f5be6ffd640 1 --2- 172.21.15.47:0/2648567959 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f5bd406ba10 0x7f5bd406ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.557+0000 7f5be6ffd640 1 -- 172.21.15.47:0/2648567959 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f5be00ad120 con 0x7f5bf00ad8c0 2024-04-01T22:34:06.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.557+0000 7f5be6ffd640 1 --2- 172.21.15.47:0/2648567959 >> [v2:172.21.15.47:6802/1003968856,v1:172.21.15.47:6803/1003968856] conn(0x7f5bd40754a0 0x7f5bd4077940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.557+0000 7f5be6ffd640 1 -- 172.21.15.47:0/2648567959 --> [v2:172.21.15.47:6802/1003968856,v1:172.21.15.47:6803/1003968856] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5be003a2b0 con 0x7f5bd40754a0 2024-04-01T22:34:06.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.557+0000 7f5be6ffd640 1 -- 172.21.15.47:0/2648567959 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5be00ad600 con 0x7f5bf00ad8c0 2024-04-01T22:34:06.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.556+0000 7f6f06ffd640 1 -- 172.21.15.47:0/3170569568 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c015020 con 0x7f6f10047c80 2024-04-01T22:34:06.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.556+0000 7f6f06ffd640 1 -- 172.21.15.47:0/3170569568 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f0c011850 con 0x7f6f10047c80 2024-04-01T22:34:06.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.556+0000 7f6f06ffd640 1 -- 172.21.15.47:0/3170569568 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c011c40 con 0x7f6f10047c80 2024-04-01T22:34:06.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.557+0000 7f6f1759e640 1 -- 172.21.15.47:0/3170569568 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f1016a920 con 0x7f6f10047c80 2024-04-01T22:34:06.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.557+0000 7f6f1759e640 1 -- 172.21.15.47:0/3170569568 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f100deba0 con 0x7f6f10047c80 2024-04-01T22:34:06.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.557+0000 7f5bf6b9f640 1 --2- 172.21.15.47:0/2648567959 >> [v2:172.21.15.47:6802/1003968856,v1:172.21.15.47:6803/1003968856] conn(0x7f5bd40754a0 0x7f5bd4077940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.559 INFO:teuthology.orchestra.run.smithi047.stdout:55834574862 2024-04-01T22:34:06.559 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-01T22:34:06.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.558+0000 7f5bf6b9f640 1 --2- 172.21.15.47:0/2648567959 >> [v2:172.21.15.47:6802/1003968856,v1:172.21.15.47:6803/1003968856] conn(0x7f5bd40754a0 0x7f5bd4077940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:06.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.558+0000 7f6f04ff9640 1 -- 172.21.15.47:0/3170569568 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6ef0001030 con 0x7f6f10047c80 2024-04-01T22:34:06.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.559+0000 7f5bf639e640 1 --2- 172.21.15.47:0/2648567959 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f5bd406ba10 0x7f5bd406ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.559+0000 7f5be6ffd640 1 -- 172.21.15.47:0/2648567959 <== osd.2 v2:172.21.15.47:6802/1003968856 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5be003a2b0 con 0x7f5bd40754a0 2024-04-01T22:34:06.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.560+0000 7f5bf639e640 1 --2- 172.21.15.47:0/2648567959 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f5bd406ba10 0x7f5bd406ded0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5bec009770 tx=0x7f5bec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:06.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.561+0000 7f9a722b5640 1 -- 172.21.15.47:0/494499163 --> [v2:172.21.15.47:6826/3152157503,v1:172.21.15.47:6827/3152157503] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9a6c068210 con 0x7f9a580752a0 2024-04-01T22:34:06.562 INFO:teuthology.orchestra.run.smithi047.stdout:55834574862 2024-04-01T22:34:06.563 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-01T22:34:06.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.562+0000 7f9a68ff9640 1 -- 172.21.15.47:0/494499163 <== osd.1 v2:172.21.15.47:6826/3152157503 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9a6c068210 con 0x7f9a580752a0 2024-04-01T22:34:06.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.562+0000 7f9a722b5640 1 -- 172.21.15.47:0/494499163 >> [v2:172.21.15.47:6826/3152157503,v1:172.21.15.47:6827/3152157503] conn(0x7f9a580752a0 msgr2=0x7f9a58077740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.562+0000 7f9a722b5640 1 --2- 172.21.15.47:0/494499163 >> [v2:172.21.15.47:6826/3152157503,v1:172.21.15.47:6827/3152157503] conn(0x7f9a580752a0 0x7f9a58077740 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.563+0000 7f9a722b5640 1 -- 172.21.15.47:0/494499163 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f9a5806b990 msgr2=0x7f9a5806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.563+0000 7f9a722b5640 1 --2- 172.21.15.47:0/494499163 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f9a5806b990 0x7f9a5806de50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c009670 tx=0x7f9a5c006bf0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.563+0000 7f9a722b5640 1 -- 172.21.15.47:0/494499163 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9a6c152210 msgr2=0x7f9a6c1f3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.563+0000 7f9a722b5640 1 --2- 172.21.15.47:0/494499163 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f9a6c152210 0x7f9a6c1f3970 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9a64032000 tx=0x7f9a64004a40 comp rx=0 tx=0).stop 2024-04-01T22:34:06.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.563+0000 7f9a70852640 1 -- 172.21.15.47:0/494499163 reap_dead start 2024-04-01T22:34:06.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.563+0000 7f9a722b5640 1 -- 172.21.15.47:0/494499163 shutdown_connections 2024-04-01T22:34:06.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.563+0000 7f9a722b5640 1 -- 172.21.15.47:0/494499163 >> 172.21.15.47:0/494499163 conn(0x7f9a6c071310 msgr2=0x7f9a6c1560a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:06.565 INFO:teuthology.orchestra.run.smithi047.stdout:55834574862 2024-04-01T22:34:06.565 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-01T22:34:06.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.564+0000 7f9a722b5640 1 -- 172.21.15.47:0/494499163 shutdown_connections 2024-04-01T22:34:06.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.564+0000 7f9a722b5640 1 -- 172.21.15.47:0/494499163 wait complete. 2024-04-01T22:34:06.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.575+0000 7f2ecea30640 1 -- 172.21.15.47:0/2703527978 --> [v2:172.21.15.181:6816/2161566540,v1:172.21.15.181:6817/2161566540] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2ec80757e0 con 0x7f2eac0753f0 2024-04-01T22:34:06.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.576+0000 7f2ec4ff9640 1 -- 172.21.15.47:0/2703527978 <== osd.5 v2:172.21.15.181:6816/2161566540 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2ec80757e0 con 0x7f2eac0753f0 2024-04-01T22:34:06.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.578+0000 7f2ecea30640 1 -- 172.21.15.47:0/2703527978 >> [v2:172.21.15.181:6816/2161566540,v1:172.21.15.181:6817/2161566540] conn(0x7f2eac0753f0 msgr2=0x7f2eac077890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.578+0000 7f2ecea30640 1 --2- 172.21.15.47:0/2703527978 >> [v2:172.21.15.181:6816/2161566540,v1:172.21.15.181:6817/2161566540] conn(0x7f2eac0753f0 0x7f2eac077890 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.578+0000 7f2ecea30640 1 -- 172.21.15.47:0/2703527978 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f2eac06b9e0 msgr2=0x7f2eac06dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.578+0000 7f2ecea30640 1 --2- 172.21.15.47:0/2703527978 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f2eac06b9e0 0x7f2eac06dea0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8161c00 tx=0x7f2eb40095a0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.578+0000 7f2ecea30640 1 -- 172.21.15.47:0/2703527978 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ec80c6be0 msgr2=0x7f2ec814ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.578+0000 7f2ecea30640 1 --2- 172.21.15.47:0/2703527978 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ec80c6be0 0x7f2ec814ae00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc000c00 tx=0x7f2ebc0046c0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.578+0000 7f2eccfcd640 1 -- 172.21.15.47:0/2703527978 reap_dead start 2024-04-01T22:34:06.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.579+0000 7f2ecea30640 1 -- 172.21.15.47:0/2703527978 shutdown_connections 2024-04-01T22:34:06.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.579+0000 7f2ecea30640 1 -- 172.21.15.47:0/2703527978 >> 172.21.15.47:0/2703527978 conn(0x7f2ec806ef00 msgr2=0x7f2ec81579c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:06.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.579+0000 7f2ecea30640 1 -- 172.21.15.47:0/2703527978 shutdown_connections 2024-04-01T22:34:06.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.579+0000 7f2ecea30640 1 -- 172.21.15.47:0/2703527978 wait complete. 2024-04-01T22:34:06.580 INFO:teuthology.orchestra.run.smithi047.stdout:55834574861 2024-04-01T22:34:06.580 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-01T22:34:06.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.589+0000 7f5bf8602640 1 -- 172.21.15.47:0/2648567959 --> [v2:172.21.15.47:6802/1003968856,v1:172.21.15.47:6803/1003968856] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5bf0068920 con 0x7f5bd40754a0 2024-04-01T22:34:06.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.590+0000 7f5be6ffd640 1 -- 172.21.15.47:0/2648567959 <== osd.2 v2:172.21.15.47:6802/1003968856 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5bf0068920 con 0x7f5bd40754a0 2024-04-01T22:34:06.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.591+0000 7f5bf8602640 1 -- 172.21.15.47:0/2648567959 >> [v2:172.21.15.47:6802/1003968856,v1:172.21.15.47:6803/1003968856] conn(0x7f5bd40754a0 msgr2=0x7f5bd4077940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.591+0000 7f5bf8602640 1 --2- 172.21.15.47:0/2648567959 >> [v2:172.21.15.47:6802/1003968856,v1:172.21.15.47:6803/1003968856] conn(0x7f5bd40754a0 0x7f5bd4077940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.591+0000 7f5bf8602640 1 -- 172.21.15.47:0/2648567959 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f5bd406ba10 msgr2=0x7f5bd406ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.591+0000 7f5bf8602640 1 --2- 172.21.15.47:0/2648567959 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f5bd406ba10 0x7f5bd406ded0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5bec009770 tx=0x7f5bec008040 comp rx=0 tx=0).stop 2024-04-01T22:34:06.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.591+0000 7f5bf8602640 1 -- 172.21.15.47:0/2648567959 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5bf00ad8c0 msgr2=0x7f5bf00c1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.591+0000 7f5bf8602640 1 --2- 172.21.15.47:0/2648567959 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5bf00ad8c0 0x7f5bf00c1110 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5bf006ebe0 tx=0x7f5be00046c0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.591+0000 7f5bf6b9f640 1 -- 172.21.15.47:0/2648567959 reap_dead start 2024-04-01T22:34:06.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.592+0000 7f5bf8602640 1 -- 172.21.15.47:0/2648567959 shutdown_connections 2024-04-01T22:34:06.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.592+0000 7f5bf8602640 1 -- 172.21.15.47:0/2648567959 >> 172.21.15.47:0/2648567959 conn(0x7f5bf00c8bf0 msgr2=0x7f5bf00c9ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:06.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.592+0000 7f5bf8602640 1 -- 172.21.15.47:0/2648567959 shutdown_connections 2024-04-01T22:34:06.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.592+0000 7f5bf8602640 1 -- 172.21.15.47:0/2648567959 wait complete. 2024-04-01T22:34:06.600 INFO:teuthology.orchestra.run.smithi047.stdout:55834574861 2024-04-01T22:34:06.600 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-01T22:34:06.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.601+0000 7f6f06ffd640 1 -- 172.21.15.47:0/3170569568 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f6f0c018020 con 0x7f6f10047c80 2024-04-01T22:34:06.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.601+0000 7f6f06ffd640 1 --2- 172.21.15.47:0/3170569568 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f6ef806b9e0 0x7f6ef806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.602+0000 7f6f1659c640 1 --2- 172.21.15.47:0/3170569568 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f6ef806b9e0 0x7f6ef806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.603+0000 7f6f1659c640 1 --2- 172.21.15.47:0/3170569568 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f6ef806b9e0 0x7f6ef806dea0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6f080099e0 tx=0x7f6f08009110 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:06.615 INFO:teuthology.orchestra.run.smithi047.stdout:55834574862 2024-04-01T22:34:06.615 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-01T22:34:06.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.635+0000 7f6f06ffd640 1 -- 172.21.15.47:0/3170569568 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f6f0c011de0 con 0x7f6f10047c80 2024-04-01T22:34:06.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.635+0000 7f6f06ffd640 1 --2- 172.21.15.47:0/3170569568 >> [v2:172.21.15.181:6800/3792144865,v1:172.21.15.181:6801/3792144865] conn(0x7f6ef8075370 0x7f6ef8077810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.635+0000 7f6f06ffd640 1 -- 172.21.15.47:0/3170569568 --> [v2:172.21.15.181:6800/3792144865,v1:172.21.15.181:6801/3792144865] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6f0c018ec0 con 0x7f6ef8075370 2024-04-01T22:34:06.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.636+0000 7f6f16d9d640 1 --2- 172.21.15.47:0/3170569568 >> [v2:172.21.15.181:6800/3792144865,v1:172.21.15.181:6801/3792144865] conn(0x7f6ef8075370 0x7f6ef8077810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.636+0000 7f6f16d9d640 1 --2- 172.21.15.47:0/3170569568 >> [v2:172.21.15.181:6800/3792144865,v1:172.21.15.181:6801/3792144865] conn(0x7f6ef8075370 0x7f6ef8077810 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:06.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.637+0000 7f6f06ffd640 1 -- 172.21.15.47:0/3170569568 <== osd.6 v2:172.21.15.181:6800/3792144865 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6f0c018ec0 con 0x7f6ef8075370 2024-04-01T22:34:06.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.648+0000 7f6f06ffd640 1 -- 172.21.15.47:0/3170569568 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6f0c055510 con 0x7f6f10047c80 2024-04-01T22:34:06.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.654+0000 7f1278284640 1 Processor -- start 2024-04-01T22:34:06.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.654+0000 7f1278284640 1 -- start start 2024-04-01T22:34:06.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.656+0000 7f1278284640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1270150a50 0x7f1270159d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.656+0000 7f1278284640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f12700c76d0 0x7f12700c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.656+0000 7f1278284640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12700730d0 con 0x7f12700c7180 2024-04-01T22:34:06.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.656+0000 7f1278284640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f12700733b0 con 0x7f12700c76d0 2024-04-01T22:34:06.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.656+0000 7f1278284640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f1270073690 con 0x7f1270150a50 2024-04-01T22:34:06.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.657+0000 7f1276020640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1270150a50 0x7f1270159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.657+0000 7f127581f640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f12700c76d0 0x7f12700c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.657+0000 7f1276020640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1270150a50 0x7f1270159d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:39510/0 (socket says 172.21.15.47:39510) 2024-04-01T22:34:06.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.657+0000 7f1276020640 1 -- 172.21.15.47:0/2491277128 learned_addr learned my addr 172.21.15.47:0/2491277128 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:06.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.664+0000 7f127581f640 1 -- 172.21.15.47:0/2491277128 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1270150a50 msgr2=0x7f1270159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:06.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.664+0000 7f127581f640 1 --2- 172.21.15.47:0/2491277128 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1270150a50 0x7f1270159d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.664+0000 7f127581f640 1 -- 172.21.15.47:0/2491277128 >> v1:172.21.15.47:6789/0 conn(0x7f12700c7180 legacy=0x7f12700c28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:06.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.664+0000 7f127581f640 1 -- 172.21.15.47:0/2491277128 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12700c7c10 con 0x7f12700c76d0 2024-04-01T22:34:06.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.670+0000 7f127581f640 1 --2- 172.21.15.47:0/2491277128 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12700c76d0 0x7f12700c6af0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f126000a940 tx=0x7f126002cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc15a8e1f3b24c0a server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:06.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.678+0000 7f127501e640 1 -- 172.21.15.47:0/2491277128 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126003a070 con 0x7f12700c76d0 2024-04-01T22:34:06.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.678+0000 7f127501e640 1 -- 172.21.15.47:0/2491277128 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f126002db50 con 0x7f12700c76d0 2024-04-01T22:34:06.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.679+0000 7f1278284640 1 -- 172.21.15.47:0/2491277128 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12700c76d0 msgr2=0x7f12700c6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.679+0000 7f1278284640 1 --2- 172.21.15.47:0/2491277128 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12700c76d0 0x7f12700c6af0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f126000a940 tx=0x7f126002cda0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.682+0000 7f1278284640 1 -- 172.21.15.47:0/2491277128 shutdown_connections 2024-04-01T22:34:06.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.682+0000 7f1278284640 1 --2- 172.21.15.47:0/2491277128 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12700c76d0 0x7f12700c6af0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.682+0000 7f1278284640 1 --2- 172.21.15.47:0/2491277128 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1270150a50 0x7f1270159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.682+0000 7f1278284640 1 -- 172.21.15.47:0/2491277128 >> 172.21.15.47:0/2491277128 conn(0x7f12700c8bf0 msgr2=0x7f12700c8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:06.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.683+0000 7f1278284640 1 -- 172.21.15.47:0/2491277128 shutdown_connections 2024-04-01T22:34:06.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.683+0000 7f1278284640 1 -- 172.21.15.47:0/2491277128 wait complete. 2024-04-01T22:34:06.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.685+0000 7f1278284640 1 Processor -- start 2024-04-01T22:34:06.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.685+0000 7f1278284640 1 -- start start 2024-04-01T22:34:06.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.686+0000 7f1278284640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12700c7180 0x7f1270144cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.687+0000 7f6f04ff9640 1 -- 172.21.15.47:0/3170569568 --> [v2:172.21.15.181:6800/3792144865,v1:172.21.15.181:6801/3792144865] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6ef0002dd0 con 0x7f6ef8075370 2024-04-01T22:34:06.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.686+0000 7f1278284640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12700c76d0 0x7f1270145200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.686+0000 7f1278284640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1270150a50 0x7f12701f80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.686+0000 7f1278284640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1270150e30 con 0x7f12700c76d0 2024-04-01T22:34:06.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.686+0000 7f1278284640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f12700c81d0 con 0x7f12700c7180 2024-04-01T22:34:06.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.686+0000 7f1278284640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f12700c2fc0 con 0x7f1270150a50 2024-04-01T22:34:06.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.687+0000 7f6f06ffd640 1 -- 172.21.15.47:0/3170569568 <== osd.6 v2:172.21.15.181:6800/3792144865 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6ef0002dd0 con 0x7f6ef8075370 2024-04-01T22:34:06.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.688+0000 7f1276821640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1270150a50 0x7f12701f80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.689+0000 7f1276821640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1270150a50 0x7f12701f80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:39516/0 (socket says 172.21.15.47:39516) 2024-04-01T22:34:06.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.689+0000 7f1276821640 1 -- 172.21.15.47:0/3533635396 learned_addr learned my addr 172.21.15.47:0/3533635396 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:06.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.689+0000 7f127581f640 1 --2- 172.21.15.47:0/3533635396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12700c76d0 0x7f1270145200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.690+0000 7f6f04ff9640 1 -- 172.21.15.47:0/3170569568 >> [v2:172.21.15.181:6800/3792144865,v1:172.21.15.181:6801/3792144865] conn(0x7f6ef8075370 msgr2=0x7f6ef8077810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.690+0000 7f6f04ff9640 1 --2- 172.21.15.47:0/3170569568 >> [v2:172.21.15.181:6800/3792144865,v1:172.21.15.181:6801/3792144865] conn(0x7f6ef8075370 0x7f6ef8077810 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.696+0000 7f6f04ff9640 1 -- 172.21.15.47:0/3170569568 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f6ef806b9e0 msgr2=0x7f6ef806dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.696+0000 7f6f04ff9640 1 --2- 172.21.15.47:0/3170569568 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f6ef806b9e0 0x7f6ef806dea0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6f080099e0 tx=0x7f6f08009110 comp rx=0 tx=0).stop 2024-04-01T22:34:06.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.696+0000 7f6f04ff9640 1 -- 172.21.15.47:0/3170569568 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f10047c80 msgr2=0x7f6f10178a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.696+0000 7f6f04ff9640 1 --2- 172.21.15.47:0/3170569568 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f10047c80 0x7f6f10178a90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c00b410 tx=0x7f6f0c00b810 comp rx=0 tx=0).stop 2024-04-01T22:34:06.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.696+0000 7f6f16d9d640 1 -- 172.21.15.47:0/3170569568 reap_dead start 2024-04-01T22:34:06.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.698+0000 7f6f04ff9640 1 -- 172.21.15.47:0/3170569568 shutdown_connections 2024-04-01T22:34:06.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.698+0000 7f6f04ff9640 1 -- 172.21.15.47:0/3170569568 >> 172.21.15.47:0/3170569568 conn(0x7f6f10051290 msgr2=0x7f6f100cef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:06.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.698+0000 7f6f04ff9640 1 -- 172.21.15.47:0/3170569568 shutdown_connections 2024-04-01T22:34:06.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.698+0000 7f6f04ff9640 1 -- 172.21.15.47:0/3170569568 wait complete. 2024-04-01T22:34:06.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.697+0000 7f1276020640 1 --2- 172.21.15.47:0/3533635396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12700c7180 0x7f1270144cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.700+0000 7f1276821640 1 -- 172.21.15.47:0/3533635396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12700c7180 msgr2=0x7f1270144cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.700+0000 7f1276821640 1 --2- 172.21.15.47:0/3533635396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12700c7180 0x7f1270144cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.702+0000 7f1276821640 1 -- 172.21.15.47:0/3533635396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12700c76d0 msgr2=0x7f1270145200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.702+0000 7f1276821640 1 --2- 172.21.15.47:0/3533635396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12700c76d0 0x7f1270145200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.702+0000 7f1276821640 1 -- 172.21.15.47:0/3533635396 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1270143c90 con 0x7f1270150a50 2024-04-01T22:34:06.716 INFO:teuthology.orchestra.run.smithi047.stdout:55834574862 2024-04-01T22:34:06.716 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-01T22:34:06.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.708+0000 7f1276821640 1 --2- 172.21.15.47:0/3533635396 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1270150a50 0x7f12701f80b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f126c00c3c0 tx=0x7f126c00c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:06.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.715+0000 7f1266ffd640 1 -- 172.21.15.47:0/3533635396 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126c017070 con 0x7f1270150a50 2024-04-01T22:34:06.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.715+0000 7f1278284640 1 -- 172.21.15.47:0/3533635396 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12700cb670 con 0x7f1270150a50 2024-04-01T22:34:06.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.715+0000 7f1278284640 1 -- 172.21.15.47:0/3533635396 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f12701441e0 con 0x7f1270150a50 2024-04-01T22:34:06.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.715+0000 7f1266ffd640 1 -- 172.21.15.47:0/3533635396 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f126c0035f0 con 0x7f1270150a50 2024-04-01T22:34:06.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.715+0000 7f1266ffd640 1 -- 172.21.15.47:0/3533635396 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126c0039e0 con 0x7f1270150a50 2024-04-01T22:34:06.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.718+0000 7f1278284640 1 -- 172.21.15.47:0/3533635396 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1258005290 con 0x7f1270150a50 2024-04-01T22:34:06.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.735+0000 7f1266ffd640 1 -- 172.21.15.47:0/3533635396 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f126c01a070 con 0x7f1270150a50 2024-04-01T22:34:06.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.736+0000 7f1266ffd640 1 --2- 172.21.15.47:0/3533635396 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f125406b9e0 0x7f125406dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.737+0000 7f1276020640 1 --2- 172.21.15.47:0/3533635396 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f125406b9e0 0x7f125406dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.737+0000 7f1276020640 1 --2- 172.21.15.47:0/3533635396 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f125406b9e0 0x7f125406dea0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1268011200 tx=0x7f126800d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:06.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.744+0000 7fa7e8a4e640 1 Processor -- start 2024-04-01T22:34:06.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.744+0000 7fa7e8a4e640 1 -- start start 2024-04-01T22:34:06.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.745+0000 7fa7e8a4e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa7dc0dd3f0 0x7fa7dc046490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.745+0000 7fa7e8a4e640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa7dc0e37d0 0x7fa7dc04beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.745+0000 7fa7e8a4e640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7dc0dd7d0 con 0x7fa7dc04ba90 2024-04-01T22:34:06.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.745+0000 7fa7e8a4e640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fa7dc045480 con 0x7fa7dc0dd3f0 2024-04-01T22:34:06.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.745+0000 7fa7e8a4e640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fa7dc046000 con 0x7fa7dc0e37d0 2024-04-01T22:34:06.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.747+0000 7fa7e259c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa7dc0dd3f0 0x7fa7dc046490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.747+0000 7fa7e1d9b640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fa7dc04ba90 0x7fa7dc0e30c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.47:49542/0 (socket says 172.21.15.47:49542) 2024-04-01T22:34:06.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.747+0000 7fa7e1d9b640 1 -- 172.21.15.47:0/2596842326 learned_addr learned my addr 172.21.15.47:0/2596842326 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T22:34:06.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.751+0000 7fa7e159a640 1 -- 172.21.15.47:0/2596842326 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3539280289 0 0) 0x7fa7d4001110 con 0x7fa7dc04ba90 2024-04-01T22:34:06.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.751+0000 7fa7e159a640 1 -- 172.21.15.47:0/2596842326 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7cc003520 con 0x7fa7dc04ba90 2024-04-01T22:34:06.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.752+0000 7fa7e2d9d640 1 --2- 172.21.15.47:0/2596842326 >> v2:172.21.15.181:3300/0 conn(0x7fa7dc0e37d0 0x7fa7dc04beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.752+0000 7fa7e259c640 1 -- 172.21.15.47:0/2596842326 >> v2:172.21.15.181:3300/0 conn(0x7fa7dc0e37d0 msgr2=0x7fa7dc04beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:06.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.752+0000 7fa7e259c640 1 --2- 172.21.15.47:0/2596842326 >> v2:172.21.15.181:3300/0 conn(0x7fa7dc0e37d0 0x7fa7dc04beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.752+0000 7fa7e259c640 1 -- 172.21.15.47:0/2596842326 >> v1:172.21.15.181:6789/0 conn(0x7fa7dc04ba90 legacy=0x7fa7dc0e30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.753+0000 7fa7e259c640 1 -- 172.21.15.47:0/2596842326 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7dc0e3c00 con 0x7fa7dc0dd3f0 2024-04-01T22:34:06.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.754+0000 7fbed897f640 1 Processor -- start 2024-04-01T22:34:06.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.754+0000 7fbed897f640 1 -- start start 2024-04-01T22:34:06.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.754+0000 7f2cbb53f640 1 Processor -- start 2024-04-01T22:34:06.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.755+0000 7fbed897f640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbecc04d340 0x7fbecc0dc710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.755+0000 7fbed897f640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbecc007e80 con 0x7fbecc04c430 2024-04-01T22:34:06.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.755+0000 7fbed897f640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbecc008160 con 0x7fbecc0d2ba0 2024-04-01T22:34:06.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.755+0000 7fbed897f640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fbecc007c30 con 0x7fbecc04d340 2024-04-01T22:34:06.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.754+0000 7f2cbb53f640 1 -- start start 2024-04-01T22:34:06.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.756+0000 7f2cbb53f640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2cb4158840 0x7f2cb40c6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.756+0000 7f2cbb53f640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2cb40c6ca0 0x7f2cb40c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.756+0000 7f2cbb53f640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2cb40c8260 0x7f2cb415fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.756+0000 7fa7e259c640 1 --2- 172.21.15.47:0/2596842326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7dc0dd3f0 0x7fa7dc046490 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4062d10 tx=0x7fa7e40a7640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0e865176eeaafe3 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:06.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.756+0000 7f2cbb53f640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f2cb4161a90 con 0x7f2cb4158840 2024-04-01T22:34:06.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.756+0000 7f2cbb53f640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f2cb415f990 con 0x7f2cb40c6ca0 2024-04-01T22:34:06.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.756+0000 7f2cbb53f640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f2cb4161ce0 con 0x7f2cb40c8260 2024-04-01T22:34:06.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.758+0000 7f2cb9d3c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2cb40c6ca0 0x7f2cb40c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.758+0000 7f2cb9d3c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2cb40c6ca0 0x7f2cb40c7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:44840/0 (socket says 172.21.15.47:44840) 2024-04-01T22:34:06.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.758+0000 7f2cb9d3c640 1 -- 172.21.15.47:0/1816388456 learned_addr learned my addr 172.21.15.47:0/1816388456 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:06.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.758+0000 7f2cba53d640 1 --2- 172.21.15.47:0/1816388456 >> v2:172.21.15.47:3300/0 conn(0x7f2cb4158840 0x7f2cb40c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.758+0000 7fbed259c640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fbecc04c430 0x7fbecc04cc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:56360/0 (socket says 172.21.15.47:56360) 2024-04-01T22:34:06.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.759+0000 7fbed259c640 1 -- 172.21.15.47:0/1852986228 learned_addr learned my addr 172.21.15.47:0/1852986228 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T22:34:06.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.761+0000 7f2cb9d3c640 1 -- 172.21.15.47:0/1816388456 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2cb40c8260 msgr2=0x7f2cb415fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:06.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.761+0000 7f2cb9d3c640 1 --2- 172.21.15.47:0/1816388456 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2cb40c8260 0x7f2cb415fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.761+0000 7f2cb9d3c640 1 -- 172.21.15.47:0/1816388456 >> v2:172.21.15.47:3300/0 conn(0x7f2cb4158840 msgr2=0x7f2cb40c6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:06.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.761+0000 7f2cb9d3c640 1 --2- 172.21.15.47:0/1816388456 >> v2:172.21.15.47:3300/0 conn(0x7f2cb4158840 0x7f2cb40c6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.761+0000 7f2cb9d3c640 1 -- 172.21.15.47:0/1816388456 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb4161fc0 con 0x7f2cb40c6ca0 2024-04-01T22:34:06.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.764+0000 7fbed1d9b640 1 -- 172.21.15.47:0/1852986228 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3302372927 0 0) 0x7fbecc008160 con 0x7fbecc0d2ba0 2024-04-01T22:34:06.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.764+0000 7fbed1d9b640 1 -- 172.21.15.47:0/1852986228 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbebc003520 con 0x7fbecc0d2ba0 2024-04-01T22:34:06.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.765+0000 7fa7e159a640 1 -- 172.21.15.47:0/2596842326 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e40ac7d0 con 0x7fa7dc0dd3f0 2024-04-01T22:34:06.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.768+0000 7f2cb9d3c640 1 --2- 172.21.15.47:0/1816388456 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2cb40c6ca0 0x7f2cb40c7d20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2cb406bfb0 tx=0x7f2cb002b9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8bfb6cfd9f7594e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:06.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.768+0000 7fbed1d9b640 1 -- 172.21.15.47:0/1852986228 <== mon.1 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1051106517 0 0) 0x7fbebc003520 con 0x7fbecc0d2ba0 2024-04-01T22:34:06.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.768+0000 7fbed1d9b640 1 -- 172.21.15.47:0/1852986228 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbecc04d340 msgr2=0x7fbecc0dc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:06.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.768+0000 7fbed1d9b640 1 --2- 172.21.15.47:0/1852986228 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbecc04d340 0x7fbecc0dc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.768+0000 7fbed1d9b640 1 -- 172.21.15.47:0/1852986228 >> v1:172.21.15.47:6789/0 conn(0x7fbecc04c430 legacy=0x7fbecc04cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.768+0000 7fbed1d9b640 1 -- 172.21.15.47:0/1852986228 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbecc008440 con 0x7fbecc0d2ba0 2024-04-01T22:34:06.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.769+0000 7fbed1d9b640 1 -- 172.21.15.47:0/1852986228 <== mon.1 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3952983659 0 0) 0x7fbec8001670 con 0x7fbecc0d2ba0 2024-04-01T22:34:06.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.769+0000 7fbed1d9b640 1 -- 172.21.15.47:0/1852986228 >> v1:172.21.15.181:6789/0 conn(0x7fbecc0d2ba0 legacy=0x7fbecc04e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.769+0000 7fbed1d9b640 1 --2- 172.21.15.47:0/1852986228 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbebc0039b0 0x7fbebc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.769+0000 7fbed1d9b640 1 --2- 172.21.15.47:0/1852986228 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbecc04d340 0x7fbebc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.769+0000 7fbed1d9b640 1 --2- 172.21.15.47:0/1852986228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbebc004e60 0x7fbebc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.769+0000 7fbed1d9b640 1 -- 172.21.15.47:0/1852986228 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbecc007c30 con 0x7fbebc0039b0 2024-04-01T22:34:06.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.769+0000 7fbed1d9b640 1 -- 172.21.15.47:0/1852986228 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fbebc005510 con 0x7fbebc004e60 2024-04-01T22:34:06.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.769+0000 7fbed1d9b640 1 -- 172.21.15.47:0/1852986228 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fbebc00bf00 con 0x7fbecc04d340 2024-04-01T22:34:06.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.770+0000 7f65bd167640 1 Processor -- start 2024-04-01T22:34:06.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.770+0000 7f65bd167640 1 -- start start 2024-04-01T22:34:06.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.771+0000 7f65bd167640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f65b00dd4e0 0x7f65b0045570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.771+0000 7f65bd167640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65b00dd8c0 con 0x7f65b0045ab0 2024-04-01T22:34:06.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.771+0000 7f65bd167640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65b00e34e0 con 0x7f65b0046520 2024-04-01T22:34:06.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.771+0000 7f65bd167640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f65b00e4060 con 0x7f65b00dd4e0 2024-04-01T22:34:06.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.772+0000 7fbed359e640 1 --2- 172.21.15.47:0/1852986228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbebc004e60 0x7fbebc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.775+0000 7f2cb953b640 1 -- 172.21.15.47:0/1816388456 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb0034070 con 0x7f2cb40c6ca0 2024-04-01T22:34:06.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.775+0000 7f2cb953b640 1 -- 172.21.15.47:0/1816388456 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cb0030890 con 0x7f2cb40c6ca0 2024-04-01T22:34:06.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.775+0000 7f2cb953b640 1 -- 172.21.15.47:0/1816388456 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb0030ca0 con 0x7f2cb40c6ca0 2024-04-01T22:34:06.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.776+0000 7f2cbb53f640 1 -- 172.21.15.47:0/1816388456 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2cb40c6ca0 msgr2=0x7f2cb40c7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.776+0000 7f2cbb53f640 1 --2- 172.21.15.47:0/1816388456 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2cb40c6ca0 0x7f2cb40c7d20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2cb406bfb0 tx=0x7f2cb002b9d0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.776+0000 7f2cbb53f640 1 -- 172.21.15.47:0/1816388456 shutdown_connections 2024-04-01T22:34:06.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.776+0000 7f2cbb53f640 1 --2- 172.21.15.47:0/1816388456 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2cb40c8260 0x7f2cb415fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.776+0000 7f2cbb53f640 1 --2- 172.21.15.47:0/1816388456 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2cb40c6ca0 0x7f2cb40c7d20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.776+0000 7f2cbb53f640 1 --2- 172.21.15.47:0/1816388456 >> v2:172.21.15.47:3300/0 conn(0x7f2cb4158840 0x7f2cb40c6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.776+0000 7f2cbb53f640 1 -- 172.21.15.47:0/1816388456 >> 172.21.15.47:0/1816388456 conn(0x7f2cb406b110 msgr2=0x7f2cb406b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:06.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.776+0000 7f2cbb53f640 1 -- 172.21.15.47:0/1816388456 shutdown_connections 2024-04-01T22:34:06.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.776+0000 7fa7e159a640 1 -- 172.21.15.47:0/2596842326 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7e40ac970 con 0x7fa7dc0dd3f0 2024-04-01T22:34:06.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.776+0000 7fa7e159a640 1 -- 172.21.15.47:0/2596842326 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e40acde0 con 0x7fa7dc0dd3f0 2024-04-01T22:34:06.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.776+0000 7f2cbb53f640 1 -- 172.21.15.47:0/1816388456 wait complete. 2024-04-01T22:34:06.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.777+0000 7fa7e8a4e640 1 -- 172.21.15.47:0/2596842326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7dc0dd3f0 msgr2=0x7fa7dc046490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.777+0000 7fa7e8a4e640 1 --2- 172.21.15.47:0/2596842326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7dc0dd3f0 0x7fa7dc046490 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4062d10 tx=0x7fa7e40a7640 comp rx=0 tx=0).stop 2024-04-01T22:34:06.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.778+0000 7fa7e8a4e640 1 -- 172.21.15.47:0/2596842326 shutdown_connections 2024-04-01T22:34:06.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.778+0000 7fa7e8a4e640 1 --2- 172.21.15.47:0/2596842326 >> v2:172.21.15.181:3300/0 conn(0x7fa7dc0e37d0 0x7fa7dc04beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.778+0000 7fa7e8a4e640 1 --2- 172.21.15.47:0/2596842326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7dc0dd3f0 0x7fa7dc046490 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.778+0000 7fa7e8a4e640 1 -- 172.21.15.47:0/2596842326 >> 172.21.15.47:0/2596842326 conn(0x7fa7dc0501b0 msgr2=0x7fa7dc0505c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:06.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.778+0000 7fa7e8a4e640 1 -- 172.21.15.47:0/2596842326 shutdown_connections 2024-04-01T22:34:06.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.778+0000 7f65b77fe640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f65b0045ab0 0x7f65b004beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:56370/0 (socket says 172.21.15.47:56370) 2024-04-01T22:34:06.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.778+0000 7f65b77fe640 1 -- 172.21.15.47:0/1779968076 learned_addr learned my addr 172.21.15.47:0/1779968076 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T22:34:06.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.778+0000 7f2cbb53f640 1 Processor -- start 2024-04-01T22:34:06.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.778+0000 7fbed359e640 1 -- 172.21.15.47:0/1852986228 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbecc04d340 msgr2=0x7fbebc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:06.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.778+0000 7fbed359e640 1 --2- 172.21.15.47:0/1852986228 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbecc04d340 0x7fbebc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.778+0000 7fbed359e640 1 -- 172.21.15.47:0/1852986228 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbebc0039b0 msgr2=0x7fbebc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:06.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.778+0000 7fbed359e640 1 --2- 172.21.15.47:0/1852986228 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbebc0039b0 0x7fbebc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.778+0000 7fbed359e640 1 -- 172.21.15.47:0/1852986228 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbebc003520 con 0x7fbebc004e60 2024-04-01T22:34:06.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.779+0000 7f2cbb53f640 1 -- start start 2024-04-01T22:34:06.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.778+0000 7fa7e8a4e640 1 -- 172.21.15.47:0/2596842326 wait complete. 2024-04-01T22:34:06.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.780+0000 7fa7e8a4e640 1 Processor -- start 2024-04-01T22:34:06.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.780+0000 7fa7e8a4e640 1 -- start start 2024-04-01T22:34:06.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.780+0000 7f2cbb53f640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2cb40c6ca0 0x7f2cb41f4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.780+0000 7f2cbb53f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2cb40c8260 0x7f2cb4151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.780+0000 7f2cbb53f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2cb4158840 0x7f2cb4152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.780+0000 7f2cbb53f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb4162860 con 0x7f2cb40c8260 2024-04-01T22:34:06.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.780+0000 7f2cbb53f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb4162580 con 0x7f2cb4158840 2024-04-01T22:34:06.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.780+0000 7f2cbb53f640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f2cb415f270 con 0x7f2cb40c6ca0 2024-04-01T22:34:06.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.781+0000 7fa7e8a4e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa7dc04ba90 0x7fa7dc0c4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.781+0000 7fa7e8a4e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7dc0dd3f0 0x7fa7dc0e0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.781+0000 7fa7e8a4e640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa7dc0e37d0 0x7fa7dc0c7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.781+0000 7fa7e8a4e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa7dc0459b0 con 0x7fa7dc0dd3f0 2024-04-01T22:34:06.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.781+0000 7fa7e8a4e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa7dc0456d0 con 0x7fa7dc04ba90 2024-04-01T22:34:06.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.781+0000 7fa7e8a4e640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fa7dc045c90 con 0x7fa7dc0e37d0 2024-04-01T22:34:06.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.781+0000 7f2cbad3e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2cb4158840 0x7f2cb4152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.783+0000 7fa7e1d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7dc0dd3f0 0x7fa7dc0e0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.783+0000 7f2cbad3e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2cb4158840 0x7f2cb4152110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:44854/0 (socket says 172.21.15.47:44854) 2024-04-01T22:34:06.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.783+0000 7f2cbad3e640 1 -- 172.21.15.47:0/559211120 learned_addr learned my addr 172.21.15.47:0/559211120 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:06.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.784+0000 7fa7e259c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa7dc04ba90 0x7fa7dc0c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.784+0000 7fa7e259c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa7dc04ba90 0x7fa7dc0c4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:44868/0 (socket says 172.21.15.47:44868) 2024-04-01T22:34:06.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.784+0000 7fa7e259c640 1 -- 172.21.15.47:0/1918341955 learned_addr learned my addr 172.21.15.47:0/1918341955 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:06.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.785+0000 7fd7cf167640 1 Processor -- start 2024-04-01T22:34:06.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.785+0000 7fd7cf167640 1 -- start start 2024-04-01T22:34:06.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.786+0000 7f65b6ffd640 1 -- 172.21.15.47:0/1779968076 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4119300368 0 0) 0x7f65a4001110 con 0x7f65b0045ab0 2024-04-01T22:34:06.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.786+0000 7f65b6ffd640 1 -- 172.21.15.47:0/1779968076 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65a8003520 con 0x7f65b0045ab0 2024-04-01T22:34:06.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.786+0000 7fbed359e640 1 --2- 172.21.15.47:0/1852986228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbebc004e60 0x7fbebc00b9c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbec4009860 tx=0x7fbebc005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1031351b5c66beb6 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:06.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.786+0000 7fd7cf167640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd7c0006270 0x7fd7c0006690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.786+0000 7fd7cf167640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd7c00e6690 0x7fd7c00e6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.786+0000 7fd7cf167640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7c00dd840 con 0x7fd7c00dd460 2024-04-01T22:34:06.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.786+0000 7fd7cf167640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fd7c004ba90 con 0x7fd7c0006270 2024-04-01T22:34:06.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.786+0000 7fd7cf167640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fd7c00e7600 con 0x7fd7c00e6690 2024-04-01T22:34:06.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.788+0000 7f2cb9d3c640 1 --2- 172.21.15.47:0/559211120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2cb40c8260 0x7f2cb4151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.790+0000 7f2cbad3e640 1 -- 172.21.15.47:0/559211120 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2cb40c6ca0 msgr2=0x7f2cb41f4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.790+0000 7f2cbad3e640 1 --2- 172.21.15.47:0/559211120 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2cb40c6ca0 0x7f2cb41f4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.790+0000 7f2cbad3e640 1 -- 172.21.15.47:0/559211120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2cb40c8260 msgr2=0x7f2cb4151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.790+0000 7f2cbad3e640 1 --2- 172.21.15.47:0/559211120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2cb40c8260 0x7f2cb4151bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.790+0000 7f2cbad3e640 1 -- 172.21.15.47:0/559211120 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb41f3e60 con 0x7f2cb4158840 2024-04-01T22:34:06.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.791+0000 7fa7e1d9b640 1 -- 172.21.15.47:0/1918341955 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa7dc0e37d0 msgr2=0x7fa7dc0c7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.791+0000 7fa7e1d9b640 1 --2- 172.21.15.47:0/1918341955 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa7dc0e37d0 0x7fa7dc0c7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.791+0000 7fa7e1d9b640 1 -- 172.21.15.47:0/1918341955 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa7dc04ba90 msgr2=0x7fa7dc0c4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.791+0000 7fa7e1d9b640 1 --2- 172.21.15.47:0/1918341955 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa7dc04ba90 0x7fa7dc0c4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.791+0000 7fa7e1d9b640 1 -- 172.21.15.47:0/1918341955 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7dc0de010 con 0x7fa7dc0dd3f0 2024-04-01T22:34:06.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.792+0000 7f65b6ffd640 1 -- 172.21.15.47:0/1779968076 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1127503743 0 0) 0x7f65b00e34e0 con 0x7f65b0046520 2024-04-01T22:34:06.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.792+0000 7f65b6ffd640 1 -- 172.21.15.47:0/1779968076 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65a8003880 con 0x7f65b0046520 2024-04-01T22:34:06.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.796+0000 7f65b6ffd640 1 -- 172.21.15.47:0/1779968076 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3717037520 0 0) 0x7f65a8003520 con 0x7f65b0045ab0 2024-04-01T22:34:06.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.796+0000 7f65b6ffd640 1 -- 172.21.15.47:0/1779968076 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f65b00dd4e0 msgr2=0x7f65b0045570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:06.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.796+0000 7f65b6ffd640 1 --2- 172.21.15.47:0/1779968076 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f65b00dd4e0 0x7f65b0045570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.796+0000 7f65b6ffd640 1 -- 172.21.15.47:0/1779968076 >> v1:172.21.15.181:6789/0 conn(0x7f65b0046520 legacy=0x7f65b0046970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.796+0000 7f65b6ffd640 1 -- 172.21.15.47:0/1779968076 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65b00e37c0 con 0x7f65b0045ab0 2024-04-01T22:34:06.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.796+0000 7f65b6ffd640 1 -- 172.21.15.47:0/1779968076 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3952983659 0 0) 0x7f65a4001820 con 0x7f65b0045ab0 2024-04-01T22:34:06.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.797+0000 7f65b6ffd640 1 -- 172.21.15.47:0/1779968076 >> v1:172.21.15.47:6789/0 conn(0x7f65b0045ab0 legacy=0x7f65b004beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.797+0000 7f65b6ffd640 1 --2- 172.21.15.47:0/1779968076 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f65b00dd4e0 0x7f65a8003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.797+0000 7f65b6ffd640 1 --2- 172.21.15.47:0/1779968076 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65a80042e0 0x7f65a8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.797+0000 7f65b6ffd640 1 --2- 172.21.15.47:0/1779968076 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f65a8004f90 0x7f65a800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.797+0000 7f65b6ffd640 1 -- 172.21.15.47:0/1779968076 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f65b00e4060 con 0x7f65a80042e0 2024-04-01T22:34:06.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.797+0000 7f65b6ffd640 1 -- 172.21.15.47:0/1779968076 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f65a800bf00 con 0x7f65a8004f90 2024-04-01T22:34:06.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.797+0000 7f65b6ffd640 1 -- 172.21.15.47:0/1779968076 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f65a800c080 con 0x7f65b00dd4e0 2024-04-01T22:34:06.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.798+0000 7f2cbad3e640 1 --2- 172.21.15.47:0/559211120 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2cb4158840 0x7f2cb4152110 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2cac00b9a0 tx=0x7f2cac00be60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:06.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.800+0000 7fa7e1d9b640 1 --2- 172.21.15.47:0/1918341955 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7dc0dd3f0 0x7fa7dc0e0330 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa7d400c3c0 tx=0x7fa7d400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:06.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.800+0000 7f64f6b7a640 1 Processor -- start 2024-04-01T22:34:06.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.800+0000 7f64f6b7a640 1 -- start start 2024-04-01T22:34:06.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.800+0000 7fbed1d9b640 1 -- 172.21.15.47:0/1852986228 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec4009460 con 0x7fbebc004e60 2024-04-01T22:34:06.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.800+0000 7fbed1d9b640 1 -- 172.21.15.47:0/1852986228 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec4031660 con 0x7fbebc004e60 2024-04-01T22:34:06.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.800+0000 7fbed1d9b640 1 -- 172.21.15.47:0/1852986228 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec4031a90 con 0x7fbebc004e60 2024-04-01T22:34:06.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.801+0000 7f64f6b7a640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f64f01546d0 0x7f64f00727a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.801+0000 7f64f6b7a640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f64f00b11e0 0x7f64f006bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.801+0000 7fbed897f640 1 -- 172.21.15.47:0/1852986228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbebc004e60 msgr2=0x7fbebc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.801+0000 7fbed897f640 1 --2- 172.21.15.47:0/1852986228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbebc004e60 0x7fbebc00b9c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbec4009860 tx=0x7fbebc005830 comp rx=0 tx=0).stop 2024-04-01T22:34:06.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.801+0000 7fbed359e640 1 -- 172.21.15.47:0/1852986228 reap_dead start 2024-04-01T22:34:06.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.801+0000 7f64f6b7a640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64f015b150 con 0x7f64f015ad00 2024-04-01T22:34:06.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.801+0000 7f64f6b7a640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f64f0071df0 con 0x7f64f01546d0 2024-04-01T22:34:06.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.801+0000 7f64f6b7a640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f64f006b110 con 0x7f64f00b11e0 2024-04-01T22:34:06.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.801+0000 7fbed897f640 1 -- 172.21.15.47:0/1852986228 shutdown_connections 2024-04-01T22:34:06.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.801+0000 7fbed897f640 1 -- 172.21.15.47:0/1852986228 >> 172.21.15.47:0/1852986228 conn(0x7fbecc00d180 msgr2=0x7fbecc00d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:06.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.801+0000 7fbed897f640 1 -- 172.21.15.47:0/1852986228 shutdown_connections 2024-04-01T22:34:06.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.801+0000 7fbed897f640 1 -- 172.21.15.47:0/1852986228 wait complete. 2024-04-01T22:34:06.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.803+0000 7fbed897f640 1 Processor -- start 2024-04-01T22:34:06.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.803+0000 7fbed897f640 1 -- start start 2024-04-01T22:34:06.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.804+0000 7fbed897f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbebc004e60 0x7fbecc0cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.804+0000 7fbed897f640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbecc0c9e50 0x7fbecc0c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.804+0000 7fbed897f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbecc0de1e0 0x7fbecc0cc970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.804+0000 7fbed897f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbecc04e7a0 con 0x7fbecc0de1e0 2024-04-01T22:34:06.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.804+0000 7fbed897f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fbecc008a90 con 0x7fbebc004e60 2024-04-01T22:34:06.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.804+0000 7fbed897f640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fbecc04e920 con 0x7fbecc0c9e50 2024-04-01T22:34:06.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.807+0000 7f2caaffd640 1 -- 172.21.15.47:0/559211120 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cac019070 con 0x7f2cb4158840 2024-04-01T22:34:06.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.807+0000 7f2caaffd640 1 -- 172.21.15.47:0/559211120 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cac00cbc0 con 0x7f2cb4158840 2024-04-01T22:34:06.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.807+0000 7f2caaffd640 1 -- 172.21.15.47:0/559211120 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cac014440 con 0x7f2cb4158840 2024-04-01T22:34:06.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.807+0000 7f2cbb53f640 1 -- 172.21.15.47:0/559211120 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cb41501a0 con 0x7f2cb4158840 2024-04-01T22:34:06.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.807+0000 7f2cbb53f640 1 -- 172.21.15.47:0/559211120 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cb41f4100 con 0x7f2cb4158840 2024-04-01T22:34:06.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.808+0000 7f2cbb53f640 1 -- 172.21.15.47:0/559211120 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cb4075770 con 0x7f2cb4158840 2024-04-01T22:34:06.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.809+0000 7f65b77fe640 1 --2- 172.21.15.47:0/1779968076 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65a80042e0 0x7f65a8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.809+0000 7fbed2d9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbebc004e60 0x7fbecc0cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.809+0000 7fa7d2ffd640 1 -- 172.21.15.47:0/1918341955 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d4017070 con 0x7fa7dc0dd3f0 2024-04-01T22:34:06.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.809+0000 7fa7d2ffd640 1 -- 172.21.15.47:0/1918341955 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7d4005ce0 con 0x7fa7dc0dd3f0 2024-04-01T22:34:06.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.809+0000 7fa7d2ffd640 1 -- 172.21.15.47:0/1918341955 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d40072f0 con 0x7fa7dc0dd3f0 2024-04-01T22:34:06.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.809+0000 7fa7e8a4e640 1 -- 172.21.15.47:0/1918341955 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7dc0df890 con 0x7fa7dc0dd3f0 2024-04-01T22:34:06.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.809+0000 7fa7e8a4e640 1 -- 172.21.15.47:0/1918341955 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7dc0c95c0 con 0x7fa7dc0dd3f0 2024-04-01T22:34:06.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.810+0000 7f64e7fff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f64f00b11e0 0x7f64f006bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.810+0000 7f65bc966640 1 --2- 172.21.15.47:0/1779968076 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f65a8004f90 0x7f65a800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.810+0000 7fbed2d9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbebc004e60 0x7fbecc0cb0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:44896/0 (socket says 172.21.15.47:44896) 2024-04-01T22:34:06.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.810+0000 7fbed2d9d640 1 -- 172.21.15.47:0/3214395332 learned_addr learned my addr 172.21.15.47:0/3214395332 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:06.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.810+0000 7f64e7fff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f64f00b11e0 0x7f64f006bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:44886/0 (socket says 172.21.15.47:44886) 2024-04-01T22:34:06.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.810+0000 7f64e7fff640 1 -- 172.21.15.47:0/3004554505 learned_addr learned my addr 172.21.15.47:0/3004554505 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:06.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.811+0000 7fa7e8a4e640 1 -- 172.21.15.47:0/1918341955 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7dc0053c0 con 0x7fa7dc0dd3f0 2024-04-01T22:34:06.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.812+0000 7f64f4916640 1 --2- 172.21.15.47:0/3004554505 >> v2:172.21.15.47:3300/0 conn(0x7f64f01546d0 0x7f64f00727a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.817+0000 7fbed2d9d640 1 -- 172.21.15.47:0/3214395332 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbecc0c9e50 msgr2=0x7fbecc0c9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.817+0000 7fbed2d9d640 1 --2- 172.21.15.47:0/3214395332 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbecc0c9e50 0x7fbecc0c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.817+0000 7fbed2d9d640 1 -- 172.21.15.47:0/3214395332 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbecc0de1e0 msgr2=0x7fbecc0cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:06.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.817+0000 7fbed2d9d640 1 --2- 172.21.15.47:0/3214395332 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbecc0de1e0 0x7fbecc0cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.817+0000 7fbed2d9d640 1 -- 172.21.15.47:0/3214395332 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbecc0ca380 con 0x7fbebc004e60 2024-04-01T22:34:06.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.833+0000 7f65b77fe640 1 -- 172.21.15.47:0/1779968076 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f65b00dd4e0 msgr2=0x7f65a8003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:06.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.833+0000 7f65b77fe640 1 --2- 172.21.15.47:0/1779968076 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f65b00dd4e0 0x7f65a8003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.833+0000 7f65b77fe640 1 -- 172.21.15.47:0/1779968076 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f65a8004f90 msgr2=0x7f65a800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:06.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.833+0000 7f65b77fe640 1 --2- 172.21.15.47:0/1779968076 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f65a8004f90 0x7f65a800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.833+0000 7f65b77fe640 1 -- 172.21.15.47:0/1779968076 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65a8003520 con 0x7f65a80042e0 2024-04-01T22:34:06.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.838+0000 7f64f4916640 1 -- 172.21.15.47:0/3004554505 >> v2:172.21.15.181:3300/0 conn(0x7f64f00b11e0 msgr2=0x7f64f006bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:06.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.838+0000 7f64f4916640 1 --2- 172.21.15.47:0/3004554505 >> v2:172.21.15.181:3300/0 conn(0x7f64f00b11e0 0x7f64f006bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:06.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.838+0000 7f64f4916640 1 -- 172.21.15.47:0/3004554505 >> v1:172.21.15.181:6789/0 conn(0x7f64f015ad00 legacy=0x7f64f00c69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:06.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.838+0000 7f64f4916640 1 -- 172.21.15.47:0/3004554505 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64f0072040 con 0x7f64f01546d0 2024-04-01T22:34:06.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.841+0000 7f65b77fe640 1 --2- 172.21.15.47:0/1779968076 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65a80042e0 0x7f65a8004800 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f65a400c270 tx=0x7f65a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6c9908b7b3df382 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:06.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.841+0000 7f64f4916640 1 --2- 172.21.15.47:0/3004554505 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64f01546d0 0x7f64f00727a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f64f00ccfc0 tx=0x7f64ec02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8946b5eb5d8a70ee server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:06.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.841+0000 7fd7cd964640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd7c0006270 0x7fd7c0006690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:06.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.842+0000 7fd7cd964640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd7c0006270 0x7fd7c0006690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47938/0 (socket says 172.21.15.47:47938) 2024-04-01T22:34:06.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.842+0000 7fd7cd964640 1 -- 172.21.15.47:0/873318433 learned_addr learned my addr 172.21.15.47:0/873318433 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:06.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.854+0000 7f3a6eb48640 1 Processor -- start 2024-04-01T22:34:06.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.854+0000 7f3a6eb48640 1 -- start start 2024-04-01T22:34:06.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.854+0000 7f3a6eb48640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3a680c7240 0x7f3a680c28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.854+0000 7f3a6eb48640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3a680c7620 0x7f3a680cdf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.855+0000 7f3a6eb48640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3a680cee70 0x7f3a680ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:06.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.855+0000 7f3a6eb48640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f3a6815ee00 con 0x7f3a680c7620 2024-04-01T22:34:06.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.855+0000 7f3a6eb48640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f3a6815f0e0 con 0x7f3a680c7240 2024-04-01T22:34:06.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.855+0000 7f3a6eb48640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f3a6815f3c0 con 0x7f3a680cee70 2024-04-01T22:34:06.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.985+0000 7f1266ffd640 1 -- 172.21.15.47:0/3533635396 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f126c056660 con 0x7f1270150a50 2024-04-01T22:34:06.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:06.997+0000 7f1266ffd640 1 -- 172.21.15.47:0/3533635396 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f126c021020 con 0x7f1270150a50 2024-04-01T22:34:07.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.003+0000 7fd7ce966640 1 --2- 172.21.15.47:0/873318433 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd7c00e6690 0x7fd7c00e6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:07.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.007+0000 7f3a6d0e5640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3a680cee70 0x7f3a680ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:07.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.009+0000 7f3a6d0e5640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3a680cee70 0x7f3a680ce4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:39616/0 (socket says 172.21.15.47:39616) 2024-04-01T22:34:07.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.009+0000 7f3a6d0e5640 1 -- 172.21.15.47:0/3842281697 learned_addr learned my addr 172.21.15.47:0/3842281697 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:07.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.026+0000 7f3a6d0e5640 1 -- 172.21.15.47:0/3842281697 >> v2:172.21.15.181:3300/0 conn(0x7f3a680c7240 msgr2=0x7f3a680c28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:07.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.026+0000 7f3a6d0e5640 1 --2- 172.21.15.47:0/3842281697 >> v2:172.21.15.181:3300/0 conn(0x7f3a680c7240 0x7f3a680c28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.026+0000 7f3a6d0e5640 1 -- 172.21.15.47:0/3842281697 >> v2:172.21.15.47:3300/0 conn(0x7f3a680c7620 msgr2=0x7f3a680cdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:07.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.026+0000 7f3a6d0e5640 1 --2- 172.21.15.47:0/3842281697 >> v2:172.21.15.47:3300/0 conn(0x7f3a680c7620 0x7f3a680cdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.026+0000 7f3a6d0e5640 1 -- 172.21.15.47:0/3842281697 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a6815f6a0 con 0x7f3a680cee70 2024-04-01T22:34:07.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.030+0000 7fd7ce966640 1 -- 172.21.15.47:0/873318433 >> v2:172.21.15.47:3300/0 conn(0x7fd7c0006270 msgr2=0x7fd7c0006690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:07.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.030+0000 7fd7ce966640 1 --2- 172.21.15.47:0/873318433 >> v2:172.21.15.47:3300/0 conn(0x7fd7c0006270 0x7fd7c0006690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.030+0000 7fd7ce966640 1 -- 172.21.15.47:0/873318433 >> v1:172.21.15.47:6789/0 conn(0x7fd7c00dd460 legacy=0x7fd7c004b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:07.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.030+0000 7fd7ce966640 1 -- 172.21.15.47:0/873318433 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7c0007150 con 0x7fd7c00e6690 2024-04-01T22:34:07.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.031+0000 7f3a6d0e5640 1 --2- 172.21.15.47:0/3842281697 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3a680cee70 0x7f3a680ce4b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3a6808d1e0 tx=0x7f3a6002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1eb167d5a79ce88 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:07.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.038+0000 7fd7ce966640 1 --2- 172.21.15.47:0/873318433 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd7c00e6690 0x7fd7c00e6ae0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8062d10 tx=0x7fd7c80a7530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f2cc9bb2e2e06cd server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:07.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.040+0000 7f3a677fe640 1 -- 172.21.15.47:0/3842281697 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6002cb00 con 0x7f3a680cee70 2024-04-01T22:34:07.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.040+0000 7f3a677fe640 1 -- 172.21.15.47:0/3842281697 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a6002cca0 con 0x7f3a680cee70 2024-04-01T22:34:07.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.040+0000 7f3a677fe640 1 -- 172.21.15.47:0/3842281697 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a60034610 con 0x7f3a680cee70 2024-04-01T22:34:07.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.041+0000 7f3a6eb48640 1 -- 172.21.15.47:0/3842281697 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3a680cee70 msgr2=0x7f3a680ce4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:07.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.041+0000 7f3a6eb48640 1 --2- 172.21.15.47:0/3842281697 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3a680cee70 0x7f3a680ce4b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3a6808d1e0 tx=0x7f3a6002bf60 comp rx=0 tx=0).stop 2024-04-01T22:34:07.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.041+0000 7f3a6eb48640 1 -- 172.21.15.47:0/3842281697 shutdown_connections 2024-04-01T22:34:07.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.041+0000 7f3a6eb48640 1 --2- 172.21.15.47:0/3842281697 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3a680cee70 0x7f3a680ce4b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.041+0000 7f3a6eb48640 1 --2- 172.21.15.47:0/3842281697 >> v2:172.21.15.47:3300/0 conn(0x7f3a680c7620 0x7f3a680cdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.041+0000 7f3a6eb48640 1 --2- 172.21.15.47:0/3842281697 >> v2:172.21.15.181:3300/0 conn(0x7f3a680c7240 0x7f3a680c28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.041+0000 7f3a6eb48640 1 -- 172.21.15.47:0/3842281697 >> 172.21.15.47:0/3842281697 conn(0x7f3a680cfdb0 msgr2=0x7f3a680d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:07.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.041+0000 7f3a6eb48640 1 -- 172.21.15.47:0/3842281697 shutdown_connections 2024-04-01T22:34:07.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.041+0000 7f3a6eb48640 1 -- 172.21.15.47:0/3842281697 wait complete. 2024-04-01T22:34:07.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.042+0000 7fd7cd163640 1 -- 172.21.15.47:0/873318433 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c80ac7d0 con 0x7fd7c00e6690 2024-04-01T22:34:07.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.042+0000 7fd7cd163640 1 -- 172.21.15.47:0/873318433 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7c80ac970 con 0x7fd7c00e6690 2024-04-01T22:34:07.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.042+0000 7fd7cd163640 1 -- 172.21.15.47:0/873318433 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c80acde0 con 0x7fd7c00e6690 2024-04-01T22:34:07.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.042+0000 7f3a6eb48640 1 Processor -- start 2024-04-01T22:34:07.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.042+0000 7f3a6eb48640 1 -- start start 2024-04-01T22:34:07.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.043+0000 7fd7cf167640 1 -- 172.21.15.47:0/873318433 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd7c00e6690 msgr2=0x7fd7c00e6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:07.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.043+0000 7fd7cf167640 1 --2- 172.21.15.47:0/873318433 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd7c00e6690 0x7fd7c00e6ae0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8062d10 tx=0x7fd7c80a7530 comp rx=0 tx=0).stop 2024-04-01T22:34:07.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.043+0000 7fd7cf167640 1 -- 172.21.15.47:0/873318433 shutdown_connections 2024-04-01T22:34:07.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.043+0000 7fd7cf167640 1 --2- 172.21.15.47:0/873318433 >> v2:172.21.15.47:3300/0 conn(0x7fd7c0006270 0x7fd7c0006690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.043+0000 7fd7cf167640 1 --2- 172.21.15.47:0/873318433 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd7c00e6690 0x7fd7c00e6ae0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.043+0000 7fd7cf167640 1 -- 172.21.15.47:0/873318433 >> 172.21.15.47:0/873318433 conn(0x7fd7c0050a00 msgr2=0x7fd7c0050e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:07.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.043+0000 7fd7cf167640 1 -- 172.21.15.47:0/873318433 shutdown_connections 2024-04-01T22:34:07.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.043+0000 7fd7cf167640 1 -- 172.21.15.47:0/873318433 wait complete. 2024-04-01T22:34:07.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.043+0000 7f3a6eb48640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3a680c7240 0x7f3a680b5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:07.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.043+0000 7f3a6eb48640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a680c7620 0x7f3a680ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:07.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.043+0000 7f3a6eb48640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a680cee70 0x7f3a68161f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:07.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.044+0000 7f3a6eb48640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3a680cf430 con 0x7f3a680cee70 2024-04-01T22:34:07.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.044+0000 7f3a6eb48640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3a680cda50 con 0x7f3a680c7620 2024-04-01T22:34:07.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.044+0000 7f3a6eb48640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f3a680cf5b0 con 0x7f3a680c7240 2024-04-01T22:34:07.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.044+0000 7f3a6c8e4640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3a680c7240 0x7f3a680b5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:07.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.045+0000 7f3a6c8e4640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3a680c7240 0x7f3a680b5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:39632/0 (socket says 172.21.15.47:39632) 2024-04-01T22:34:07.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.045+0000 7f3a6c8e4640 1 -- 172.21.15.47:0/2822020056 learned_addr learned my addr 172.21.15.47:0/2822020056 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:07.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.045+0000 7fd7cf167640 1 Processor -- start 2024-04-01T22:34:07.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.045+0000 7fd7cf167640 1 -- start start 2024-04-01T22:34:07.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.046+0000 7fd7cf167640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7c0006270 0x7fd7c0035fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:07.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.046+0000 7fd7cf167640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd7c00dd460 0x7fd7c00d8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:07.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.046+0000 7fd7cf167640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7c00e6690 0x7fd7c00d93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:07.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.046+0000 7fd7cf167640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c0007710 con 0x7fd7c00e6690 2024-04-01T22:34:07.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.046+0000 7fd7cf167640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c0007d60 con 0x7fd7c0006270 2024-04-01T22:34:07.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.046+0000 7fd7cf167640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fd7c00079f0 con 0x7fd7c00dd460 2024-04-01T22:34:07.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.048+0000 7f3a6c8e4640 1 -- 172.21.15.47:0/2822020056 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a680c7620 msgr2=0x7f3a680ce1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:07.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.048+0000 7f3a6c8e4640 1 --2- 172.21.15.47:0/2822020056 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a680c7620 0x7f3a680ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.048+0000 7f3a6c8e4640 1 -- 172.21.15.47:0/2822020056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a680cee70 msgr2=0x7f3a68161f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:07.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.048+0000 7f3a6c8e4640 1 --2- 172.21.15.47:0/2822020056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a680cee70 0x7f3a68161f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.048+0000 7f3a6c8e4640 1 -- 172.21.15.47:0/2822020056 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a680b3940 con 0x7f3a680c7240 2024-04-01T22:34:07.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.050+0000 7f3a6c8e4640 1 --2- 172.21.15.47:0/2822020056 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3a680c7240 0x7f3a680b5300 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c00b4d0 tx=0x7f3a5c00b990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:07.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.053+0000 7fd7cd964640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd7c00dd460 0x7fd7c00d8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:07.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.054+0000 7f3a657fa640 1 -- 172.21.15.47:0/2822020056 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c014070 con 0x7f3a680c7240 2024-04-01T22:34:07.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.054+0000 7f3a657fa640 1 -- 172.21.15.47:0/2822020056 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a5c010870 con 0x7f3a680c7240 2024-04-01T22:34:07.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.054+0000 7f3a6eb48640 1 -- 172.21.15.47:0/2822020056 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a680b3c20 con 0x7f3a680c7240 2024-04-01T22:34:07.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.054+0000 7f3a657fa640 1 -- 172.21.15.47:0/2822020056 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c010c60 con 0x7f3a680c7240 2024-04-01T22:34:07.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.054+0000 7f3a6eb48640 1 -- 172.21.15.47:0/2822020056 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a680b41e0 con 0x7f3a680c7240 2024-04-01T22:34:07.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.054+0000 7fd7cd964640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd7c00dd460 0x7fd7c00d8e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:39644/0 (socket says 172.21.15.47:39644) 2024-04-01T22:34:07.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.054+0000 7fd7cd964640 1 -- 172.21.15.47:0/1313716060 learned_addr learned my addr 172.21.15.47:0/1313716060 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:07.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.055+0000 7f3a6eb48640 1 -- 172.21.15.47:0/2822020056 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a68068210 con 0x7f3a680c7240 2024-04-01T22:34:07.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.079+0000 7f3a657fa640 1 -- 172.21.15.47:0/2822020056 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f3a5c017070 con 0x7f3a680c7240 2024-04-01T22:34:07.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.079+0000 7f3a657fa640 1 --2- 172.21.15.47:0/2822020056 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f3a4c06b9e0 0x7f3a4c06dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:07.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.079+0000 7f3a67fff640 1 --2- 172.21.15.47:0/2822020056 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f3a4c06b9e0 0x7f3a4c06dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:07.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.080+0000 7f3a67fff640 1 --2- 172.21.15.47:0/2822020056 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f3a4c06b9e0 0x7f3a4c06dea0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3a680ceab0 tx=0x7f3a54006c90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:07.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.086+0000 7fd7cd964640 1 -- 172.21.15.47:0/1313716060 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7c0006270 msgr2=0x7fd7c0035fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:07.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.086+0000 7fd7cd964640 1 --2- 172.21.15.47:0/1313716060 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7c0006270 0x7fd7c0035fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.086+0000 7fd7cd964640 1 -- 172.21.15.47:0/1313716060 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7c00e6690 msgr2=0x7fd7c00d93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:07.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.086+0000 7fd7cd964640 1 --2- 172.21.15.47:0/1313716060 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7c00e6690 0x7fd7c00d93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.086+0000 7fd7cd964640 1 -- 172.21.15.47:0/1313716060 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7c0047df0 con 0x7fd7c00dd460 2024-04-01T22:34:07.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.089+0000 7f2caaffd640 1 -- 172.21.15.47:0/559211120 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f2cac01c070 con 0x7f2cb4158840 2024-04-01T22:34:07.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.089+0000 7f2caaffd640 1 --2- 172.21.15.47:0/559211120 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f2c9806b9e0 0x7f2c9806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:07.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.090+0000 7f2cba53d640 1 --2- 172.21.15.47:0/559211120 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f2c9806b9e0 0x7f2c9806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:07.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.090+0000 7f2cba53d640 1 --2- 172.21.15.47:0/559211120 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f2c9806b9e0 0x7f2c9806dea0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4006a90 tx=0x7f2ca4006a20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:07.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.092+0000 7f2caaffd640 1 -- 172.21.15.47:0/559211120 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f2cac056fd0 con 0x7f2cb4158840 2024-04-01T22:34:07.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.103+0000 7f64e77fe640 1 -- 172.21.15.47:0/3004554505 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ec039070 con 0x7f64f01546d0 2024-04-01T22:34:07.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.103+0000 7f64e77fe640 1 -- 172.21.15.47:0/3004554505 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64ec02cbf0 con 0x7f64f01546d0 2024-04-01T22:34:07.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.103+0000 7f64e77fe640 1 -- 172.21.15.47:0/3004554505 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ec034440 con 0x7f64f01546d0 2024-04-01T22:34:07.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.104+0000 7f64f6b7a640 1 -- 172.21.15.47:0/3004554505 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64f01546d0 msgr2=0x7f64f00727a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:07.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.104+0000 7f64f6b7a640 1 --2- 172.21.15.47:0/3004554505 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64f01546d0 0x7f64f00727a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f64f00ccfc0 tx=0x7f64ec02be40 comp rx=0 tx=0).stop 2024-04-01T22:34:07.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.104+0000 7f64f6b7a640 1 -- 172.21.15.47:0/3004554505 shutdown_connections 2024-04-01T22:34:07.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.104+0000 7f64f6b7a640 1 --2- 172.21.15.47:0/3004554505 >> v2:172.21.15.181:3300/0 conn(0x7f64f00b11e0 0x7f64f006bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.104+0000 7f64f6b7a640 1 --2- 172.21.15.47:0/3004554505 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64f01546d0 0x7f64f00727a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.104+0000 7f64f6b7a640 1 -- 172.21.15.47:0/3004554505 >> 172.21.15.47:0/3004554505 conn(0x7f64f00cbff0 msgr2=0x7f64f00cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:07.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.104+0000 7f64f6b7a640 1 -- 172.21.15.47:0/3004554505 shutdown_connections 2024-04-01T22:34:07.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.104+0000 7f64f6b7a640 1 -- 172.21.15.47:0/3004554505 wait complete. 2024-04-01T22:34:07.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.105+0000 7f2caaffd640 1 -- 172.21.15.47:0/559211120 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f2cac023020 con 0x7f2cb4158840 2024-04-01T22:34:07.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.106+0000 7f64f6b7a640 1 Processor -- start 2024-04-01T22:34:07.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.106+0000 7f64f6b7a640 1 -- start start 2024-04-01T22:34:07.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.107+0000 7f64f6b7a640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f64f00b11e0 0x7f64f01592a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:07.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.107+0000 7f64f6b7a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64f01546d0 0x7f64f00c1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:07.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.107+0000 7f64f6b7a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f64f015ad00 0x7f64f01e45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:07.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.107+0000 7f64f6b7a640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f64f006b6b0 con 0x7f64f01546d0 2024-04-01T22:34:07.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.107+0000 7f64f6b7a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f64f006b3d0 con 0x7f64f015ad00 2024-04-01T22:34:07.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.107+0000 7f64f6b7a640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f64f00c7100 con 0x7f64f00b11e0 2024-04-01T22:34:07.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.108+0000 7fbed2d9d640 1 --2- 172.21.15.47:0/3214395332 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbebc004e60 0x7fbecc0cb0d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbec800c760 tx=0x7fbec800cb60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:07.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.114+0000 7f64f5117640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f64f015ad00 0x7f64f01e45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:07.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.116+0000 7f64f5117640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f64f015ad00 0x7f64f01e45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:44944/0 (socket says 172.21.15.47:44944) 2024-04-01T22:34:07.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.117+0000 7f64f5117640 1 -- 172.21.15.47:0/2773752189 learned_addr learned my addr 172.21.15.47:0/2773752189 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:07.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.117+0000 7fbebb7fe640 1 -- 172.21.15.47:0/3214395332 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec8017070 con 0x7fbebc004e60 2024-04-01T22:34:07.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.117+0000 7fbebb7fe640 1 -- 172.21.15.47:0/3214395332 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec8005270 con 0x7fbebc004e60 2024-04-01T22:34:07.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.117+0000 7fbed897f640 1 -- 172.21.15.47:0/3214395332 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbecc1714e0 con 0x7fbebc004e60 2024-04-01T22:34:07.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.117+0000 7fbed897f640 1 -- 172.21.15.47:0/3214395332 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbecc0ca5f0 con 0x7fbebc004e60 2024-04-01T22:34:07.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.118+0000 7fbebb7fe640 1 -- 172.21.15.47:0/3214395332 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec8003830 con 0x7fbebc004e60 2024-04-01T22:34:07.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.119+0000 7fbed897f640 1 -- 172.21.15.47:0/3214395332 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbecc0057d0 con 0x7fbebc004e60 2024-04-01T22:34:07.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.121+0000 7f64f5117640 1 -- 172.21.15.47:0/2773752189 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f64f00b11e0 msgr2=0x7f64f01592a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:07.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.121+0000 7f64f5117640 1 --2- 172.21.15.47:0/2773752189 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f64f00b11e0 0x7f64f01592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.121+0000 7f64f5117640 1 -- 172.21.15.47:0/2773752189 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64f01546d0 msgr2=0x7f64f00c1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:07.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.121+0000 7f64f5117640 1 --2- 172.21.15.47:0/2773752189 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64f01546d0 0x7f64f00c1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.121+0000 7f64f5117640 1 -- 172.21.15.47:0/2773752189 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64f01599e0 con 0x7f64f015ad00 2024-04-01T22:34:07.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.124+0000 7fa7d2ffd640 1 -- 172.21.15.47:0/1918341955 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7fa7d401a070 con 0x7fa7dc0dd3f0 2024-04-01T22:34:07.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.124+0000 7fa7d2ffd640 1 --2- 172.21.15.47:0/1918341955 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fa7c406b9e0 0x7fa7c406dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:07.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.125+0000 7fa7e259c640 1 --2- 172.21.15.47:0/1918341955 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fa7c406b9e0 0x7fa7c406dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:07.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.125+0000 7fa7e259c640 1 --2- 172.21.15.47:0/1918341955 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fa7c406b9e0 0x7fa7c406dea0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4069390 tx=0x7fa7e40ac000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:07.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.155+0000 7fa7d2ffd640 1 -- 172.21.15.47:0/1918341955 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fa7d4056600 con 0x7fa7dc0dd3f0 2024-04-01T22:34:07.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.155+0000 7fa7d2ffd640 1 -- 172.21.15.47:0/1918341955 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fa7d4021020 con 0x7fa7dc0dd3f0 2024-04-01T22:34:07.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.159+0000 7f65b6ffd640 1 -- 172.21.15.47:0/1779968076 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a4007db0 con 0x7f65a80042e0 2024-04-01T22:34:07.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.159+0000 7f65b6ffd640 1 -- 172.21.15.47:0/1779968076 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65a4030030 con 0x7f65a80042e0 2024-04-01T22:34:07.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.159+0000 7f65b6ffd640 1 -- 172.21.15.47:0/1779968076 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a402cda0 con 0x7f65a80042e0 2024-04-01T22:34:07.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.160+0000 7f65bd167640 1 -- 172.21.15.47:0/1779968076 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65a80042e0 msgr2=0x7f65a8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:07.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.160+0000 7f65bd167640 1 --2- 172.21.15.47:0/1779968076 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65a80042e0 0x7f65a8004800 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f65a400c270 tx=0x7f65a8005830 comp rx=0 tx=0).stop 2024-04-01T22:34:07.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.160+0000 7f65bc966640 1 -- 172.21.15.47:0/1779968076 reap_dead start 2024-04-01T22:34:07.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.160+0000 7f65bd167640 1 -- 172.21.15.47:0/1779968076 shutdown_connections 2024-04-01T22:34:07.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.160+0000 7f65bd167640 1 -- 172.21.15.47:0/1779968076 >> 172.21.15.47:0/1779968076 conn(0x7f65b00505d0 msgr2=0x7f65b00509e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:07.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.160+0000 7f65bd167640 1 -- 172.21.15.47:0/1779968076 shutdown_connections 2024-04-01T22:34:07.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.160+0000 7f65bd167640 1 -- 172.21.15.47:0/1779968076 wait complete. 2024-04-01T22:34:07.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.162+0000 7f65bd167640 1 Processor -- start 2024-04-01T22:34:07.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.163+0000 7f65bd167640 1 -- start start 2024-04-01T22:34:07.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.164+0000 7f65bd167640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f65b0006670 0x7f65b00d5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:07.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.164+0000 7f65bd167640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65b0006a50 0x7f65b00d3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:07.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.164+0000 7f65bd167640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f65b00da0b0 0x7f65b00d3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:07.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.164+0000 7f65bd167640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f65b0046000 con 0x7f65b0006a50 2024-04-01T22:34:07.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.164+0000 7f65bd167640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f65b00e3d80 con 0x7f65b00da0b0 2024-04-01T22:34:07.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.164+0000 7f65bd167640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f65b00e3130 con 0x7f65b0006670 2024-04-01T22:34:07.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.192+0000 7f65b77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65b0006a50 0x7f65b00d3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:07.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.193+0000 7f65b77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65b0006a50 0x7f65b00d3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48018/0 (socket says 172.21.15.47:48018) 2024-04-01T22:34:07.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.193+0000 7f65b77fe640 1 -- 172.21.15.47:0/2258385609 learned_addr learned my addr 172.21.15.47:0/2258385609 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:07.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.198+0000 7f65b77fe640 1 -- 172.21.15.47:0/2258385609 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f65b0006670 msgr2=0x7f65b00d5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:07.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.198+0000 7f65b77fe640 1 --2- 172.21.15.47:0/2258385609 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f65b0006670 0x7f65b00d5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.198+0000 7f65b77fe640 1 -- 172.21.15.47:0/2258385609 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f65b00da0b0 msgr2=0x7f65b00d3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:07.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.198+0000 7f65b77fe640 1 --2- 172.21.15.47:0/2258385609 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f65b00da0b0 0x7f65b00d3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.198+0000 7f65b77fe640 1 -- 172.21.15.47:0/2258385609 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65b00d5a50 con 0x7f65b0006a50 2024-04-01T22:34:07.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.202+0000 7f65b77fe640 1 --2- 172.21.15.47:0/2258385609 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65b0006a50 0x7f65b00d3400 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f65a402c510 tx=0x7f65a4001b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:07.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.206+0000 7f65b4ff9640 1 -- 172.21.15.47:0/2258385609 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a4046070 con 0x7f65b0006a50 2024-04-01T22:34:07.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.206+0000 7f65b4ff9640 1 -- 172.21.15.47:0/2258385609 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65a4004ac0 con 0x7f65b0006a50 2024-04-01T22:34:07.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.206+0000 7f65b4ff9640 1 -- 172.21.15.47:0/2258385609 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a4007db0 con 0x7f65b0006a50 2024-04-01T22:34:07.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.206+0000 7f65bd167640 1 -- 172.21.15.47:0/2258385609 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65b00d3e80 con 0x7f65b0006a50 2024-04-01T22:34:07.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.206+0000 7f65bd167640 1 -- 172.21.15.47:0/2258385609 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65b017cb10 con 0x7f65b0006a50 2024-04-01T22:34:07.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.207+0000 7f65bd167640 1 -- 172.21.15.47:0/2258385609 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65b00057e0 con 0x7f65b0006a50 2024-04-01T22:34:07.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.219+0000 7f1278284640 1 -- 172.21.15.47:0/3533635396 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f1258005850 con 0x7f1270150a50 2024-04-01T22:34:07.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.303+0000 7f2cbb53f640 1 -- 172.21.15.47:0/559211120 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f2cb40c7280 con 0x7f2cb4158840 2024-04-01T22:34:07.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.323+0000 7f3a657fa640 1 -- 172.21.15.47:0/2822020056 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f3a5c057010 con 0x7f3a680c7240 2024-04-01T22:34:07.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.347+0000 7f3a657fa640 1 -- 172.21.15.47:0/2822020056 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f3a5c059670 con 0x7f3a680c7240 2024-04-01T22:34:07.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.348+0000 7fa7e8a4e640 1 -- 172.21.15.47:0/1918341955 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fa7dc04b870 con 0x7fa7dc0dd3f0 2024-04-01T22:34:07.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.349+0000 7f1266ffd640 1 -- 172.21.15.47:0/3533635396 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f126c0585c0 con 0x7f1270150a50 2024-04-01T22:34:07.349 INFO:teuthology.orchestra.run.smithi047.stdout:55834574861 2024-04-01T22:34:07.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.350+0000 7fd7cd964640 1 --2- 172.21.15.47:0/1313716060 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd7c00dd460 0x7fd7c00d8e60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8009fd0 tx=0x7fd7b800ed40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:07.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.351+0000 7f1278284640 1 -- 172.21.15.47:0/3533635396 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f125406b9e0 msgr2=0x7f125406dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:07.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.351+0000 7f1278284640 1 --2- 172.21.15.47:0/3533635396 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f125406b9e0 0x7f125406dea0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1268011200 tx=0x7f126800d040 comp rx=0 tx=0).stop 2024-04-01T22:34:07.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.351+0000 7f1278284640 1 -- 172.21.15.47:0/3533635396 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1270150a50 msgr2=0x7f12701f80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:07.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.351+0000 7f1278284640 1 --2- 172.21.15.47:0/3533635396 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1270150a50 0x7f12701f80b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f126c00c3c0 tx=0x7f126c00c880 comp rx=0 tx=0).stop 2024-04-01T22:34:07.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.351+0000 7f1278284640 1 -- 172.21.15.47:0/3533635396 shutdown_connections 2024-04-01T22:34:07.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.351+0000 7f1278284640 1 --2- 172.21.15.47:0/3533635396 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f125406b9e0 0x7f125406dea0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.351+0000 7f1278284640 1 --2- 172.21.15.47:0/3533635396 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1270150a50 0x7f12701f80b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.351+0000 7f1278284640 1 --2- 172.21.15.47:0/3533635396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12700c76d0 0x7f1270145200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.351+0000 7f1278284640 1 --2- 172.21.15.47:0/3533635396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12700c7180 0x7f1270144cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.351+0000 7f1278284640 1 -- 172.21.15.47:0/3533635396 >> 172.21.15.47:0/3533635396 conn(0x7f12700c8bf0 msgr2=0x7f1270157af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:07.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.351+0000 7f1278284640 1 -- 172.21.15.47:0/3533635396 shutdown_connections 2024-04-01T22:34:07.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.351+0000 7f1278284640 1 -- 172.21.15.47:0/3533635396 wait complete. 2024-04-01T22:34:07.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.361+0000 7fd7beffd640 1 -- 172.21.15.47:0/1313716060 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b8017070 con 0x7fd7c00dd460 2024-04-01T22:34:07.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.361+0000 7fd7beffd640 1 -- 172.21.15.47:0/1313716060 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7b800c940 con 0x7fd7c00dd460 2024-04-01T22:34:07.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.361+0000 7fd7beffd640 1 -- 172.21.15.47:0/1313716060 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b800cd10 con 0x7fd7c00dd460 2024-04-01T22:34:07.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.361+0000 7fd7cf167640 1 -- 172.21.15.47:0/1313716060 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7c00480d0 con 0x7fd7c00dd460 2024-04-01T22:34:07.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.361+0000 7fd7cf167640 1 -- 172.21.15.47:0/1313716060 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7c00357d0 con 0x7fd7c00dd460 2024-04-01T22:34:07.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.362+0000 7fd7cf167640 1 -- 172.21.15.47:0/1313716060 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7c00057d0 con 0x7fd7c00dd460 2024-04-01T22:34:07.365 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574861 for osd.0 2024-04-01T22:34:07.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.386+0000 7fbebb7fe640 1 -- 172.21.15.47:0/3214395332 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7fbec801a070 con 0x7fbebc004e60 2024-04-01T22:34:07.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.387+0000 7f64f5117640 1 --2- 172.21.15.47:0/2773752189 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f64f015ad00 0x7f64f01e45f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f64e800b490 tx=0x7f64e800b950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:07.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.387+0000 7fbebb7fe640 1 --2- 172.21.15.47:0/3214395332 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fbec006b990 0x7fbec006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:07.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.387+0000 7fbed259c640 1 --2- 172.21.15.47:0/3214395332 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fbec006b990 0x7fbec006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:07.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.387+0000 7fbed259c640 1 --2- 172.21.15.47:0/3214395332 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fbec006b990 0x7fbec006de50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbed4068000 tx=0x7fbed4075420 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:07.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.390+0000 7fbebb7fe640 1 -- 172.21.15.47:0/3214395332 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fbec8056740 con 0x7fbebc004e60 2024-04-01T22:34:07.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.400+0000 7fbebb7fe640 1 -- 172.21.15.47:0/3214395332 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fbec8021020 con 0x7fbebc004e60 2024-04-01T22:34:07.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.412+0000 7f2caaffd640 1 -- 172.21.15.47:0/559211120 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2cac059630 con 0x7f2cb4158840 2024-04-01T22:34:07.412 INFO:teuthology.orchestra.run.smithi047.stdout:55834574861 2024-04-01T22:34:07.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.416+0000 7f2cbb53f640 1 -- 172.21.15.47:0/559211120 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f2c9806b9e0 msgr2=0x7f2c9806dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:07.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.416+0000 7f2cbb53f640 1 --2- 172.21.15.47:0/559211120 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f2c9806b9e0 0x7f2c9806dea0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4006a90 tx=0x7f2ca4006a20 comp rx=0 tx=0).stop 2024-04-01T22:34:07.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.416+0000 7f2cbb53f640 1 -- 172.21.15.47:0/559211120 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2cb4158840 msgr2=0x7f2cb4152110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:07.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.416+0000 7f2cbb53f640 1 --2- 172.21.15.47:0/559211120 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2cb4158840 0x7f2cb4152110 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2cac00b9a0 tx=0x7f2cac00be60 comp rx=0 tx=0).stop 2024-04-01T22:34:07.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.416+0000 7f2cbb53f640 1 -- 172.21.15.47:0/559211120 shutdown_connections 2024-04-01T22:34:07.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.416+0000 7f2cbb53f640 1 --2- 172.21.15.47:0/559211120 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f2c9806b9e0 0x7f2c9806dea0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.416+0000 7f2cbb53f640 1 --2- 172.21.15.47:0/559211120 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2cb4158840 0x7f2cb4152110 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.416+0000 7f2cbb53f640 1 --2- 172.21.15.47:0/559211120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2cb40c8260 0x7f2cb4151bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.416+0000 7f2cbb53f640 1 --2- 172.21.15.47:0/559211120 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2cb40c6ca0 0x7f2cb41f4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.416+0000 7f2cbb53f640 1 -- 172.21.15.47:0/559211120 >> 172.21.15.47:0/559211120 conn(0x7f2cb406b110 msgr2=0x7f2cb4072a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:07.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.416+0000 7f64e57fa640 1 -- 172.21.15.47:0/2773752189 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e8015020 con 0x7f64f015ad00 2024-04-01T22:34:07.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.416+0000 7f2cbb53f640 1 -- 172.21.15.47:0/559211120 shutdown_connections 2024-04-01T22:34:07.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.416+0000 7f2cbb53f640 1 -- 172.21.15.47:0/559211120 wait complete. 2024-04-01T22:34:07.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.416+0000 7f64e57fa640 1 -- 172.21.15.47:0/2773752189 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64e8011850 con 0x7f64f015ad00 2024-04-01T22:34:07.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.416+0000 7f64e57fa640 1 -- 172.21.15.47:0/2773752189 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e8011c40 con 0x7f64f015ad00 2024-04-01T22:34:07.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.417+0000 7f64f6b7a640 1 -- 172.21.15.47:0/2773752189 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64f01f0ce0 con 0x7f64f015ad00 2024-04-01T22:34:07.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.417+0000 7f64f6b7a640 1 -- 172.21.15.47:0/2773752189 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64f01eff20 con 0x7f64f015ad00 2024-04-01T22:34:07.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.418+0000 7f64f6b7a640 1 -- 172.21.15.47:0/2773752189 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64f0068920 con 0x7f64f015ad00 2024-04-01T22:34:07.431 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574861 for osd.3 2024-04-01T22:34:07.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.485+0000 7f65b4ff9640 1 -- 172.21.15.47:0/2258385609 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f65a4049070 con 0x7f65b0006a50 2024-04-01T22:34:07.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.485+0000 7f65b4ff9640 1 --2- 172.21.15.47:0/2258385609 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f659c06ba10 0x7f659c06ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:07.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.486+0000 7f65b7fff640 1 --2- 172.21.15.47:0/2258385609 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f659c06ba10 0x7f659c06ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:07.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.486+0000 7f65b7fff640 1 --2- 172.21.15.47:0/2258385609 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f659c06ba10 0x7f659c06ded0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f65ac009710 tx=0x7f65ac006d10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:07.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.501+0000 7f65b4ff9640 1 -- 172.21.15.47:0/2258385609 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f65a4078500 con 0x7f65b0006a50 2024-04-01T22:34:07.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.501+0000 7f65b4ff9640 1 -- 172.21.15.47:0/2258385609 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f65a4050080 con 0x7f65b0006a50 2024-04-01T22:34:07.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.519+0000 7fa7d2ffd640 1 -- 172.21.15.47:0/1918341955 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa7dc0dd7d0 con 0x7fa7dc0dd3f0 2024-04-01T22:34:07.519 INFO:teuthology.orchestra.run.smithi047.stdout:55834574861 2024-04-01T22:34:07.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.521+0000 7fa7e8a4e640 1 -- 172.21.15.47:0/1918341955 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fa7c406b9e0 msgr2=0x7fa7c406dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:07.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.521+0000 7fa7e8a4e640 1 --2- 172.21.15.47:0/1918341955 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fa7c406b9e0 0x7fa7c406dea0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4069390 tx=0x7fa7e40ac000 comp rx=0 tx=0).stop 2024-04-01T22:34:07.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.521+0000 7fa7e8a4e640 1 -- 172.21.15.47:0/1918341955 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7dc0dd3f0 msgr2=0x7fa7dc0e0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:07.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.521+0000 7fa7e8a4e640 1 --2- 172.21.15.47:0/1918341955 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7dc0dd3f0 0x7fa7dc0e0330 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa7d400c3c0 tx=0x7fa7d400c880 comp rx=0 tx=0).stop 2024-04-01T22:34:07.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.521+0000 7fa7e8a4e640 1 -- 172.21.15.47:0/1918341955 shutdown_connections 2024-04-01T22:34:07.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.521+0000 7fa7e8a4e640 1 --2- 172.21.15.47:0/1918341955 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fa7c406b9e0 0x7fa7c406dea0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.521+0000 7fa7e8a4e640 1 --2- 172.21.15.47:0/1918341955 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fa7dc0e37d0 0x7fa7dc0c7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.521+0000 7fa7e8a4e640 1 --2- 172.21.15.47:0/1918341955 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7dc0dd3f0 0x7fa7dc0e0330 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.521+0000 7fa7e8a4e640 1 --2- 172.21.15.47:0/1918341955 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa7dc04ba90 0x7fa7dc0c4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.521+0000 7fa7e8a4e640 1 -- 172.21.15.47:0/1918341955 >> 172.21.15.47:0/1918341955 conn(0x7fa7dc0501b0 msgr2=0x7fa7dc0055d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:07.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.521+0000 7fa7e8a4e640 1 -- 172.21.15.47:0/1918341955 shutdown_connections 2024-04-01T22:34:07.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.522+0000 7fa7e8a4e640 1 -- 172.21.15.47:0/1918341955 wait complete. 2024-04-01T22:34:07.532 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574861 for osd.4 2024-04-01T22:34:07.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.572+0000 7f3a6eb48640 1 -- 172.21.15.47:0/2822020056 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f3a680c7ba0 con 0x7f3a680c7240 2024-04-01T22:34:07.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.597+0000 7fbed897f640 1 -- 172.21.15.47:0/3214395332 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fbecc046910 con 0x7fbebc004e60 2024-04-01T22:34:07.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.629+0000 7fd7beffd640 1 -- 172.21.15.47:0/1313716060 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7fd7b801a070 con 0x7fd7c00dd460 2024-04-01T22:34:07.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.629+0000 7fd7beffd640 1 --2- 172.21.15.47:0/1313716060 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fd7ac06b9e0 0x7fd7ac06dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:07.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.630+0000 7fd7ce165640 1 --2- 172.21.15.47:0/1313716060 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fd7ac06b9e0 0x7fd7ac06dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:07.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.630+0000 7fd7ce165640 1 --2- 172.21.15.47:0/1313716060 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fd7ac06b9e0 0x7fd7ac06dea0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4001560 tx=0x7fd7c4007990 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:07.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.632+0000 7fd7beffd640 1 -- 172.21.15.47:0/1313716060 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fd7b80574d0 con 0x7fd7c00dd460 2024-04-01T22:34:07.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.633+0000 7f3a657fa640 1 -- 172.21.15.47:0/2822020056 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3a5c058f70 con 0x7f3a680c7240 2024-04-01T22:34:07.633 INFO:teuthology.orchestra.run.smithi047.stdout:55834574861 2024-04-01T22:34:07.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.636+0000 7f3a6eb48640 1 -- 172.21.15.47:0/2822020056 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f3a4c06b9e0 msgr2=0x7f3a4c06dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:07.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.636+0000 7f3a6eb48640 1 --2- 172.21.15.47:0/2822020056 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f3a4c06b9e0 0x7f3a4c06dea0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3a680ceab0 tx=0x7f3a54006c90 comp rx=0 tx=0).stop 2024-04-01T22:34:07.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.636+0000 7f3a6eb48640 1 -- 172.21.15.47:0/2822020056 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3a680c7240 msgr2=0x7f3a680b5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:07.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.636+0000 7f3a6eb48640 1 --2- 172.21.15.47:0/2822020056 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3a680c7240 0x7f3a680b5300 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c00b4d0 tx=0x7f3a5c00b990 comp rx=0 tx=0).stop 2024-04-01T22:34:07.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.636+0000 7f3a6eb48640 1 -- 172.21.15.47:0/2822020056 shutdown_connections 2024-04-01T22:34:07.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.636+0000 7f3a6eb48640 1 --2- 172.21.15.47:0/2822020056 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f3a4c06b9e0 0x7f3a4c06dea0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.636+0000 7f3a6eb48640 1 --2- 172.21.15.47:0/2822020056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a680cee70 0x7f3a68161f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.636+0000 7f3a6eb48640 1 --2- 172.21.15.47:0/2822020056 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a680c7620 0x7f3a680ce1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.636+0000 7f3a6eb48640 1 --2- 172.21.15.47:0/2822020056 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3a680c7240 0x7f3a680b5300 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.636+0000 7f3a6eb48640 1 -- 172.21.15.47:0/2822020056 >> 172.21.15.47:0/2822020056 conn(0x7f3a680cfdb0 msgr2=0x7f3a6815c250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:07.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.636+0000 7f3a6eb48640 1 -- 172.21.15.47:0/2822020056 shutdown_connections 2024-04-01T22:34:07.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.636+0000 7f3a6eb48640 1 -- 172.21.15.47:0/2822020056 wait complete. 2024-04-01T22:34:07.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.648+0000 7fd7beffd640 1 -- 172.21.15.47:0/1313716060 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fd7b8059b30 con 0x7fd7c00dd460 2024-04-01T22:34:07.650 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574861 for osd.6 2024-04-01T22:34:07.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.675+0000 7f64e57fa640 1 -- 172.21.15.47:0/2773752189 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f64e8018020 con 0x7f64f015ad00 2024-04-01T22:34:07.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.675+0000 7f64e57fa640 1 --2- 172.21.15.47:0/2773752189 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f64dc06b990 0x7f64dc06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:07.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.675+0000 7f64f4916640 1 --2- 172.21.15.47:0/2773752189 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f64dc06b990 0x7f64dc06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:07.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.676+0000 7f64f4916640 1 --2- 172.21.15.47:0/2773752189 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f64dc06b990 0x7f64dc06de50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f64ec036000 tx=0x7f64ec02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:07.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.680+0000 7f64e57fa640 1 -- 172.21.15.47:0/2773752189 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f64e8011de0 con 0x7f64f015ad00 2024-04-01T22:34:07.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.692+0000 7f64e57fa640 1 -- 172.21.15.47:0/2773752189 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f64e801f020 con 0x7f64f015ad00 2024-04-01T22:34:07.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.700+0000 7fbebb7fe640 1 -- 172.21.15.47:0/3214395332 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbec8058da0 con 0x7fbebc004e60 2024-04-01T22:34:07.700 INFO:teuthology.orchestra.run.smithi047.stdout:55834574861 2024-04-01T22:34:07.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.703+0000 7fbed897f640 1 -- 172.21.15.47:0/3214395332 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fbec006b990 msgr2=0x7fbec006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:07.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.703+0000 7fbed897f640 1 --2- 172.21.15.47:0/3214395332 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fbec006b990 0x7fbec006de50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbed4068000 tx=0x7fbed4075420 comp rx=0 tx=0).stop 2024-04-01T22:34:07.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.703+0000 7fbed897f640 1 -- 172.21.15.47:0/3214395332 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbebc004e60 msgr2=0x7fbecc0cb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:07.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.703+0000 7fbed897f640 1 --2- 172.21.15.47:0/3214395332 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbebc004e60 0x7fbecc0cb0d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbec800c760 tx=0x7fbec800cb60 comp rx=0 tx=0).stop 2024-04-01T22:34:07.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.703+0000 7fbed897f640 1 -- 172.21.15.47:0/3214395332 shutdown_connections 2024-04-01T22:34:07.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.703+0000 7fbed897f640 1 --2- 172.21.15.47:0/3214395332 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fbec006b990 0x7fbec006de50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.703+0000 7fbed897f640 1 --2- 172.21.15.47:0/3214395332 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbecc0de1e0 0x7fbecc0cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.703+0000 7fbed897f640 1 --2- 172.21.15.47:0/3214395332 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbecc0c9e50 0x7fbecc0c9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.703+0000 7fbed897f640 1 --2- 172.21.15.47:0/3214395332 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbebc004e60 0x7fbecc0cb0d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.703+0000 7fbed897f640 1 -- 172.21.15.47:0/3214395332 >> 172.21.15.47:0/3214395332 conn(0x7fbecc00d180 msgr2=0x7fbecc04f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:07.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.703+0000 7fbed897f640 1 -- 172.21.15.47:0/3214395332 shutdown_connections 2024-04-01T22:34:07.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.703+0000 7fbed897f640 1 -- 172.21.15.47:0/3214395332 wait complete. 2024-04-01T22:34:07.719 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574861 for osd.7 2024-04-01T22:34:07.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.741+0000 7f65bd167640 1 -- 172.21.15.47:0/2258385609 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f65b0033ea0 con 0x7f65b0006a50 2024-04-01T22:34:07.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.749+0000 7f65b4ff9640 1 -- 172.21.15.47:0/2258385609 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f65b00dd8c0 con 0x7f65b0006a50 2024-04-01T22:34:07.749 INFO:teuthology.orchestra.run.smithi047.stdout:55834574860 2024-04-01T22:34:07.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.752+0000 7f65bd167640 1 -- 172.21.15.47:0/2258385609 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f659c06ba10 msgr2=0x7f659c06ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:07.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.752+0000 7f65bd167640 1 --2- 172.21.15.47:0/2258385609 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f659c06ba10 0x7f659c06ded0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f65ac009710 tx=0x7f65ac006d10 comp rx=0 tx=0).stop 2024-04-01T22:34:07.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.752+0000 7f65bd167640 1 -- 172.21.15.47:0/2258385609 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65b0006a50 msgr2=0x7f65b00d3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:07.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.752+0000 7f65bd167640 1 --2- 172.21.15.47:0/2258385609 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65b0006a50 0x7f65b00d3400 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f65a402c510 tx=0x7f65a4001b20 comp rx=0 tx=0).stop 2024-04-01T22:34:07.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.752+0000 7f65bd167640 1 -- 172.21.15.47:0/2258385609 shutdown_connections 2024-04-01T22:34:07.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.752+0000 7f65bd167640 1 --2- 172.21.15.47:0/2258385609 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f659c06ba10 0x7f659c06ded0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.752+0000 7f65bd167640 1 --2- 172.21.15.47:0/2258385609 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f65b00da0b0 0x7f65b00d3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.752+0000 7f65bd167640 1 --2- 172.21.15.47:0/2258385609 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65b0006a50 0x7f65b00d3400 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.752+0000 7f65bd167640 1 --2- 172.21.15.47:0/2258385609 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f65b0006670 0x7f65b00d5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.752+0000 7f65bd167640 1 -- 172.21.15.47:0/2258385609 >> 172.21.15.47:0/2258385609 conn(0x7f65b00505d0 msgr2=0x7f65b00d8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:07.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.752+0000 7f65bd167640 1 -- 172.21.15.47:0/2258385609 shutdown_connections 2024-04-01T22:34:07.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.752+0000 7f65bd167640 1 -- 172.21.15.47:0/2258385609 wait complete. 2024-04-01T22:34:07.765 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574860 for osd.1 2024-04-01T22:34:07.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.864+0000 7fd7cf167640 1 -- 172.21.15.47:0/1313716060 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fd7c0006e00 con 0x7fd7c00dd460 2024-04-01T22:34:07.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.887+0000 7f64f6b7a640 1 -- 172.21.15.47:0/2773752189 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f64f0157cd0 con 0x7f64f015ad00 2024-04-01T22:34:07.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.891+0000 7fd7beffd640 1 -- 172.21.15.47:0/1313716060 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd7b8059430 con 0x7fd7c00dd460 2024-04-01T22:34:07.891 INFO:teuthology.orchestra.run.smithi047.stdout:55834574861 2024-04-01T22:34:07.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.892+0000 7f64e57fa640 1 -- 172.21.15.47:0/2773752189 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f64e800f2e0 con 0x7f64f015ad00 2024-04-01T22:34:07.892 INFO:teuthology.orchestra.run.smithi047.stdout:55834574862 2024-04-01T22:34:07.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.893+0000 7fd7cf167640 1 -- 172.21.15.47:0/1313716060 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fd7ac06b9e0 msgr2=0x7fd7ac06dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:07.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.893+0000 7fd7cf167640 1 --2- 172.21.15.47:0/1313716060 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fd7ac06b9e0 0x7fd7ac06dea0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4001560 tx=0x7fd7c4007990 comp rx=0 tx=0).stop 2024-04-01T22:34:07.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.893+0000 7fd7cf167640 1 -- 172.21.15.47:0/1313716060 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd7c00dd460 msgr2=0x7fd7c00d8e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:07.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.893+0000 7fd7cf167640 1 --2- 172.21.15.47:0/1313716060 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd7c00dd460 0x7fd7c00d8e60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8009fd0 tx=0x7fd7b800ed40 comp rx=0 tx=0).stop 2024-04-01T22:34:07.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.893+0000 7fd7cf167640 1 -- 172.21.15.47:0/1313716060 shutdown_connections 2024-04-01T22:34:07.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.893+0000 7fd7cf167640 1 --2- 172.21.15.47:0/1313716060 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fd7ac06b9e0 0x7fd7ac06dea0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.893+0000 7fd7cf167640 1 --2- 172.21.15.47:0/1313716060 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7c00e6690 0x7fd7c00d93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.893+0000 7fd7cf167640 1 --2- 172.21.15.47:0/1313716060 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd7c00dd460 0x7fd7c00d8e60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.893+0000 7fd7cf167640 1 --2- 172.21.15.47:0/1313716060 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7c0006270 0x7fd7c0035fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.893+0000 7fd7cf167640 1 -- 172.21.15.47:0/1313716060 >> 172.21.15.47:0/1313716060 conn(0x7fd7c0050a00 msgr2=0x7fd7c0046620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:07.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.893+0000 7fd7cf167640 1 -- 172.21.15.47:0/1313716060 shutdown_connections 2024-04-01T22:34:07.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.893+0000 7fd7cf167640 1 -- 172.21.15.47:0/1313716060 wait complete. 2024-04-01T22:34:07.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.894+0000 7f64f6b7a640 1 -- 172.21.15.47:0/2773752189 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f64dc06b990 msgr2=0x7f64dc06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:07.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.894+0000 7f64f6b7a640 1 --2- 172.21.15.47:0/2773752189 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f64dc06b990 0x7f64dc06de50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f64ec036000 tx=0x7f64ec02e000 comp rx=0 tx=0).stop 2024-04-01T22:34:07.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.894+0000 7f64f6b7a640 1 -- 172.21.15.47:0/2773752189 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f64f015ad00 msgr2=0x7f64f01e45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:07.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.894+0000 7f64f6b7a640 1 --2- 172.21.15.47:0/2773752189 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f64f015ad00 0x7f64f01e45f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f64e800b490 tx=0x7f64e800b950 comp rx=0 tx=0).stop 2024-04-01T22:34:07.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.894+0000 7f64f6b7a640 1 -- 172.21.15.47:0/2773752189 shutdown_connections 2024-04-01T22:34:07.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.894+0000 7f64f6b7a640 1 --2- 172.21.15.47:0/2773752189 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f64dc06b990 0x7f64dc06de50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.894+0000 7f64f6b7a640 1 --2- 172.21.15.47:0/2773752189 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f64f015ad00 0x7f64f01e45f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.894+0000 7f64f6b7a640 1 --2- 172.21.15.47:0/2773752189 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64f01546d0 0x7f64f00c1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.894+0000 7f64f6b7a640 1 --2- 172.21.15.47:0/2773752189 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f64f00b11e0 0x7f64f01592a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:07.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.894+0000 7f64f6b7a640 1 -- 172.21.15.47:0/2773752189 >> 172.21.15.47:0/2773752189 conn(0x7f64f00cbff0 msgr2=0x7f64f00cc3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:07.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.894+0000 7f64f6b7a640 1 -- 172.21.15.47:0/2773752189 shutdown_connections 2024-04-01T22:34:07.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:07.894+0000 7f64f6b7a640 1 -- 172.21.15.47:0/2773752189 wait complete. 2024-04-01T22:34:07.906 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574861 for osd.5 2024-04-01T22:34:07.906 DEBUG:teuthology.parallel:result is None 2024-04-01T22:34:07.907 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574862 for osd.2 2024-04-01T22:34:07.907 DEBUG:teuthology.parallel:result is None 2024-04-01T22:34:08.366 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-01T22:34:08.432 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-01T22:34:08.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.470+0000 7ff915ffd640 1 Processor -- start 2024-04-01T22:34:08.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.471+0000 7ff915ffd640 1 -- start start 2024-04-01T22:34:08.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.472+0000 7ff915ffd640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff9100c93f0 0x7ff9100cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:08.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.472+0000 7ff915ffd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff91015afc0 0x7ff91006c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:08.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.472+0000 7ff915ffd640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff91006c770 0x7ff9100cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:08.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.472+0000 7ff915ffd640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7ff9100cdae0 con 0x7ff9100c93f0 2024-04-01T22:34:08.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.472+0000 7ff915ffd640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7ff9100c97d0 con 0x7ff91006c770 2024-04-01T22:34:08.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.472+0000 7ff915ffd640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7ff9100cdd80 con 0x7ff91015afc0 2024-04-01T22:34:08.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.472+0000 7ff90f7fe640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff9100c93f0 0x7ff9100cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:08.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.473+0000 7ff90effd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff91015afc0 0x7ff91006c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:08.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.473+0000 7ff90ffff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff91006c770 0x7ff9100cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:08.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.473+0000 7ff90ffff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff91006c770 0x7ff9100cc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:44970/0 (socket says 172.21.15.47:44970) 2024-04-01T22:34:08.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.473+0000 7ff90ffff640 1 -- 172.21.15.47:0/476247286 learned_addr learned my addr 172.21.15.47:0/476247286 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:08.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.475+0000 7ff90ffff640 1 -- 172.21.15.47:0/476247286 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff91015afc0 msgr2=0x7ff91006c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:08.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.475+0000 7ff90ffff640 1 --2- 172.21.15.47:0/476247286 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff91015afc0 0x7ff91006c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:08.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.475+0000 7ff90ffff640 1 -- 172.21.15.47:0/476247286 >> v2:172.21.15.47:3300/0 conn(0x7ff9100c93f0 msgr2=0x7ff9100cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:08.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.475+0000 7ff90ffff640 1 --2- 172.21.15.47:0/476247286 >> v2:172.21.15.47:3300/0 conn(0x7ff9100c93f0 0x7ff9100cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:08.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.475+0000 7ff90ffff640 1 -- 172.21.15.47:0/476247286 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9100ce060 con 0x7ff91006c770 2024-04-01T22:34:08.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.477+0000 7ff90ffff640 1 --2- 172.21.15.47:0/476247286 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff91006c770 0x7ff9100cc0d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff9100c6c30 tx=0x7ff90802be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c76ee45c64ecb54c server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:08.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.481+0000 7ff90e7fc640 1 -- 172.21.15.47:0/476247286 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90802c9e0 con 0x7ff91006c770 2024-04-01T22:34:08.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.481+0000 7ff90e7fc640 1 -- 172.21.15.47:0/476247286 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff90802cb80 con 0x7ff91006c770 2024-04-01T22:34:08.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.481+0000 7ff90e7fc640 1 -- 172.21.15.47:0/476247286 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9080343f0 con 0x7ff91006c770 2024-04-01T22:34:08.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.482+0000 7ff915ffd640 1 -- 172.21.15.47:0/476247286 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff91006c770 msgr2=0x7ff9100cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:08.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.482+0000 7ff915ffd640 1 --2- 172.21.15.47:0/476247286 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff91006c770 0x7ff9100cc0d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff9100c6c30 tx=0x7ff90802be40 comp rx=0 tx=0).stop 2024-04-01T22:34:08.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.482+0000 7ff915ffd640 1 -- 172.21.15.47:0/476247286 shutdown_connections 2024-04-01T22:34:08.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.482+0000 7ff915ffd640 1 --2- 172.21.15.47:0/476247286 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff91006c770 0x7ff9100cc0d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:08.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.482+0000 7ff915ffd640 1 --2- 172.21.15.47:0/476247286 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff91015afc0 0x7ff91006c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:08.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.482+0000 7ff915ffd640 1 --2- 172.21.15.47:0/476247286 >> v2:172.21.15.47:3300/0 conn(0x7ff9100c93f0 0x7ff9100cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:08.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.482+0000 7ff915ffd640 1 -- 172.21.15.47:0/476247286 >> 172.21.15.47:0/476247286 conn(0x7ff9100cfdb0 msgr2=0x7ff9100d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:08.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.482+0000 7ff915ffd640 1 -- 172.21.15.47:0/476247286 shutdown_connections 2024-04-01T22:34:08.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.482+0000 7ff915ffd640 1 -- 172.21.15.47:0/476247286 wait complete. 2024-04-01T22:34:08.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.483+0000 7ff915ffd640 1 Processor -- start 2024-04-01T22:34:08.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.483+0000 7ff915ffd640 1 -- start start 2024-04-01T22:34:08.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.484+0000 7ff915ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff91006c770 0x7ff9100ae540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:08.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.484+0000 7ff915ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9100c93f0 0x7ff9101f3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:08.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.484+0000 7ff915ffd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff91015afc0 0x7ff9101e6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:08.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.484+0000 7ff915ffd640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff91015b400 con 0x7ff9100c93f0 2024-04-01T22:34:08.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.484+0000 7ff915ffd640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff9100ce620 con 0x7ff91006c770 2024-04-01T22:34:08.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.484+0000 7ff915ffd640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7ff9100cf430 con 0x7ff91015afc0 2024-04-01T22:34:08.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.485+0000 7ff90effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9100c93f0 0x7ff9101f3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:08.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.485+0000 7ff90ffff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff91015afc0 0x7ff9101e6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:08.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.485+0000 7ff90f7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff91006c770 0x7ff9100ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:08.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.485+0000 7ff90effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9100c93f0 0x7ff9101f3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48046/0 (socket says 172.21.15.47:48046) 2024-04-01T22:34:08.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.485+0000 7ff90effd640 1 -- 172.21.15.47:0/2586673111 learned_addr learned my addr 172.21.15.47:0/2586673111 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:08.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.489+0000 7ff90ffff640 1 -- 172.21.15.47:0/2586673111 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff91006c770 msgr2=0x7ff9100ae540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:08.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.489+0000 7ff90ffff640 1 --2- 172.21.15.47:0/2586673111 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff91006c770 0x7ff9100ae540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:08.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.489+0000 7ff90ffff640 1 -- 172.21.15.47:0/2586673111 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9100c93f0 msgr2=0x7ff9101f3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:08.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.489+0000 7ff90ffff640 1 --2- 172.21.15.47:0/2586673111 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9100c93f0 0x7ff9101f3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:08.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.489+0000 7ff90ffff640 1 -- 172.21.15.47:0/2586673111 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9101f0d70 con 0x7ff91015afc0 2024-04-01T22:34:08.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.491+0000 7ff90ffff640 1 --2- 172.21.15.47:0/2586673111 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff91015afc0 0x7ff9101e6aa0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff908032000 tx=0x7ff908004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:08.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.495+0000 7ff8f7fff640 1 -- 172.21.15.47:0/2586673111 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff908043020 con 0x7ff91015afc0 2024-04-01T22:34:08.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.495+0000 7ff8f7fff640 1 -- 172.21.15.47:0/2586673111 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff90803e450 con 0x7ff91015afc0 2024-04-01T22:34:08.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.495+0000 7ff8f7fff640 1 -- 172.21.15.47:0/2586673111 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90803e840 con 0x7ff91015afc0 2024-04-01T22:34:08.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.495+0000 7ff915ffd640 1 -- 172.21.15.47:0/2586673111 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9100af2a0 con 0x7ff91015afc0 2024-04-01T22:34:08.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.495+0000 7ff915ffd640 1 -- 172.21.15.47:0/2586673111 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9100aefc0 con 0x7ff91015afc0 2024-04-01T22:34:08.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.497+0000 7ff915ffd640 1 -- 172.21.15.47:0/2586673111 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff910068210 con 0x7ff91015afc0 2024-04-01T22:34:08.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.515+0000 7ff8f7fff640 1 -- 172.21.15.47:0/2586673111 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7ff908046020 con 0x7ff91015afc0 2024-04-01T22:34:08.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.516+0000 7ff8f7fff640 1 --2- 172.21.15.47:0/2586673111 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff8fc06b9c0 0x7ff8fc06de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:08.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.516+0000 7ff90f7fe640 1 --2- 172.21.15.47:0/2586673111 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff8fc06b9c0 0x7ff8fc06de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:08.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.516+0000 7ff90f7fe640 1 --2- 172.21.15.47:0/2586673111 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff8fc06b9c0 0x7ff8fc06de80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff900009ac0 tx=0x7ff900009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:08.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.518+0000 7ff8f7fff640 1 -- 172.21.15.47:0/2586673111 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7ff908079890 con 0x7ff91015afc0 2024-04-01T22:34:08.533 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-01T22:34:08.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.538+0000 7f73b456c640 1 Processor -- start 2024-04-01T22:34:08.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.538+0000 7f73b456c640 1 -- start start 2024-04-01T22:34:08.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.539+0000 7f73b456c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f73ac0cbe40 0x7f73ac15a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:08.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.539+0000 7f73b456c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f73ac0ce410 0x7f73ac0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:08.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.539+0000 7f73b456c640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73ac15a990 con 0x7f73ac0cf370 2024-04-01T22:34:08.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.539+0000 7f73b456c640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f73ac0cd9c0 con 0x7f73ac0ce410 2024-04-01T22:34:08.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.539+0000 7f73b456c640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f73ac0cdf80 con 0x7f73ac0cbe40 2024-04-01T22:34:08.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.540+0000 7f73b2308640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f73ac0cbe40 0x7f73ac15a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:08.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.540+0000 7f73b2308640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f73ac0cbe40 0x7f73ac15a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:44988/0 (socket says 172.21.15.47:44988) 2024-04-01T22:34:08.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.540+0000 7f73b2308640 1 -- 172.21.15.47:0/1035766842 learned_addr learned my addr 172.21.15.47:0/1035766842 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:08.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.541+0000 7f73b1b07640 1 --2- 172.21.15.47:0/1035766842 >> v2:172.21.15.47:3300/0 conn(0x7f73ac0ce410 0x7f73ac0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:08.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.542+0000 7f73b2308640 1 -- 172.21.15.47:0/1035766842 >> v2:172.21.15.47:3300/0 conn(0x7f73ac0ce410 msgr2=0x7f73ac0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:08.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.542+0000 7f73b2308640 1 --2- 172.21.15.47:0/1035766842 >> v2:172.21.15.47:3300/0 conn(0x7f73ac0ce410 0x7f73ac0cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:08.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.542+0000 7f73b2308640 1 -- 172.21.15.47:0/1035766842 >> v1:172.21.15.47:6789/0 conn(0x7f73ac0cf370 legacy=0x7f73ac0cc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:08.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.542+0000 7f73b2308640 1 -- 172.21.15.47:0/1035766842 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73ac15ac20 con 0x7f73ac0cbe40 2024-04-01T22:34:08.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.544+0000 7f73b2308640 1 --2- 172.21.15.47:0/1035766842 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f73ac0cbe40 0x7f73ac15a450 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f73ac08ccb0 tx=0x7f73a802b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=890691a3786f1bdc server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:08.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.549+0000 7f73b1306640 1 -- 172.21.15.47:0/1035766842 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a8035020 con 0x7f73ac0cbe40 2024-04-01T22:34:08.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.549+0000 7f73b1306640 1 -- 172.21.15.47:0/1035766842 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73a8031870 con 0x7f73ac0cbe40 2024-04-01T22:34:08.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.549+0000 7f73b1306640 1 -- 172.21.15.47:0/1035766842 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a8031c40 con 0x7f73ac0cbe40 2024-04-01T22:34:08.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.549+0000 7f73b456c640 1 -- 172.21.15.47:0/1035766842 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f73ac0cbe40 msgr2=0x7f73ac15a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:08.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.550+0000 7f73b456c640 1 --2- 172.21.15.47:0/1035766842 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f73ac0cbe40 0x7f73ac15a450 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f73ac08ccb0 tx=0x7f73a802b910 comp rx=0 tx=0).stop 2024-04-01T22:34:08.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.550+0000 7f73b456c640 1 -- 172.21.15.47:0/1035766842 shutdown_connections 2024-04-01T22:34:08.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.550+0000 7f73b456c640 1 --2- 172.21.15.47:0/1035766842 >> v2:172.21.15.47:3300/0 conn(0x7f73ac0ce410 0x7f73ac0cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:08.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.550+0000 7f73b456c640 1 --2- 172.21.15.47:0/1035766842 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f73ac0cbe40 0x7f73ac15a450 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:08.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.550+0000 7f73b456c640 1 -- 172.21.15.47:0/1035766842 >> 172.21.15.47:0/1035766842 conn(0x7f73ac0cfbe0 msgr2=0x7f73ac0cfff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:08.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.550+0000 7f73b456c640 1 -- 172.21.15.47:0/1035766842 shutdown_connections 2024-04-01T22:34:08.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.550+0000 7f73b456c640 1 -- 172.21.15.47:0/1035766842 wait complete. 2024-04-01T22:34:08.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.551+0000 7f73b456c640 1 Processor -- start 2024-04-01T22:34:08.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.551+0000 7f73b456c640 1 -- start start 2024-04-01T22:34:08.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.552+0000 7f73b456c640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f73ac0cbe40 0x7f73ac0c66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:08.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.552+0000 7f73b456c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f73ac0ce410 0x7f73ac1e69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:08.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.552+0000 7f73b456c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f73ac0cf370 0x7f73ac155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:08.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.552+0000 7f73b456c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f73ac0cdc10 con 0x7f73ac0cf370 2024-04-01T22:34:08.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.552+0000 7f73b456c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f73ac15b1e0 con 0x7f73ac0ce410 2024-04-01T22:34:08.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.552+0000 7f73b456c640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f73ac0ce850 con 0x7f73ac0cbe40 2024-04-01T22:34:08.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.552+0000 7f73b1b07640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f73ac0ce410 0x7f73ac1e69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:08.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.552+0000 7f73b2b09640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f73ac0cf370 0x7f73ac155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:08.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.552+0000 7f73b1b07640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f73ac0ce410 0x7f73ac1e69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:45002/0 (socket says 172.21.15.47:45002) 2024-04-01T22:34:08.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.552+0000 7f73b1b07640 1 -- 172.21.15.47:0/4187447723 learned_addr learned my addr 172.21.15.47:0/4187447723 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:08.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.556+0000 7f73b1b07640 1 -- 172.21.15.47:0/4187447723 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f73ac0cbe40 msgr2=0x7f73ac0c66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:08.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.556+0000 7f73b1b07640 1 --2- 172.21.15.47:0/4187447723 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f73ac0cbe40 0x7f73ac0c66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:08.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.556+0000 7f73b1b07640 1 -- 172.21.15.47:0/4187447723 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f73ac0cf370 msgr2=0x7f73ac155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:08.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.556+0000 7f73b1b07640 1 --2- 172.21.15.47:0/4187447723 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f73ac0cf370 0x7f73ac155410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:08.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.556+0000 7f73b1b07640 1 -- 172.21.15.47:0/4187447723 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73ac1f06b0 con 0x7f73ac0ce410 2024-04-01T22:34:08.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.558+0000 7f73b1b07640 1 --2- 172.21.15.47:0/4187447723 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f73ac0ce410 0x7f73ac1e69b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f739c00d860 tx=0x7f739c00dd20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:08.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.562+0000 7f73a2ffd640 1 -- 172.21.15.47:0/4187447723 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f739c00de50 con 0x7f73ac0ce410 2024-04-01T22:34:08.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.562+0000 7f73a2ffd640 1 -- 172.21.15.47:0/4187447723 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f739c019070 con 0x7f73ac0ce410 2024-04-01T22:34:08.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.562+0000 7f73b456c640 1 -- 172.21.15.47:0/4187447723 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73ac0b5800 con 0x7f73ac0ce410 2024-04-01T22:34:08.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.562+0000 7f73a2ffd640 1 -- 172.21.15.47:0/4187447723 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f739c00baf0 con 0x7f73ac0ce410 2024-04-01T22:34:08.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.562+0000 7f73b456c640 1 -- 172.21.15.47:0/4187447723 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73ac1f0c50 con 0x7f73ac0ce410 2024-04-01T22:34:08.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.563+0000 7f73b456c640 1 -- 172.21.15.47:0/4187447723 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73ac068920 con 0x7f73ac0ce410 2024-04-01T22:34:08.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.587+0000 7f73a2ffd640 1 -- 172.21.15.47:0/4187447723 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f739c00bc90 con 0x7f73ac0ce410 2024-04-01T22:34:08.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.587+0000 7f73a2ffd640 1 --2- 172.21.15.47:0/4187447723 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f739006b990 0x7f739006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:08.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.587+0000 7f73b2308640 1 --2- 172.21.15.47:0/4187447723 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f739006b990 0x7f739006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:08.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.588+0000 7f73b2308640 1 --2- 172.21.15.47:0/4187447723 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f739006b990 0x7f739006de50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f73a8036000 tx=0x7f73a8030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:08.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.639+0000 7ff3849e9640 1 Processor -- start 2024-04-01T22:34:08.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.639+0000 7ff3849e9640 1 -- start start 2024-04-01T22:34:08.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.640+0000 7ff3849e9640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff3800c93f0 0x7ff3800cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:08.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.640+0000 7ff3849e9640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff3800cc0d0 0x7ff3800cc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:08.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.640+0000 7ff3849e9640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3800ccaa0 con 0x7ff38015afc0 2024-04-01T22:34:08.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.640+0000 7ff3849e9640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7ff3800cdae0 con 0x7ff3800cc0d0 2024-04-01T22:34:08.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.640+0000 7ff3849e9640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7ff3800c97d0 con 0x7ff3800c93f0 2024-04-01T22:34:08.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.640+0000 7ff37ed9d640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff3800cc0d0 0x7ff3800cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:08.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.641+0000 7ff37ed9d640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff3800cc0d0 0x7ff3800cc560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48066/0 (socket says 172.21.15.47:48066) 2024-04-01T22:34:08.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.641+0000 7ff37ed9d640 1 -- 172.21.15.47:0/1487471677 learned_addr learned my addr 172.21.15.47:0/1487471677 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:08.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.643+0000 7ff37ed9d640 1 -- 172.21.15.47:0/1487471677 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff3800c93f0 msgr2=0x7ff3800cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:08.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.643+0000 7ff37ed9d640 1 --2- 172.21.15.47:0/1487471677 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff3800c93f0 0x7ff3800cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:08.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.643+0000 7ff37ed9d640 1 -- 172.21.15.47:0/1487471677 >> v1:172.21.15.181:6789/0 conn(0x7ff38015afc0 legacy=0x7ff38006c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:08.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.643+0000 7ff37ed9d640 1 -- 172.21.15.47:0/1487471677 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3800cdd80 con 0x7ff3800cc0d0 2024-04-01T22:34:08.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.645+0000 7ff37ed9d640 1 --2- 172.21.15.47:0/1487471677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3800cc0d0 0x7ff3800cc560 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff378009e50 tx=0x7ff37802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e6e89065c12503f server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:08.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.649+0000 7ff37d59a640 1 -- 172.21.15.47:0/1487471677 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff37802c9e0 con 0x7ff3800cc0d0 2024-04-01T22:34:08.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.649+0000 7ff37d59a640 1 -- 172.21.15.47:0/1487471677 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff37802cb80 con 0x7ff3800cc0d0 2024-04-01T22:34:08.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.649+0000 7ff37d59a640 1 -- 172.21.15.47:0/1487471677 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3780343f0 con 0x7ff3800cc0d0 2024-04-01T22:34:08.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.649+0000 7ff3849e9640 1 -- 172.21.15.47:0/1487471677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3800cc0d0 msgr2=0x7ff3800cc560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:08.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.649+0000 7ff3849e9640 1 --2- 172.21.15.47:0/1487471677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3800cc0d0 0x7ff3800cc560 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff378009e50 tx=0x7ff37802be40 comp rx=0 tx=0).stop 2024-04-01T22:34:08.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.649+0000 7ff3849e9640 1 -- 172.21.15.47:0/1487471677 shutdown_connections 2024-04-01T22:34:08.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.649+0000 7ff3849e9640 1 --2- 172.21.15.47:0/1487471677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3800cc0d0 0x7ff3800cc560 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:08.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.649+0000 7ff3849e9640 1 --2- 172.21.15.47:0/1487471677 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff3800c93f0 0x7ff3800cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:08.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.649+0000 7ff3849e9640 1 -- 172.21.15.47:0/1487471677 >> 172.21.15.47:0/1487471677 conn(0x7ff3800cfdb0 msgr2=0x7ff3800d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:08.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.649+0000 7ff3849e9640 1 -- 172.21.15.47:0/1487471677 shutdown_connections 2024-04-01T22:34:08.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.649+0000 7ff3849e9640 1 -- 172.21.15.47:0/1487471677 wait complete. 2024-04-01T22:34:08.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.651+0000 7ff3849e9640 1 Processor -- start 2024-04-01T22:34:08.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.651+0000 7ff3849e9640 1 -- start start 2024-04-01T22:34:08.651 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-01T22:34:08.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.652+0000 7ff3849e9640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff3800c93f0 0x7ff3801f0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:08.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.652+0000 7ff3849e9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff3800cc0d0 0x7ff3801522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:08.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.652+0000 7ff3849e9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff38015afc0 0x7ff3800c3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:08.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.652+0000 7ff3849e9640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff3800ce620 con 0x7ff38015afc0 2024-04-01T22:34:08.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.652+0000 7ff3849e9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff3800ce340 con 0x7ff3800cc0d0 2024-04-01T22:34:08.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.652+0000 7ff3849e9640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7ff38015b400 con 0x7ff3800c93f0 2024-04-01T22:34:08.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.652+0000 7ff37ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff38015afc0 0x7ff3800c3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:08.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.653+0000 7ff37ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff38015afc0 0x7ff3800c3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48076/0 (socket says 172.21.15.47:48076) 2024-04-01T22:34:08.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.653+0000 7ff37ed9d640 1 -- 172.21.15.47:0/3100779243 learned_addr learned my addr 172.21.15.47:0/3100779243 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:08.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.656+0000 7ff37ed9d640 1 -- 172.21.15.47:0/3100779243 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff3800c93f0 msgr2=0x7ff3801f0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:08.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.656+0000 7ff37ed9d640 1 --2- 172.21.15.47:0/3100779243 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff3800c93f0 0x7ff3801f0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:08.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.656+0000 7ff37ed9d640 1 -- 172.21.15.47:0/3100779243 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff3800cc0d0 msgr2=0x7ff3801522c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:08.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.656+0000 7ff37ed9d640 1 --2- 172.21.15.47:0/3100779243 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff3800cc0d0 0x7ff3801522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:08.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.656+0000 7ff37ed9d640 1 -- 172.21.15.47:0/3100779243 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3801f4910 con 0x7ff38015afc0 2024-04-01T22:34:08.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.658+0000 7ff37ed9d640 1 --2- 172.21.15.47:0/3100779243 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff38015afc0 0x7ff3800c3700 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff378009e50 tx=0x7ff378004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:08.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.663+0000 7ff36effd640 1 -- 172.21.15.47:0/3100779243 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff378043020 con 0x7ff38015afc0 2024-04-01T22:34:08.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.663+0000 7ff36effd640 1 -- 172.21.15.47:0/3100779243 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff37803e450 con 0x7ff38015afc0 2024-04-01T22:34:08.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.663+0000 7ff3849e9640 1 -- 172.21.15.47:0/3100779243 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3800c4c40 con 0x7ff38015afc0 2024-04-01T22:34:08.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.663+0000 7ff36effd640 1 -- 172.21.15.47:0/3100779243 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff37803e820 con 0x7ff38015afc0 2024-04-01T22:34:08.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.663+0000 7ff3849e9640 1 -- 172.21.15.47:0/3100779243 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3801f3e30 con 0x7ff38015afc0 2024-04-01T22:34:08.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.665+0000 7ff3849e9640 1 -- 172.21.15.47:0/3100779243 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff380068210 con 0x7ff38015afc0 2024-04-01T22:34:08.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.689+0000 7ff36effd640 1 -- 172.21.15.47:0/3100779243 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7ff378046020 con 0x7ff38015afc0 2024-04-01T22:34:08.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.690+0000 7ff36effd640 1 --2- 172.21.15.47:0/3100779243 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff36006ba10 0x7ff36006ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:08.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.690+0000 7ff37e59c640 1 --2- 172.21.15.47:0/3100779243 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff36006ba10 0x7ff36006ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:08.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.691+0000 7ff37e59c640 1 --2- 172.21.15.47:0/3100779243 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff36006ba10 0x7ff36006ded0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff370009670 tx=0x7ff370006bf0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:08.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.693+0000 7ff36effd640 1 -- 172.21.15.47:0/3100779243 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7ff378079c40 con 0x7ff38015afc0 2024-04-01T22:34:08.720 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-01T22:34:08.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.758+0000 7f7d8be0b640 1 Processor -- start 2024-04-01T22:34:08.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.758+0000 7f7d8be0b640 1 -- start start 2024-04-01T22:34:08.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.759+0000 7f7d8be0b640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7d840cc7e0 0x7f7d8415afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:08.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.759+0000 7f7d8be0b640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d840cdae0 con 0x7f7d840c93f0 2024-04-01T22:34:08.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.759+0000 7f7d8be0b640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d840c97d0 con 0x7f7d840cee30 2024-04-01T22:34:08.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.759+0000 7f7d8be0b640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f7d8415b500 con 0x7f7d840cc7e0 2024-04-01T22:34:08.766 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-01T22:34:08.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.795+0000 7ff8f7fff640 1 -- 172.21.15.47:0/2586673111 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7ff90804d070 con 0x7ff91015afc0 2024-04-01T22:34:08.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.842+0000 7fc47ac8a640 1 Processor -- start 2024-04-01T22:34:08.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.842+0000 7fc47ac8a640 1 -- start start 2024-04-01T22:34:08.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.843+0000 7fc47ac8a640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc47406c610 0x7fc47415aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:08.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.843+0000 7fc47ac8a640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4740cf580 con 0x7fc47406c230 2024-04-01T22:34:08.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.843+0000 7fc47ac8a640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4740cda50 con 0x7fc4740ca790 2024-04-01T22:34:08.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.843+0000 7fc47ac8a640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fc47415b400 con 0x7fc47406c610 2024-04-01T22:34:08.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.845+0000 7f73a2ffd640 1 -- 172.21.15.47:0/4187447723 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f739c057d10 con 0x7f73ac0ce410 2024-04-01T22:34:08.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.870+0000 7f73a2ffd640 1 -- 172.21.15.47:0/4187447723 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f739c05a370 con 0x7f73ac0ce410 2024-04-01T22:34:08.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.871+0000 7fc7abdae640 1 Processor -- start 2024-04-01T22:34:08.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.871+0000 7fc7abdae640 1 -- start start 2024-04-01T22:34:08.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.872+0000 7fc7abdae640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc7a40cee30 0x7fc7a415afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:08.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.872+0000 7fc7abdae640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc7a40cc0d0 0x7fc7a40cc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:08.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.872+0000 7fc7abdae640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7a40cdae0 con 0x7fc7a40c93f0 2024-04-01T22:34:08.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.872+0000 7fc7abdae640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fc7a415b500 con 0x7fc7a40cee30 2024-04-01T22:34:08.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.872+0000 7fc7abdae640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fc7a40cca60 con 0x7fc7a40cc0d0 2024-04-01T22:34:08.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.874+0000 7f7d893a6640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f7d840cee30 0x7f7d840cc0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.47:49576/0 (socket says 172.21.15.47:49576) 2024-04-01T22:34:08.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.874+0000 7f7d893a6640 1 -- 172.21.15.47:0/377576259 learned_addr learned my addr 172.21.15.47:0/377576259 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T22:34:08.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.874+0000 7f7d8a3a8640 1 --2- 172.21.15.47:0/377576259 >> v2:172.21.15.181:3300/0 conn(0x7f7d840cc7e0 0x7f7d8415afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:08.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.875+0000 7fc479227640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fc4740ca790 0x7fc4740cabc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.47:49586/0 (socket says 172.21.15.47:49586) 2024-04-01T22:34:08.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.875+0000 7fc479227640 1 -- 172.21.15.47:0/2417291118 learned_addr learned my addr 172.21.15.47:0/2417291118 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T22:34:08.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.878+0000 7fc7aa34b640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc7a40cc0d0 0x7fc7a40cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:08.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.879+0000 7fc7aa34b640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc7a40cc0d0 0x7fc7a40cc520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:45028/0 (socket says 172.21.15.47:45028) 2024-04-01T22:34:08.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.879+0000 7fc7aa34b640 1 -- 172.21.15.47:0/3489864179 learned_addr learned my addr 172.21.15.47:0/3489864179 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:08.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.881+0000 7f7d8a3a8640 1 -- 172.21.15.47:0/377576259 >> v1:172.21.15.181:6789/0 conn(0x7f7d840cee30 legacy=0x7f7d840cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:08.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.881+0000 7f7d8a3a8640 1 -- 172.21.15.47:0/377576259 >> v1:172.21.15.47:6789/0 conn(0x7f7d840c93f0 legacy=0x7f7d8406c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:08.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.881+0000 7f7d8a3a8640 1 -- 172.21.15.47:0/377576259 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d840cdd80 con 0x7f7d840cc7e0 2024-04-01T22:34:08.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.882+0000 7fc7aa34b640 1 -- 172.21.15.47:0/3489864179 >> v2:172.21.15.47:3300/0 conn(0x7fc7a40cee30 msgr2=0x7fc7a415afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:08.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.882+0000 7fc7aa34b640 1 --2- 172.21.15.47:0/3489864179 >> v2:172.21.15.47:3300/0 conn(0x7fc7a40cee30 0x7fc7a415afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:08.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.882+0000 7fc7aa34b640 1 -- 172.21.15.47:0/3489864179 >> v1:172.21.15.47:6789/0 conn(0x7fc7a40c93f0 legacy=0x7fc7a406c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:08.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.882+0000 7fc7aa34b640 1 -- 172.21.15.47:0/3489864179 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7a40c97d0 con 0x7fc7a40cc0d0 2024-04-01T22:34:08.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.886+0000 7f7d8a3a8640 1 --2- 172.21.15.47:0/377576259 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d840cc7e0 0x7f7d8415afc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c009d90 tx=0x7f7d7c02be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=351b52c55541b75d server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:08.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.887+0000 7fc7aa34b640 1 --2- 172.21.15.47:0/3489864179 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc7a40cc0d0 0x7fc7a40cc520 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc7a408cd20 tx=0x7fc79c02be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6896a47b51b9786 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:08.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.890+0000 7f7d88ba5640 1 -- 172.21.15.47:0/377576259 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c039070 con 0x7f7d840cc7e0 2024-04-01T22:34:08.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.894+0000 7fc7a8b48640 1 -- 172.21.15.47:0/3489864179 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79c02c9e0 con 0x7fc7a40cc0d0 2024-04-01T22:34:08.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.894+0000 7fc7a8b48640 1 -- 172.21.15.47:0/3489864179 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc79c02cb80 con 0x7fc7a40cc0d0 2024-04-01T22:34:08.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.894+0000 7fc7a8b48640 1 -- 172.21.15.47:0/3489864179 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79c0343f0 con 0x7fc7a40cc0d0 2024-04-01T22:34:08.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.895+0000 7fc7abdae640 1 -- 172.21.15.47:0/3489864179 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc7a40cc0d0 msgr2=0x7fc7a40cc520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:08.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.895+0000 7fc7abdae640 1 --2- 172.21.15.47:0/3489864179 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc7a40cc0d0 0x7fc7a40cc520 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc7a408cd20 tx=0x7fc79c02be40 comp rx=0 tx=0).stop 2024-04-01T22:34:08.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.895+0000 7fc7abdae640 1 -- 172.21.15.47:0/3489864179 shutdown_connections 2024-04-01T22:34:08.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.895+0000 7fc7abdae640 1 --2- 172.21.15.47:0/3489864179 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc7a40cc0d0 0x7fc7a40cc520 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:08.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.895+0000 7fc7abdae640 1 --2- 172.21.15.47:0/3489864179 >> v2:172.21.15.47:3300/0 conn(0x7fc7a40cee30 0x7fc7a415afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:08.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.895+0000 7f7d88ba5640 1 -- 172.21.15.47:0/377576259 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d7c02cbd0 con 0x7f7d840cc7e0 2024-04-01T22:34:08.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.895+0000 7f7d88ba5640 1 -- 172.21.15.47:0/377576259 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c034440 con 0x7f7d840cc7e0 2024-04-01T22:34:08.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.895+0000 7fc7abdae640 1 -- 172.21.15.47:0/3489864179 >> 172.21.15.47:0/3489864179 conn(0x7fc7a40cfdb0 msgr2=0x7fc7a40d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:08.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.895+0000 7fc7abdae640 1 -- 172.21.15.47:0/3489864179 shutdown_connections 2024-04-01T22:34:08.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.895+0000 7fc7abdae640 1 -- 172.21.15.47:0/3489864179 wait complete. 2024-04-01T22:34:08.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.896+0000 7f7d8be0b640 1 -- 172.21.15.47:0/377576259 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d840cc7e0 msgr2=0x7f7d8415afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:08.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.896+0000 7f7d8be0b640 1 --2- 172.21.15.47:0/377576259 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d840cc7e0 0x7f7d8415afc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c009d90 tx=0x7f7d7c02be20 comp rx=0 tx=0).stop 2024-04-01T22:34:08.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.896+0000 7f7d8be0b640 1 -- 172.21.15.47:0/377576259 shutdown_connections 2024-04-01T22:34:08.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.896+0000 7f7d8be0b640 1 --2- 172.21.15.47:0/377576259 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d840cc7e0 0x7f7d8415afc0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:08.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.896+0000 7f7d8be0b640 1 -- 172.21.15.47:0/377576259 >> 172.21.15.47:0/377576259 conn(0x7f7d840cfdb0 msgr2=0x7f7d840d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:08.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.896+0000 7f7d8be0b640 1 -- 172.21.15.47:0/377576259 shutdown_connections 2024-04-01T22:34:08.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.896+0000 7f7d8be0b640 1 -- 172.21.15.47:0/377576259 wait complete. 2024-04-01T22:34:08.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.897+0000 7fc7abdae640 1 Processor -- start 2024-04-01T22:34:08.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.897+0000 7fc7abdae640 1 -- start start 2024-04-01T22:34:08.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.897+0000 7fc7abdae640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc7a40c93f0 0x7fc7a40b2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:08.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.897+0000 7fc7abdae640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc7a40cc0d0 0x7fc7a41f1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:08.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.897+0000 7fc7abdae640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7a40cee30 0x7fc7a4157170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:08.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.897+0000 7fc7abdae640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a40ce340 con 0x7fc7a40cee30 2024-04-01T22:34:08.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.897+0000 7fc7abdae640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a40ce060 con 0x7fc7a40cc0d0 2024-04-01T22:34:08.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.897+0000 7fc7abdae640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fc7a40ce620 con 0x7fc7a40c93f0 2024-04-01T22:34:08.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.898+0000 7fc7a9b4a640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc7a40c93f0 0x7fc7a40b2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:08.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.898+0000 7fc7a9b4a640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc7a40c93f0 0x7fc7a40b2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:39694/0 (socket says 172.21.15.47:39694) 2024-04-01T22:34:08.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.898+0000 7fc7a9b4a640 1 -- 172.21.15.47:0/2364299731 learned_addr learned my addr 172.21.15.47:0/2364299731 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:08.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.898+0000 7f7d8be0b640 1 Processor -- start 2024-04-01T22:34:08.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.898+0000 7f7d8be0b640 1 -- start start 2024-04-01T22:34:08.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.899+0000 7fc7a9349640 1 --2- 172.21.15.47:0/2364299731 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc7a40cc0d0 0x7fc7a41f1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:08.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.900+0000 7f7d8be0b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d840c93f0 0x7f7d840c5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:08.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.900+0000 7f7d8be0b640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7d840cc7e0 0x7f7d84153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:08.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.900+0000 7f7d8be0b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d840cee30 0x7f7d84154460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:08.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.900+0000 7f7d8be0b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7d840ce620 con 0x7f7d840c93f0 2024-04-01T22:34:08.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.900+0000 7f7d8be0b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7d840ce340 con 0x7f7d840cee30 2024-04-01T22:34:08.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.900+0000 7f7d8be0b640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f7d840cf430 con 0x7f7d840cc7e0 2024-04-01T22:34:08.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.902+0000 7fc7a9b4a640 1 -- 172.21.15.47:0/2364299731 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc7a40cc0d0 msgr2=0x7fc7a41f1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:08.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.902+0000 7fc7a9b4a640 1 --2- 172.21.15.47:0/2364299731 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc7a40cc0d0 0x7fc7a41f1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:08.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.902+0000 7fc7a9b4a640 1 -- 172.21.15.47:0/2364299731 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7a40cee30 msgr2=0x7fc7a4157170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:08.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.902+0000 7fc7a9b4a640 1 --2- 172.21.15.47:0/2364299731 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7a40cee30 0x7fc7a4157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:08.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.902+0000 7fc7a9b4a640 1 -- 172.21.15.47:0/2364299731 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7a41f0e50 con 0x7fc7a40c93f0 2024-04-01T22:34:08.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.904+0000 7f7d893a6640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7d840cc7e0 0x7f7d84153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:08.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.904+0000 7fc7a9b4a640 1 --2- 172.21.15.47:0/2364299731 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc7a40c93f0 0x7fc7a40b2a10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc7a000c440 tx=0x7fc7a000c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:08.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.905+0000 7f7d8a3a8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d840cee30 0x7f7d84154460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:08.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.905+0000 7f7d8a3a8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d840cee30 0x7f7d84154460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:45048/0 (socket says 172.21.15.47:45048) 2024-04-01T22:34:08.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.905+0000 7f7d8a3a8640 1 -- 172.21.15.47:0/122113887 learned_addr learned my addr 172.21.15.47:0/122113887 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:08.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.908+0000 7f7d8a3a8640 1 -- 172.21.15.47:0/122113887 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7d840cc7e0 msgr2=0x7f7d84153f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:08.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.908+0000 7f7d8a3a8640 1 --2- 172.21.15.47:0/122113887 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7d840cc7e0 0x7f7d84153f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:08.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.908+0000 7f7d8a3a8640 1 -- 172.21.15.47:0/122113887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d840c93f0 msgr2=0x7f7d840c5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:08.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.908+0000 7f7d8a3a8640 1 --2- 172.21.15.47:0/122113887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d840c93f0 0x7f7d840c5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:08.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.908+0000 7f7d8a3a8640 1 -- 172.21.15.47:0/122113887 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d840c47d0 con 0x7f7d840cee30 2024-04-01T22:34:08.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.910+0000 7f7d8a3a8640 1 --2- 172.21.15.47:0/122113887 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d840cee30 0x7f7d84154460 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c009d90 tx=0x7f7d7c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:08.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.913+0000 7fc79a7fc640 1 -- 172.21.15.47:0/2364299731 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a0017070 con 0x7fc7a40c93f0 2024-04-01T22:34:08.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.913+0000 7fc79a7fc640 1 -- 172.21.15.47:0/2364299731 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7a00035f0 con 0x7fc7a40c93f0 2024-04-01T22:34:08.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.913+0000 7fc7abdae640 1 -- 172.21.15.47:0/2364299731 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7a41560d0 con 0x7fc7a40c93f0 2024-04-01T22:34:08.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.913+0000 7fc79a7fc640 1 -- 172.21.15.47:0/2364299731 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a00039e0 con 0x7fc7a40c93f0 2024-04-01T22:34:08.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.913+0000 7fc7abdae640 1 -- 172.21.15.47:0/2364299731 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7a4156970 con 0x7fc7a40c93f0 2024-04-01T22:34:08.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.914+0000 7f7d7a7fc640 1 -- 172.21.15.47:0/122113887 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c039050 con 0x7f7d840cee30 2024-04-01T22:34:08.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.914+0000 7f7d7a7fc640 1 -- 172.21.15.47:0/122113887 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d7c03a040 con 0x7f7d840cee30 2024-04-01T22:34:08.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.914+0000 7f7d7a7fc640 1 -- 172.21.15.47:0/122113887 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c03e610 con 0x7f7d840cee30 2024-04-01T22:34:08.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.914+0000 7f7d8be0b640 1 -- 172.21.15.47:0/122113887 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d840c4a90 con 0x7f7d840cee30 2024-04-01T22:34:08.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.914+0000 7f7d8be0b640 1 -- 172.21.15.47:0/122113887 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d840c3a80 con 0x7f7d840cee30 2024-04-01T22:34:08.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.914+0000 7fc7abdae640 1 -- 172.21.15.47:0/2364299731 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7a4068210 con 0x7fc7a40c93f0 2024-04-01T22:34:08.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.916+0000 7f7d8be0b640 1 -- 172.21.15.47:0/122113887 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d84068210 con 0x7f7d840cee30 2024-04-01T22:34:08.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.939+0000 7f7d7a7fc640 1 -- 172.21.15.47:0/122113887 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f7d7c047020 con 0x7f7d840cee30 2024-04-01T22:34:08.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.939+0000 7f7d7a7fc640 1 --2- 172.21.15.47:0/122113887 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f7d6806b990 0x7f7d6806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:08.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.940+0000 7f7d89ba7640 1 --2- 172.21.15.47:0/122113887 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f7d6806b990 0x7f7d6806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:08.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.940+0000 7f7d89ba7640 1 --2- 172.21.15.47:0/122113887 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f7d6806b990 0x7f7d6806de50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7d80001560 tx=0x7f7d80007990 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:08.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:08.942+0000 7f7d7a7fc640 1 -- 172.21.15.47:0/122113887 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f7d7c079cc0 con 0x7f7d840cee30 2024-04-01T22:34:09.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.056+0000 7ff36effd640 1 -- 172.21.15.47:0/3100779243 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7ff37804d070 con 0x7ff38015afc0 2024-04-01T22:34:09.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.059+0000 7f73b456c640 1 -- 172.21.15.47:0/4187447723 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f73ac0cf7e0 con 0x7f73ac0ce410 2024-04-01T22:34:09.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.070+0000 7fc473fff640 1 --2- 172.21.15.47:0/2417291118 >> v2:172.21.15.47:3300/0 conn(0x7fc47406c610 0x7fc47415aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:09.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.073+0000 7ff915ffd640 1 -- 172.21.15.47:0/2586673111 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7ff91006cf00 con 0x7ff91015afc0 2024-04-01T22:34:09.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.073+0000 7fc4737fe640 1 -- 172.21.15.47:0/2417291118 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2322719015 0 0) 0x7fc468001110 con 0x7fc47406c230 2024-04-01T22:34:09.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.073+0000 7fc4737fe640 1 -- 172.21.15.47:0/2417291118 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc464003520 con 0x7fc47406c230 2024-04-01T22:34:09.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.075+0000 7fc473fff640 1 -- 172.21.15.47:0/2417291118 >> v1:172.21.15.181:6789/0 conn(0x7fc4740ca790 legacy=0x7fc4740cabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:09.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.075+0000 7fc473fff640 1 -- 172.21.15.47:0/2417291118 >> v1:172.21.15.47:6789/0 conn(0x7fc47406c230 legacy=0x7fc4740cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:09.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.075+0000 7fc473fff640 1 -- 172.21.15.47:0/2417291118 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4740cdd30 con 0x7fc47406c610 2024-04-01T22:34:09.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.077+0000 7fc473fff640 1 --2- 172.21.15.47:0/2417291118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc47406c610 0x7fc47415aec0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc4600097a0 tx=0x7fc46002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f8cadb59b8ebaa0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:09.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.085+0000 7fc4737fe640 1 -- 172.21.15.47:0/2417291118 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc460035020 con 0x7fc47406c610 2024-04-01T22:34:09.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.086+0000 7fc4737fe640 1 -- 172.21.15.47:0/2417291118 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc460031830 con 0x7fc47406c610 2024-04-01T22:34:09.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.086+0000 7fc4737fe640 1 -- 172.21.15.47:0/2417291118 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc460031c00 con 0x7fc47406c610 2024-04-01T22:34:09.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.086+0000 7fc47ac8a640 1 -- 172.21.15.47:0/2417291118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc47406c610 msgr2=0x7fc47415aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:09.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.086+0000 7fc47ac8a640 1 --2- 172.21.15.47:0/2417291118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc47406c610 0x7fc47415aec0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc4600097a0 tx=0x7fc46002b8d0 comp rx=0 tx=0).stop 2024-04-01T22:34:09.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.087+0000 7fc47ac8a640 1 -- 172.21.15.47:0/2417291118 shutdown_connections 2024-04-01T22:34:09.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.087+0000 7fc47ac8a640 1 --2- 172.21.15.47:0/2417291118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc47406c610 0x7fc47415aec0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:09.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.087+0000 7fc47ac8a640 1 -- 172.21.15.47:0/2417291118 >> 172.21.15.47:0/2417291118 conn(0x7fc4740cfdb0 msgr2=0x7fc4740d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:09.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.087+0000 7fc47ac8a640 1 -- 172.21.15.47:0/2417291118 shutdown_connections 2024-04-01T22:34:09.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.087+0000 7fc47ac8a640 1 -- 172.21.15.47:0/2417291118 wait complete. 2024-04-01T22:34:09.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.088+0000 7fc47ac8a640 1 Processor -- start 2024-04-01T22:34:09.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.089+0000 7fc47ac8a640 1 -- start start 2024-04-01T22:34:09.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.090+0000 7fc47ac8a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc47406c230 0x7fc474155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:09.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.090+0000 7fc47ac8a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc47406c610 0x7fc4741e3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:09.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.090+0000 7fc47ac8a640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc4740ca790 0x7fc474156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:09.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.090+0000 7fc47ac8a640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc4740ce5d0 con 0x7fc47406c230 2024-04-01T22:34:09.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.090+0000 7fc47ac8a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc4740ce2f0 con 0x7fc47406c610 2024-04-01T22:34:09.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.090+0000 7fc47ac8a640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fc47406ca80 con 0x7fc4740ca790 2024-04-01T22:34:09.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.105+0000 7fc478a26640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc47406c230 0x7fc474155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:09.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.106+0000 7fc478a26640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc47406c230 0x7fc474155aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48116/0 (socket says 172.21.15.47:48116) 2024-04-01T22:34:09.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.106+0000 7fc478a26640 1 -- 172.21.15.47:0/1072730075 learned_addr learned my addr 172.21.15.47:0/1072730075 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:09.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.155+0000 7fc478a26640 1 -- 172.21.15.47:0/1072730075 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc4740ca790 msgr2=0x7fc474156560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:09.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.155+0000 7fc478a26640 1 --2- 172.21.15.47:0/1072730075 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc4740ca790 0x7fc474156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:09.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.155+0000 7fc478a26640 1 -- 172.21.15.47:0/1072730075 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc47406c610 msgr2=0x7fc4741e3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:09.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.155+0000 7fc478a26640 1 --2- 172.21.15.47:0/1072730075 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc47406c610 0x7fc4741e3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:09.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.155+0000 7fc478a26640 1 -- 172.21.15.47:0/1072730075 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc474158240 con 0x7fc47406c230 2024-04-01T22:34:09.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.160+0000 7fc478a26640 1 --2- 172.21.15.47:0/1072730075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc47406c230 0x7fc474155aa0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc46800c700 tx=0x7fc46800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:09.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.165+0000 7fc4717fa640 1 -- 172.21.15.47:0/1072730075 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4680050d0 con 0x7fc47406c230 2024-04-01T22:34:09.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.165+0000 7fc4717fa640 1 -- 172.21.15.47:0/1072730075 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc468005290 con 0x7fc47406c230 2024-04-01T22:34:09.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.165+0000 7fc47ac8a640 1 -- 172.21.15.47:0/1072730075 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc474158520 con 0x7fc47406c230 2024-04-01T22:34:09.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.165+0000 7fc4717fa640 1 -- 172.21.15.47:0/1072730075 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc46800a640 con 0x7fc47406c230 2024-04-01T22:34:09.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.166+0000 7fc47ac8a640 1 -- 172.21.15.47:0/1072730075 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4741e2450 con 0x7fc47406c230 2024-04-01T22:34:09.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.167+0000 7fc47ac8a640 1 -- 172.21.15.47:0/1072730075 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc474068210 con 0x7fc47406c230 2024-04-01T22:34:09.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.185+0000 7fc4717fa640 1 -- 172.21.15.47:0/1072730075 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7fc46800a7e0 con 0x7fc47406c230 2024-04-01T22:34:09.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.185+0000 7fc4717fa640 1 --2- 172.21.15.47:0/1072730075 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fc45806b9e0 0x7fc45806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:09.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.186+0000 7fc473fff640 1 --2- 172.21.15.47:0/1072730075 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fc45806b9e0 0x7fc45806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:09.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.186+0000 7fc473fff640 1 --2- 172.21.15.47:0/1072730075 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fc45806b9e0 0x7fc45806dea0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc460036000 tx=0x7fc460030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:09.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.186+0000 7fc79a7fc640 1 -- 172.21.15.47:0/2364299731 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7fc7a0003b80 con 0x7fc7a40c93f0 2024-04-01T22:34:09.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.187+0000 7fc79a7fc640 1 --2- 172.21.15.47:0/2364299731 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fc78806b990 0x7fc78806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:09.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.187+0000 7fc7a9349640 1 --2- 172.21.15.47:0/2364299731 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fc78806b990 0x7fc78806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:09.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.187+0000 7fc7a9349640 1 --2- 172.21.15.47:0/2364299731 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fc78806b990 0x7fc78806de50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc7a40cd290 tx=0x7fc794009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:09.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.189+0000 7fc4717fa640 1 -- 172.21.15.47:0/1072730075 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fc468057550 con 0x7fc47406c230 2024-04-01T22:34:09.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.189+0000 7fc79a7fc640 1 -- 172.21.15.47:0/2364299731 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fc7a0056330 con 0x7fc7a40c93f0 2024-04-01T22:34:09.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.204+0000 7f7d7a7fc640 1 -- 172.21.15.47:0/122113887 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f7d7c04e020 con 0x7f7d840cee30 2024-04-01T22:34:09.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.204+0000 7fc79a7fc640 1 -- 172.21.15.47:0/2364299731 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc7a0020080 con 0x7fc7a40c93f0 2024-04-01T22:34:09.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.217+0000 7f73a2ffd640 1 -- 172.21.15.47:0/4187447723 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f739c059c70 con 0x7f73ac0ce410 2024-04-01T22:34:09.216 INFO:teuthology.orchestra.run.smithi047.stdout:55834574862 2024-04-01T22:34:09.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.219+0000 7f73b456c640 1 -- 172.21.15.47:0/4187447723 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f739006b990 msgr2=0x7f739006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:09.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.219+0000 7f73b456c640 1 --2- 172.21.15.47:0/4187447723 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f739006b990 0x7f739006de50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f73a8036000 tx=0x7f73a8030000 comp rx=0 tx=0).stop 2024-04-01T22:34:09.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.219+0000 7f73b456c640 1 -- 172.21.15.47:0/4187447723 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f73ac0ce410 msgr2=0x7f73ac1e69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:09.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.219+0000 7f73b456c640 1 --2- 172.21.15.47:0/4187447723 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f73ac0ce410 0x7f73ac1e69b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f739c00d860 tx=0x7f739c00dd20 comp rx=0 tx=0).stop 2024-04-01T22:34:09.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.219+0000 7f73b456c640 1 -- 172.21.15.47:0/4187447723 shutdown_connections 2024-04-01T22:34:09.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.219+0000 7f73b456c640 1 --2- 172.21.15.47:0/4187447723 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f739006b990 0x7f739006de50 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:09.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.219+0000 7f73b456c640 1 --2- 172.21.15.47:0/4187447723 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f73ac0cf370 0x7f73ac155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:09.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.219+0000 7f73b456c640 1 --2- 172.21.15.47:0/4187447723 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f73ac0ce410 0x7f73ac1e69b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:09.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.219+0000 7f73b456c640 1 --2- 172.21.15.47:0/4187447723 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f73ac0cbe40 0x7f73ac0c66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:09.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.219+0000 7f73b456c640 1 -- 172.21.15.47:0/4187447723 >> 172.21.15.47:0/4187447723 conn(0x7f73ac0cfbe0 msgr2=0x7f73ac0742d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:09.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.219+0000 7f73b456c640 1 -- 172.21.15.47:0/4187447723 shutdown_connections 2024-04-01T22:34:09.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.219+0000 7f73b456c640 1 -- 172.21.15.47:0/4187447723 wait complete. 2024-04-01T22:34:09.230 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574862 for osd.3 2024-04-01T22:34:09.231 DEBUG:teuthology.parallel:result is None 2024-04-01T22:34:09.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.285+0000 7ff8f7fff640 1 -- 172.21.15.47:0/2586673111 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff90807b7f0 con 0x7ff91015afc0 2024-04-01T22:34:09.285 INFO:teuthology.orchestra.run.smithi047.stdout:55834574862 2024-04-01T22:34:09.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.287+0000 7ff915ffd640 1 -- 172.21.15.47:0/2586673111 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff8fc06b9c0 msgr2=0x7ff8fc06de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:09.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.287+0000 7ff915ffd640 1 --2- 172.21.15.47:0/2586673111 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff8fc06b9c0 0x7ff8fc06de80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff900009ac0 tx=0x7ff900009190 comp rx=0 tx=0).stop 2024-04-01T22:34:09.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.287+0000 7ff915ffd640 1 -- 172.21.15.47:0/2586673111 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff91015afc0 msgr2=0x7ff9101e6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:09.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.287+0000 7ff915ffd640 1 --2- 172.21.15.47:0/2586673111 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff91015afc0 0x7ff9101e6aa0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff908032000 tx=0x7ff908004a40 comp rx=0 tx=0).stop 2024-04-01T22:34:09.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.287+0000 7ff915ffd640 1 -- 172.21.15.47:0/2586673111 shutdown_connections 2024-04-01T22:34:09.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.287+0000 7ff915ffd640 1 --2- 172.21.15.47:0/2586673111 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff8fc06b9c0 0x7ff8fc06de80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:09.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.287+0000 7ff915ffd640 1 --2- 172.21.15.47:0/2586673111 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff91015afc0 0x7ff9101e6aa0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:09.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.287+0000 7ff915ffd640 1 --2- 172.21.15.47:0/2586673111 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9100c93f0 0x7ff9101f3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:09.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.287+0000 7ff915ffd640 1 --2- 172.21.15.47:0/2586673111 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff91006c770 0x7ff9100ae540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:09.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.287+0000 7ff915ffd640 1 -- 172.21.15.47:0/2586673111 >> 172.21.15.47:0/2586673111 conn(0x7ff9100cfdb0 msgr2=0x7ff9100cb2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:09.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.287+0000 7ff915ffd640 1 -- 172.21.15.47:0/2586673111 shutdown_connections 2024-04-01T22:34:09.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.287+0000 7ff915ffd640 1 -- 172.21.15.47:0/2586673111 wait complete. 2024-04-01T22:34:09.298 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574862 for osd.0 2024-04-01T22:34:09.298 DEBUG:teuthology.parallel:result is None 2024-04-01T22:34:09.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.351+0000 7ff3849e9640 1 -- 172.21.15.47:0/3100779243 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7ff3800c9c50 con 0x7ff38015afc0 2024-04-01T22:34:09.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.451+0000 7fc4717fa640 1 -- 172.21.15.47:0/1072730075 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc4740cf580 con 0x7fc47406c230 2024-04-01T22:34:09.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.465+0000 7fc7abdae640 1 -- 172.21.15.47:0/2364299731 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fc7a406cf00 con 0x7fc7a40c93f0 2024-04-01T22:34:09.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.468+0000 7fc79a7fc640 1 -- 172.21.15.47:0/2364299731 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc7a00010c0 con 0x7fc7a40c93f0 2024-04-01T22:34:09.468 INFO:teuthology.orchestra.run.smithi047.stdout:55834574861 2024-04-01T22:34:09.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.470+0000 7fc7abdae640 1 -- 172.21.15.47:0/2364299731 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fc78806b990 msgr2=0x7fc78806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:09.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.470+0000 7fc7abdae640 1 --2- 172.21.15.47:0/2364299731 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fc78806b990 0x7fc78806de50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc7a40cd290 tx=0x7fc794009060 comp rx=0 tx=0).stop 2024-04-01T22:34:09.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.470+0000 7fc7abdae640 1 -- 172.21.15.47:0/2364299731 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc7a40c93f0 msgr2=0x7fc7a40b2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:09.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.470+0000 7fc7abdae640 1 --2- 172.21.15.47:0/2364299731 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc7a40c93f0 0x7fc7a40b2a10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc7a000c440 tx=0x7fc7a000c900 comp rx=0 tx=0).stop 2024-04-01T22:34:09.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.470+0000 7fc7abdae640 1 -- 172.21.15.47:0/2364299731 shutdown_connections 2024-04-01T22:34:09.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.470+0000 7fc7abdae640 1 --2- 172.21.15.47:0/2364299731 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fc78806b990 0x7fc78806de50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:09.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.470+0000 7fc7abdae640 1 --2- 172.21.15.47:0/2364299731 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7a40cee30 0x7fc7a4157170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:09.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.470+0000 7fc7abdae640 1 --2- 172.21.15.47:0/2364299731 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc7a40cc0d0 0x7fc7a41f1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:09.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.471+0000 7fc7abdae640 1 --2- 172.21.15.47:0/2364299731 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc7a40c93f0 0x7fc7a40b2a10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:09.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.471+0000 7fc7abdae640 1 -- 172.21.15.47:0/2364299731 >> 172.21.15.47:0/2364299731 conn(0x7fc7a40cfdb0 msgr2=0x7fc7a40d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:09.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.471+0000 7fc7abdae640 1 -- 172.21.15.47:0/2364299731 shutdown_connections 2024-04-01T22:34:09.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.471+0000 7fc7abdae640 1 -- 172.21.15.47:0/2364299731 wait complete. 2024-04-01T22:34:09.481 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574861 for osd.1 2024-04-01T22:34:09.481 DEBUG:teuthology.parallel:result is None 2024-04-01T22:34:09.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.543+0000 7ff36effd640 1 -- 172.21.15.47:0/3100779243 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff37807c2a0 con 0x7ff38015afc0 2024-04-01T22:34:09.543 INFO:teuthology.orchestra.run.smithi047.stdout:55834574862 2024-04-01T22:34:09.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.546+0000 7ff3849e9640 1 -- 172.21.15.47:0/3100779243 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff36006ba10 msgr2=0x7ff36006ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:09.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.546+0000 7ff3849e9640 1 --2- 172.21.15.47:0/3100779243 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff36006ba10 0x7ff36006ded0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff370009670 tx=0x7ff370006bf0 comp rx=0 tx=0).stop 2024-04-01T22:34:09.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.546+0000 7ff3849e9640 1 -- 172.21.15.47:0/3100779243 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff38015afc0 msgr2=0x7ff3800c3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:09.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.546+0000 7ff3849e9640 1 --2- 172.21.15.47:0/3100779243 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff38015afc0 0x7ff3800c3700 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff378009e50 tx=0x7ff378004a40 comp rx=0 tx=0).stop 2024-04-01T22:34:09.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.546+0000 7ff3849e9640 1 -- 172.21.15.47:0/3100779243 shutdown_connections 2024-04-01T22:34:09.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.546+0000 7ff3849e9640 1 --2- 172.21.15.47:0/3100779243 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff36006ba10 0x7ff36006ded0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:09.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.546+0000 7ff3849e9640 1 --2- 172.21.15.47:0/3100779243 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff38015afc0 0x7ff3800c3700 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:09.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.546+0000 7ff3849e9640 1 --2- 172.21.15.47:0/3100779243 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff3800cc0d0 0x7ff3801522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:09.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.546+0000 7ff3849e9640 1 --2- 172.21.15.47:0/3100779243 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff3800c93f0 0x7ff3801f0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:09.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.546+0000 7ff3849e9640 1 -- 172.21.15.47:0/3100779243 >> 172.21.15.47:0/3100779243 conn(0x7ff3800cfdb0 msgr2=0x7ff3800c7ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:09.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.546+0000 7ff3849e9640 1 -- 172.21.15.47:0/3100779243 shutdown_connections 2024-04-01T22:34:09.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.546+0000 7ff3849e9640 1 -- 172.21.15.47:0/3100779243 wait complete. 2024-04-01T22:34:09.560 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574862 for osd.4 2024-04-01T22:34:09.560 DEBUG:teuthology.parallel:result is None 2024-04-01T22:34:09.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.571+0000 7f7d8be0b640 1 -- 172.21.15.47:0/122113887 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f7d841eff70 con 0x7f7d840cee30 2024-04-01T22:34:09.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.576+0000 7f7d7a7fc640 1 -- 172.21.15.47:0/122113887 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7d7c07c320 con 0x7f7d840cee30 2024-04-01T22:34:09.576 INFO:teuthology.orchestra.run.smithi047.stdout:55834574862 2024-04-01T22:34:09.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.579+0000 7f7d8be0b640 1 -- 172.21.15.47:0/122113887 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f7d6806b990 msgr2=0x7f7d6806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:09.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.579+0000 7f7d8be0b640 1 --2- 172.21.15.47:0/122113887 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f7d6806b990 0x7f7d6806de50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7d80001560 tx=0x7f7d80007990 comp rx=0 tx=0).stop 2024-04-01T22:34:09.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.579+0000 7f7d8be0b640 1 -- 172.21.15.47:0/122113887 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d840cee30 msgr2=0x7f7d84154460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:09.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.579+0000 7f7d8be0b640 1 --2- 172.21.15.47:0/122113887 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d840cee30 0x7f7d84154460 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c009d90 tx=0x7f7d7c004a40 comp rx=0 tx=0).stop 2024-04-01T22:34:09.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.579+0000 7f7d8be0b640 1 -- 172.21.15.47:0/122113887 shutdown_connections 2024-04-01T22:34:09.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.579+0000 7f7d8be0b640 1 --2- 172.21.15.47:0/122113887 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f7d6806b990 0x7f7d6806de50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:09.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.579+0000 7f7d8be0b640 1 --2- 172.21.15.47:0/122113887 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d840cee30 0x7f7d84154460 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:09.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.579+0000 7f7d8be0b640 1 --2- 172.21.15.47:0/122113887 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7d840cc7e0 0x7f7d84153f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:09.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.579+0000 7f7d8be0b640 1 --2- 172.21.15.47:0/122113887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d840c93f0 0x7f7d840c5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:09.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.579+0000 7f7d8be0b640 1 -- 172.21.15.47:0/122113887 >> 172.21.15.47:0/122113887 conn(0x7f7d840cfdb0 msgr2=0x7f7d84159eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:09.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.579+0000 7f7d8be0b640 1 -- 172.21.15.47:0/122113887 shutdown_connections 2024-04-01T22:34:09.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.579+0000 7f7d8be0b640 1 -- 172.21.15.47:0/122113887 wait complete. 2024-04-01T22:34:09.590 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574862 for osd.6 2024-04-01T22:34:09.590 DEBUG:teuthology.parallel:result is None 2024-04-01T22:34:09.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.659+0000 7fc47ac8a640 1 -- 172.21.15.47:0/1072730075 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fc4740c9fe0 con 0x7fc47406c230 2024-04-01T22:34:09.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.664+0000 7fc4717fa640 1 -- 172.21.15.47:0/1072730075 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc468059bb0 con 0x7fc47406c230 2024-04-01T22:34:09.664 INFO:teuthology.orchestra.run.smithi047.stdout:55834574862 2024-04-01T22:34:09.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.666+0000 7fc47ac8a640 1 -- 172.21.15.47:0/1072730075 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fc45806b9e0 msgr2=0x7fc45806dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:09.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.666+0000 7fc47ac8a640 1 --2- 172.21.15.47:0/1072730075 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fc45806b9e0 0x7fc45806dea0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc460036000 tx=0x7fc460030000 comp rx=0 tx=0).stop 2024-04-01T22:34:09.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.666+0000 7fc47ac8a640 1 -- 172.21.15.47:0/1072730075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc47406c230 msgr2=0x7fc474155aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:09.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.666+0000 7fc47ac8a640 1 --2- 172.21.15.47:0/1072730075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc47406c230 0x7fc474155aa0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc46800c700 tx=0x7fc46800cbc0 comp rx=0 tx=0).stop 2024-04-01T22:34:09.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.666+0000 7fc47ac8a640 1 -- 172.21.15.47:0/1072730075 shutdown_connections 2024-04-01T22:34:09.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.666+0000 7fc47ac8a640 1 --2- 172.21.15.47:0/1072730075 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fc45806b9e0 0x7fc45806dea0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:09.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.666+0000 7fc47ac8a640 1 --2- 172.21.15.47:0/1072730075 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fc4740ca790 0x7fc474156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:09.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.666+0000 7fc47ac8a640 1 --2- 172.21.15.47:0/1072730075 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc47406c610 0x7fc4741e3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:09.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.666+0000 7fc47ac8a640 1 --2- 172.21.15.47:0/1072730075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc47406c230 0x7fc474155aa0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:09.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.666+0000 7fc47ac8a640 1 -- 172.21.15.47:0/1072730075 >> 172.21.15.47:0/1072730075 conn(0x7fc4740cfdb0 msgr2=0x7fc4740c97d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:09.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.667+0000 7fc47ac8a640 1 -- 172.21.15.47:0/1072730075 shutdown_connections 2024-04-01T22:34:09.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.667+0000 7fc47ac8a640 1 -- 172.21.15.47:0/1072730075 wait complete. 2024-04-01T22:34:09.681 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574862 for osd.7 2024-04-01T22:34:09.681 DEBUG:teuthology.parallel:result is None 2024-04-01T22:34:09.681 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-01T22:34:09.681 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T22:34:09.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.783+0000 7fab7a925640 1 Processor -- start 2024-04-01T22:34:09.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.783+0000 7fab7a925640 1 -- start start 2024-04-01T22:34:09.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.784+0000 7fab7a925640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fab7406c250 0x7fab7415aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:09.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.784+0000 7fab7a925640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fab7406c630 0x7fab740ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:09.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.784+0000 7fab7a925640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab74154b70 con 0x7fab740cf0d0 2024-04-01T22:34:09.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.784+0000 7fab7a925640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fab740ce990 con 0x7fab7406c630 2024-04-01T22:34:09.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.784+0000 7fab7a925640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fab740cdac0 con 0x7fab7406c250 2024-04-01T22:34:09.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.784+0000 7fab737fe640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fab7406c630 0x7fab740ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:09.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.784+0000 7fab73fff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fab7406c250 0x7fab7415aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:09.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.785+0000 7fab737fe640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fab7406c630 0x7fab740ceb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34752/0 (socket says 172.21.15.47:34752) 2024-04-01T22:34:09.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.785+0000 7fab737fe640 1 -- 172.21.15.47:0/3778283220 learned_addr learned my addr 172.21.15.47:0/3778283220 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:09.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.787+0000 7fab73fff640 1 -- 172.21.15.47:0/3778283220 >> v2:172.21.15.47:3300/0 conn(0x7fab7406c630 msgr2=0x7fab740ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:09.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.787+0000 7fab73fff640 1 --2- 172.21.15.47:0/3778283220 >> v2:172.21.15.47:3300/0 conn(0x7fab7406c630 0x7fab740ceb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:09.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.787+0000 7fab73fff640 1 -- 172.21.15.47:0/3778283220 >> v1:172.21.15.47:6789/0 conn(0x7fab740cf0d0 legacy=0x7fab7415bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:09.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.787+0000 7fab73fff640 1 -- 172.21.15.47:0/3778283220 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab740cdd80 con 0x7fab7406c250 2024-04-01T22:34:09.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.789+0000 7fab73fff640 1 --2- 172.21.15.47:0/3778283220 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fab7406c250 0x7fab7415aec0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fab640097a0 tx=0x7fab6402b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c3c98deabbfb2ac server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:09.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.793+0000 7fab72ffd640 1 -- 172.21.15.47:0/3778283220 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab64034070 con 0x7fab7406c250 2024-04-01T22:34:09.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.793+0000 7fab72ffd640 1 -- 172.21.15.47:0/3778283220 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab64030610 con 0x7fab7406c250 2024-04-01T22:34:09.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.793+0000 7fab72ffd640 1 -- 172.21.15.47:0/3778283220 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab640309e0 con 0x7fab7406c250 2024-04-01T22:34:09.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.793+0000 7fab7a925640 1 -- 172.21.15.47:0/3778283220 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fab7406c250 msgr2=0x7fab7415aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:09.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.793+0000 7fab7a925640 1 --2- 172.21.15.47:0/3778283220 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fab7406c250 0x7fab7415aec0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fab640097a0 tx=0x7fab6402b960 comp rx=0 tx=0).stop 2024-04-01T22:34:09.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.793+0000 7fab7a925640 1 -- 172.21.15.47:0/3778283220 shutdown_connections 2024-04-01T22:34:09.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.793+0000 7fab7a925640 1 --2- 172.21.15.47:0/3778283220 >> v2:172.21.15.47:3300/0 conn(0x7fab7406c630 0x7fab740ceb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:09.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.793+0000 7fab7a925640 1 --2- 172.21.15.47:0/3778283220 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fab7406c250 0x7fab7415aec0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:09.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.793+0000 7fab7a925640 1 -- 172.21.15.47:0/3778283220 >> 172.21.15.47:0/3778283220 conn(0x7fab740cfdb0 msgr2=0x7fab740d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:09.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.793+0000 7fab7a925640 1 -- 172.21.15.47:0/3778283220 shutdown_connections 2024-04-01T22:34:09.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.794+0000 7fab7a925640 1 -- 172.21.15.47:0/3778283220 wait complete. 2024-04-01T22:34:09.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.795+0000 7fab7a925640 1 Processor -- start 2024-04-01T22:34:09.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.795+0000 7fab7a925640 1 -- start start 2024-04-01T22:34:09.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.795+0000 7fab7a925640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab7406c250 0x7fab740c6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:09.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.795+0000 7fab7a925640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fab7406c630 0x7fab74152e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:09.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.795+0000 7fab7a925640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab741f1f10 0x7fab741f23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:09.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.795+0000 7fab7a925640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fab740ce620 con 0x7fab741f1f10 2024-04-01T22:34:09.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.795+0000 7fab7a925640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fab740ce340 con 0x7fab7406c250 2024-04-01T22:34:09.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.795+0000 7fab7a925640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fab7406ca30 con 0x7fab7406c630 2024-04-01T22:34:09.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.796+0000 7fab78ec2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab741f1f10 0x7fab741f23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:09.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.796+0000 7fab73fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab7406c250 0x7fab740c6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:09.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.796+0000 7fab737fe640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fab7406c630 0x7fab74152e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:09.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.797+0000 7fab78ec2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab741f1f10 0x7fab741f23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34762/0 (socket says 172.21.15.47:34762) 2024-04-01T22:34:09.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.797+0000 7fab78ec2640 1 -- 172.21.15.47:0/1556761899 learned_addr learned my addr 172.21.15.47:0/1556761899 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:09.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.800+0000 7fab78ec2640 1 -- 172.21.15.47:0/1556761899 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fab7406c630 msgr2=0x7fab74152e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:09.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.800+0000 7fab78ec2640 1 --2- 172.21.15.47:0/1556761899 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fab7406c630 0x7fab74152e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:09.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.800+0000 7fab78ec2640 1 -- 172.21.15.47:0/1556761899 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab7406c250 msgr2=0x7fab740c6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:09.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.800+0000 7fab78ec2640 1 --2- 172.21.15.47:0/1556761899 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab7406c250 0x7fab740c6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:09.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.800+0000 7fab78ec2640 1 -- 172.21.15.47:0/1556761899 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab741f28e0 con 0x7fab741f1f10 2024-04-01T22:34:09.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.802+0000 7fab78ec2640 1 --2- 172.21.15.47:0/1556761899 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab741f1f10 0x7fab741f23a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fab6c00c680 tx=0x7fab6c00cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:09.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.806+0000 7fab70ff9640 1 -- 172.21.15.47:0/1556761899 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab6c003b70 con 0x7fab741f1f10 2024-04-01T22:34:09.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.806+0000 7fab70ff9640 1 -- 172.21.15.47:0/1556761899 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab6c003d10 con 0x7fab741f1f10 2024-04-01T22:34:09.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.806+0000 7fab70ff9640 1 -- 172.21.15.47:0/1556761899 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab6c005310 con 0x7fab741f1f10 2024-04-01T22:34:09.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.806+0000 7fab7a925640 1 -- 172.21.15.47:0/1556761899 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab740b1130 con 0x7fab741f1f10 2024-04-01T22:34:09.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.806+0000 7fab7a925640 1 -- 172.21.15.47:0/1556761899 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab740b16f0 con 0x7fab741f1f10 2024-04-01T22:34:09.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.807+0000 7fab7a925640 1 -- 172.21.15.47:0/1556761899 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab74068210 con 0x7fab741f1f10 2024-04-01T22:34:09.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.826+0000 7fab70ff9640 1 -- 172.21.15.47:0/1556761899 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7fab6c0054b0 con 0x7fab741f1f10 2024-04-01T22:34:09.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.826+0000 7fab70ff9640 1 --2- 172.21.15.47:0/1556761899 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fab5406ba10 0x7fab5406ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:09.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.826+0000 7fab73fff640 1 --2- 172.21.15.47:0/1556761899 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fab5406ba10 0x7fab5406ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:09.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.827+0000 7fab73fff640 1 --2- 172.21.15.47:0/1556761899 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fab5406ba10 0x7fab5406ded0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fab64036000 tx=0x7fab6403b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:09.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:09.829+0000 7fab70ff9640 1 -- 172.21.15.47:0/1556761899 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fab6c0057a0 con 0x7fab741f1f10 2024-04-01T22:34:10.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.087+0000 7fab70ff9640 1 -- 172.21.15.47:0/1556761899 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fab6c059560 con 0x7fab741f1f10 2024-04-01T22:34:10.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.300+0000 7fab7a925640 1 -- 172.21.15.47:0/1556761899 --> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fab740b5b50 con 0x7fab5406ba10 2024-04-01T22:34:10.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.308+0000 7fab70ff9640 1 -- 172.21.15.47:0/1556761899 <== mgr.4107 v2:172.21.15.47:6800/1257047371 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332611 (secure 0 0 0) 0x7fab740b5b50 con 0x7fab5406ba10 2024-04-01T22:34:10.311 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:34:10.313 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-01T22:34:10.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.312+0000 7fab7a925640 1 -- 172.21.15.47:0/1556761899 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fab5406ba10 msgr2=0x7fab5406ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:10.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.312+0000 7fab7a925640 1 --2- 172.21.15.47:0/1556761899 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fab5406ba10 0x7fab5406ded0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fab64036000 tx=0x7fab6403b040 comp rx=0 tx=0).stop 2024-04-01T22:34:10.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.312+0000 7fab7a925640 1 -- 172.21.15.47:0/1556761899 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab741f1f10 msgr2=0x7fab741f23a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:10.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.312+0000 7fab7a925640 1 --2- 172.21.15.47:0/1556761899 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab741f1f10 0x7fab741f23a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fab6c00c680 tx=0x7fab6c00cb40 comp rx=0 tx=0).stop 2024-04-01T22:34:10.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.312+0000 7fab7a925640 1 -- 172.21.15.47:0/1556761899 shutdown_connections 2024-04-01T22:34:10.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.312+0000 7fab7a925640 1 --2- 172.21.15.47:0/1556761899 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fab5406ba10 0x7fab5406ded0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:10.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.312+0000 7fab7a925640 1 --2- 172.21.15.47:0/1556761899 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab741f1f10 0x7fab741f23a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:10.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.312+0000 7fab7a925640 1 --2- 172.21.15.47:0/1556761899 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fab7406c630 0x7fab74152e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:10.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.312+0000 7fab7a925640 1 --2- 172.21.15.47:0/1556761899 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab7406c250 0x7fab740c6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:10.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.312+0000 7fab7a925640 1 -- 172.21.15.47:0/1556761899 >> 172.21.15.47:0/1556761899 conn(0x7fab740cfdb0 msgr2=0x7fab74153fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:10.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.312+0000 7fab7a925640 1 -- 172.21.15.47:0/1556761899 shutdown_connections 2024-04-01T22:34:10.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.312+0000 7fab7a925640 1 -- 172.21.15.47:0/1556761899 wait complete. 2024-04-01T22:34:10.324 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2024-04-01T22:34:08.787790+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":319,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226944,"kb_used_data":2464,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754747776,"statfs":{"total":773094113280,"available":772861722624,"internally_reserved":0,"allocated":2523136,"data_stored":2142208,"data_compressed":65062,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001919"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.895291+0000","last_change":"2024-04-01T22:33:26.849312+0000","last_active":"2024-04-01T22:34:04.895291+0000","last_peered":"2024-04-01T22:34:04.895291+0000","last_clean":"2024-04-01T22:34:04.895291+0000","last_became_active":"2024-04-01T22:33:26.849009+0000","last_became_peered":"2024-04-01T22:33:26.849009+0000","last_unstale":"2024-04-01T22:34:04.895291+0000","last_undegraded":"2024-04-01T22:34:04.895291+0000","last_fullsized":"2024-04-01T22:34:04.895291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:58:40.837557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.896574+0000","last_change":"2024-04-01T22:33:27.919006+0000","last_active":"2024-04-01T22:34:04.896574+0000","last_peered":"2024-04-01T22:34:04.896574+0000","last_clean":"2024-04-01T22:34:04.896574+0000","last_became_active":"2024-04-01T22:33:27.918702+0000","last_became_peered":"2024-04-01T22:33:27.918702+0000","last_unstale":"2024-04-01T22:34:04.896574+0000","last_undegraded":"2024-04-01T22:34:04.896574+0000","last_fullsized":"2024-04-01T22:34:04.896574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:08:00.537270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.896715+0000","last_change":"2024-04-01T22:33:33.255162+0000","last_active":"2024-04-01T22:34:04.896715+0000","last_peered":"2024-04-01T22:34:04.896715+0000","last_clean":"2024-04-01T22:34:04.896715+0000","last_became_active":"2024-04-01T22:33:33.254187+0000","last_became_peered":"2024-04-01T22:33:33.254187+0000","last_unstale":"2024-04-01T22:34:04.896715+0000","last_undegraded":"2024-04-01T22:34:04.896715+0000","last_fullsized":"2024-04-01T22:34:04.896715+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:57:12.343606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.896476+0000","last_change":"2024-04-01T22:33:26.855377+0000","last_active":"2024-04-01T22:34:04.896476+0000","last_peered":"2024-04-01T22:34:04.896476+0000","last_clean":"2024-04-01T22:34:04.896476+0000","last_became_active":"2024-04-01T22:33:26.855119+0000","last_became_peered":"2024-04-01T22:33:26.855119+0000","last_unstale":"2024-04-01T22:34:04.896476+0000","last_undegraded":"2024-04-01T22:34:04.896476+0000","last_fullsized":"2024-04-01T22:34:04.896476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:25:41.744696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.895106+0000","last_change":"2024-04-01T22:33:27.974175+0000","last_active":"2024-04-01T22:34:04.895106+0000","last_peered":"2024-04-01T22:34:04.895106+0000","last_clean":"2024-04-01T22:34:04.895106+0000","last_became_active":"2024-04-01T22:33:27.973915+0000","last_became_peered":"2024-04-01T22:33:27.973915+0000","last_unstale":"2024-04-01T22:34:04.895106+0000","last_undegraded":"2024-04-01T22:34:04.895106+0000","last_fullsized":"2024-04-01T22:34:04.895106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:43:03.166262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.288355+0000","last_change":"2024-04-01T22:33:32.853556+0000","last_active":"2024-04-01T22:34:05.288355+0000","last_peered":"2024-04-01T22:34:05.288355+0000","last_clean":"2024-04-01T22:34:05.288355+0000","last_became_active":"2024-04-01T22:33:32.853215+0000","last_became_peered":"2024-04-01T22:33:32.853215+0000","last_unstale":"2024-04-01T22:34:05.288355+0000","last_undegraded":"2024-04-01T22:34:05.288355+0000","last_fullsized":"2024-04-01T22:34:05.288355+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:50:09.812910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.890789+0000","last_change":"2024-04-01T22:33:26.849967+0000","last_active":"2024-04-01T22:34:04.890789+0000","last_peered":"2024-04-01T22:34:04.890789+0000","last_clean":"2024-04-01T22:34:04.890789+0000","last_became_active":"2024-04-01T22:33:26.849432+0000","last_became_peered":"2024-04-01T22:33:26.849432+0000","last_unstale":"2024-04-01T22:34:04.890789+0000","last_undegraded":"2024-04-01T22:34:04.890789+0000","last_fullsized":"2024-04-01T22:34:04.890789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:47:18.407469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.290623+0000","last_change":"2024-04-01T22:34:05.289795+0000","last_active":"2024-04-01T22:34:05.290623+0000","last_peered":"2024-04-01T22:34:05.290623+0000","last_clean":"2024-04-01T22:34:05.290623+0000","last_became_active":"2024-04-01T22:34:05.289454+0000","last_became_peered":"2024-04-01T22:34:05.289454+0000","last_unstale":"2024-04-01T22:34:05.290623+0000","last_undegraded":"2024-04-01T22:34:05.290623+0000","last_fullsized":"2024-04-01T22:34:05.290623+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:08:15.465415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.288947+0000","last_change":"2024-04-01T22:33:32.847230+0000","last_active":"2024-04-01T22:34:05.288947+0000","last_peered":"2024-04-01T22:34:05.288947+0000","last_clean":"2024-04-01T22:34:05.288947+0000","last_became_active":"2024-04-01T22:33:32.846382+0000","last_became_peered":"2024-04-01T22:33:32.846382+0000","last_unstale":"2024-04-01T22:34:05.288947+0000","last_undegraded":"2024-04-01T22:34:05.288947+0000","last_fullsized":"2024-04-01T22:34:05.288947+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:41:50.766262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.890435+0000","last_change":"2024-04-01T22:33:26.852784+0000","last_active":"2024-04-01T22:34:04.890435+0000","last_peered":"2024-04-01T22:34:04.890435+0000","last_clean":"2024-04-01T22:34:04.890435+0000","last_became_active":"2024-04-01T22:33:26.852530+0000","last_became_peered":"2024-04-01T22:33:26.852530+0000","last_unstale":"2024-04-01T22:34:04.890435+0000","last_undegraded":"2024-04-01T22:34:04.890435+0000","last_fullsized":"2024-04-01T22:34:04.890435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:39:29.846272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.315985+0000","last_change":"2024-04-01T22:33:27.974358+0000","last_active":"2024-04-01T22:34:05.315985+0000","last_peered":"2024-04-01T22:34:05.315985+0000","last_clean":"2024-04-01T22:34:05.315985+0000","last_became_active":"2024-04-01T22:33:27.974117+0000","last_became_peered":"2024-04-01T22:33:27.974117+0000","last_unstale":"2024-04-01T22:34:05.315985+0000","last_undegraded":"2024-04-01T22:34:05.315985+0000","last_fullsized":"2024-04-01T22:34:05.315985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:39:28.692092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.288607+0000","last_change":"2024-04-01T22:33:32.844681+0000","last_active":"2024-04-01T22:34:05.288607+0000","last_peered":"2024-04-01T22:34:05.288607+0000","last_clean":"2024-04-01T22:34:05.288607+0000","last_became_active":"2024-04-01T22:33:32.844334+0000","last_became_peered":"2024-04-01T22:33:32.844334+0000","last_unstale":"2024-04-01T22:34:05.288607+0000","last_undegraded":"2024-04-01T22:34:05.288607+0000","last_fullsized":"2024-04-01T22:34:05.288607+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:56:30.852155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.403722+0000","last_change":"2024-04-01T22:33:27.918822+0000","last_active":"2024-04-01T22:34:05.403722+0000","last_peered":"2024-04-01T22:34:05.403722+0000","last_clean":"2024-04-01T22:34:05.403722+0000","last_became_active":"2024-04-01T22:33:27.918466+0000","last_became_peered":"2024-04-01T22:33:27.918466+0000","last_unstale":"2024-04-01T22:34:05.403722+0000","last_undegraded":"2024-04-01T22:34:05.403722+0000","last_fullsized":"2024-04-01T22:34:05.403722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:43:57.121738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.890470+0000","last_change":"2024-04-01T22:33:26.850443+0000","last_active":"2024-04-01T22:34:04.890470+0000","last_peered":"2024-04-01T22:34:04.890470+0000","last_clean":"2024-04-01T22:34:04.890470+0000","last_became_active":"2024-04-01T22:33:26.849954+0000","last_became_peered":"2024-04-01T22:33:26.849954+0000","last_unstale":"2024-04-01T22:34:04.890470+0000","last_undegraded":"2024-04-01T22:34:04.890470+0000","last_fullsized":"2024-04-01T22:34:04.890470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:49:51.408086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.289098+0000","last_change":"2024-04-01T22:33:32.853569+0000","last_active":"2024-04-01T22:34:05.289098+0000","last_peered":"2024-04-01T22:34:05.289098+0000","last_clean":"2024-04-01T22:34:05.289098+0000","last_became_active":"2024-04-01T22:33:32.853185+0000","last_became_peered":"2024-04-01T22:33:32.853185+0000","last_unstale":"2024-04-01T22:34:05.289098+0000","last_undegraded":"2024-04-01T22:34:05.289098+0000","last_fullsized":"2024-04-01T22:34:05.289098+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:19:25.147938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.896929+0000","last_change":"2024-04-01T22:33:27.949789+0000","last_active":"2024-04-01T22:34:04.896929+0000","last_peered":"2024-04-01T22:34:04.896929+0000","last_clean":"2024-04-01T22:34:04.896929+0000","last_became_active":"2024-04-01T22:33:27.949518+0000","last_became_peered":"2024-04-01T22:33:27.949518+0000","last_unstale":"2024-04-01T22:34:04.896929+0000","last_undegraded":"2024-04-01T22:34:04.896929+0000","last_fullsized":"2024-04-01T22:34:04.896929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:15:08.500466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.935696+0000","last_change":"2024-04-01T22:33:26.856856+0000","last_active":"2024-04-01T22:34:04.935696+0000","last_peered":"2024-04-01T22:34:04.935696+0000","last_clean":"2024-04-01T22:34:04.935696+0000","last_became_active":"2024-04-01T22:33:26.856591+0000","last_became_peered":"2024-04-01T22:33:26.856591+0000","last_unstale":"2024-04-01T22:34:04.935696+0000","last_undegraded":"2024-04-01T22:34:04.935696+0000","last_fullsized":"2024-04-01T22:34:04.935696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:38:14.576161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.288898+0000","last_change":"2024-04-01T22:33:32.847352+0000","last_active":"2024-04-01T22:34:05.288898+0000","last_peered":"2024-04-01T22:34:05.288898+0000","last_clean":"2024-04-01T22:34:05.288898+0000","last_became_active":"2024-04-01T22:33:32.846849+0000","last_became_peered":"2024-04-01T22:33:32.846849+0000","last_unstale":"2024-04-01T22:34:05.288898+0000","last_undegraded":"2024-04-01T22:34:05.288898+0000","last_fullsized":"2024-04-01T22:34:05.288898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:04:48.921372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.896722+0000","last_change":"2024-04-01T22:33:27.855387+0000","last_active":"2024-04-01T22:34:04.896722+0000","last_peered":"2024-04-01T22:34:04.896722+0000","last_clean":"2024-04-01T22:34:04.896722+0000","last_became_active":"2024-04-01T22:33:27.855123+0000","last_became_peered":"2024-04-01T22:33:27.855123+0000","last_unstale":"2024-04-01T22:34:04.896722+0000","last_undegraded":"2024-04-01T22:34:04.896722+0000","last_fullsized":"2024-04-01T22:34:04.896722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:16:58.889368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.935482+0000","last_change":"2024-04-01T22:33:26.848128+0000","last_active":"2024-04-01T22:34:04.935482+0000","last_peered":"2024-04-01T22:34:04.935482+0000","last_clean":"2024-04-01T22:34:04.935482+0000","last_became_active":"2024-04-01T22:33:26.847904+0000","last_became_peered":"2024-04-01T22:33:26.847904+0000","last_unstale":"2024-04-01T22:34:04.935482+0000","last_undegraded":"2024-04-01T22:34:04.935482+0000","last_fullsized":"2024-04-01T22:34:04.935482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:41:58.838710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.290928+0000","last_change":"2024-04-01T22:34:05.290215+0000","last_active":"2024-04-01T22:34:05.290928+0000","last_peered":"2024-04-01T22:34:05.290928+0000","last_clean":"2024-04-01T22:34:05.290928+0000","last_became_active":"2024-04-01T22:34:05.289769+0000","last_became_peered":"2024-04-01T22:34:05.289769+0000","last_unstale":"2024-04-01T22:34:05.290928+0000","last_undegraded":"2024-04-01T22:34:05.290928+0000","last_fullsized":"2024-04-01T22:34:05.290928+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:39:33.591520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,7],"acting":[2,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.288692+0000","last_change":"2024-04-01T22:33:27.868997+0000","last_active":"2024-04-01T22:34:05.288692+0000","last_peered":"2024-04-01T22:34:05.288692+0000","last_clean":"2024-04-01T22:34:05.288692+0000","last_became_active":"2024-04-01T22:33:27.868713+0000","last_became_peered":"2024-04-01T22:33:27.868713+0000","last_unstale":"2024-04-01T22:34:05.288692+0000","last_undegraded":"2024-04-01T22:34:05.288692+0000","last_fullsized":"2024-04-01T22:34:05.288692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:41:59.967183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.890068+0000","last_change":"2024-04-01T22:33:26.848037+0000","last_active":"2024-04-01T22:34:04.890068+0000","last_peered":"2024-04-01T22:34:04.890068+0000","last_clean":"2024-04-01T22:34:04.890068+0000","last_became_active":"2024-04-01T22:33:26.847736+0000","last_became_peered":"2024-04-01T22:33:26.847736+0000","last_unstale":"2024-04-01T22:34:04.890068+0000","last_undegraded":"2024-04-01T22:34:04.890068+0000","last_fullsized":"2024-04-01T22:34:04.890068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:56:04.675231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.289161+0000","last_change":"2024-04-01T22:33:32.847015+0000","last_active":"2024-04-01T22:34:05.289161+0000","last_peered":"2024-04-01T22:34:05.289161+0000","last_clean":"2024-04-01T22:34:05.289161+0000","last_became_active":"2024-04-01T22:33:32.846639+0000","last_became_peered":"2024-04-01T22:33:32.846639+0000","last_unstale":"2024-04-01T22:34:05.289161+0000","last_undegraded":"2024-04-01T22:34:05.289161+0000","last_fullsized":"2024-04-01T22:34:05.289161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:47:09.903506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.895438+0000","last_change":"2024-04-01T22:33:27.948117+0000","last_active":"2024-04-01T22:34:04.895438+0000","last_peered":"2024-04-01T22:34:04.895438+0000","last_clean":"2024-04-01T22:34:04.895438+0000","last_became_active":"2024-04-01T22:33:27.947735+0000","last_became_peered":"2024-04-01T22:33:27.947735+0000","last_unstale":"2024-04-01T22:34:04.895438+0000","last_undegraded":"2024-04-01T22:34:04.895438+0000","last_fullsized":"2024-04-01T22:34:04.895438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:16:58.889368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.404225+0000","last_change":"2024-04-01T22:33:26.849404+0000","last_active":"2024-04-01T22:34:05.404225+0000","last_peered":"2024-04-01T22:34:05.404225+0000","last_clean":"2024-04-01T22:34:05.404225+0000","last_became_active":"2024-04-01T22:33:26.849086+0000","last_became_peered":"2024-04-01T22:33:26.849086+0000","last_unstale":"2024-04-01T22:34:05.404225+0000","last_undegraded":"2024-04-01T22:34:05.404225+0000","last_fullsized":"2024-04-01T22:34:05.404225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:41:58.838710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.288674+0000","last_change":"2024-04-01T22:33:33.249726+0000","last_active":"2024-04-01T22:34:05.288674+0000","last_peered":"2024-04-01T22:34:05.288674+0000","last_clean":"2024-04-01T22:34:05.288674+0000","last_became_active":"2024-04-01T22:33:33.249309+0000","last_became_peered":"2024-04-01T22:33:33.249309+0000","last_unstale":"2024-04-01T22:34:05.288674+0000","last_undegraded":"2024-04-01T22:34:05.288674+0000","last_fullsized":"2024-04-01T22:34:05.288674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:08:20.364843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.896624+0000","last_change":"2024-04-01T22:33:27.879797+0000","last_active":"2024-04-01T22:34:04.896624+0000","last_peered":"2024-04-01T22:34:04.896624+0000","last_clean":"2024-04-01T22:34:04.896624+0000","last_became_active":"2024-04-01T22:33:27.879582+0000","last_became_peered":"2024-04-01T22:33:27.879582+0000","last_unstale":"2024-04-01T22:34:04.896624+0000","last_undegraded":"2024-04-01T22:34:04.896624+0000","last_fullsized":"2024-04-01T22:34:04.896624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:08:15.465415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.936562+0000","last_change":"2024-04-01T22:33:26.847504+0000","last_active":"2024-04-01T22:34:04.936562+0000","last_peered":"2024-04-01T22:34:04.936562+0000","last_clean":"2024-04-01T22:34:04.936562+0000","last_became_active":"2024-04-01T22:33:26.847333+0000","last_became_peered":"2024-04-01T22:33:26.847333+0000","last_unstale":"2024-04-01T22:34:04.936562+0000","last_undegraded":"2024-04-01T22:34:04.936562+0000","last_fullsized":"2024-04-01T22:34:04.936562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:39:29.846272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.896278+0000","last_change":"2024-04-01T22:33:33.255030+0000","last_active":"2024-04-01T22:34:04.896278+0000","last_peered":"2024-04-01T22:34:04.896278+0000","last_clean":"2024-04-01T22:34:04.896278+0000","last_became_active":"2024-04-01T22:33:33.254621+0000","last_became_peered":"2024-04-01T22:33:33.254621+0000","last_unstale":"2024-04-01T22:34:04.896278+0000","last_undegraded":"2024-04-01T22:34:04.896278+0000","last_fullsized":"2024-04-01T22:34:04.896278+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:19:44.325870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.936119+0000","last_change":"2024-04-01T22:33:27.855669+0000","last_active":"2024-04-01T22:34:04.936119+0000","last_peered":"2024-04-01T22:34:04.936119+0000","last_clean":"2024-04-01T22:34:04.936119+0000","last_became_active":"2024-04-01T22:33:27.855419+0000","last_became_peered":"2024-04-01T22:33:27.855419+0000","last_unstale":"2024-04-01T22:34:04.936119+0000","last_undegraded":"2024-04-01T22:34:04.936119+0000","last_fullsized":"2024-04-01T22:34:04.936119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:15:46.224658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.890932+0000","last_change":"2024-04-01T22:33:26.850176+0000","last_active":"2024-04-01T22:34:04.890932+0000","last_peered":"2024-04-01T22:34:04.890932+0000","last_clean":"2024-04-01T22:34:04.890932+0000","last_became_active":"2024-04-01T22:33:26.849717+0000","last_became_peered":"2024-04-01T22:33:26.849717+0000","last_unstale":"2024-04-01T22:34:04.890932+0000","last_undegraded":"2024-04-01T22:34:04.890932+0000","last_fullsized":"2024-04-01T22:34:04.890932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:18:55.842886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.893929+0000","last_change":"2024-04-01T22:33:33.249765+0000","last_active":"2024-04-01T22:34:04.893929+0000","last_peered":"2024-04-01T22:34:04.893929+0000","last_clean":"2024-04-01T22:34:04.893929+0000","last_became_active":"2024-04-01T22:33:33.249370+0000","last_became_peered":"2024-04-01T22:33:33.249370+0000","last_unstale":"2024-04-01T22:34:04.893929+0000","last_undegraded":"2024-04-01T22:34:04.893929+0000","last_fullsized":"2024-04-01T22:34:04.893929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:41:50.766262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.316076+0000","last_change":"2024-04-01T22:33:27.979163+0000","last_active":"2024-04-01T22:34:05.316076+0000","last_peered":"2024-04-01T22:34:05.316076+0000","last_clean":"2024-04-01T22:34:05.316076+0000","last_became_active":"2024-04-01T22:33:27.978902+0000","last_became_peered":"2024-04-01T22:33:27.978902+0000","last_unstale":"2024-04-01T22:34:05.316076+0000","last_undegraded":"2024-04-01T22:34:05.316076+0000","last_fullsized":"2024-04-01T22:34:05.316076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:04:44.021944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.936216+0000","last_change":"2024-04-01T22:33:26.846575+0000","last_active":"2024-04-01T22:34:04.936216+0000","last_peered":"2024-04-01T22:34:04.936216+0000","last_clean":"2024-04-01T22:34:04.936216+0000","last_became_active":"2024-04-01T22:33:26.846265+0000","last_became_peered":"2024-04-01T22:33:26.846265+0000","last_unstale":"2024-04-01T22:34:04.936216+0000","last_undegraded":"2024-04-01T22:34:04.936216+0000","last_fullsized":"2024-04-01T22:34:04.936216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:56:04.675231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.935218+0000","last_change":"2024-04-01T22:33:32.850553+0000","last_active":"2024-04-01T22:34:04.935218+0000","last_peered":"2024-04-01T22:34:04.935218+0000","last_clean":"2024-04-01T22:34:04.935218+0000","last_became_active":"2024-04-01T22:33:32.849774+0000","last_became_peered":"2024-04-01T22:33:32.849774+0000","last_unstale":"2024-04-01T22:34:04.935218+0000","last_undegraded":"2024-04-01T22:34:04.935218+0000","last_fullsized":"2024-04-01T22:34:04.935218+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:04:48.921372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.289106+0000","last_change":"2024-04-01T22:33:27.949879+0000","last_active":"2024-04-01T22:34:05.289106+0000","last_peered":"2024-04-01T22:34:05.289106+0000","last_clean":"2024-04-01T22:34:05.289106+0000","last_became_active":"2024-04-01T22:33:27.949620+0000","last_became_peered":"2024-04-01T22:33:27.949620+0000","last_unstale":"2024-04-01T22:34:05.289106+0000","last_undegraded":"2024-04-01T22:34:05.289106+0000","last_fullsized":"2024-04-01T22:34:05.289106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:49:52.536559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.316240+0000","last_change":"2024-04-01T22:33:26.846346+0000","last_active":"2024-04-01T22:34:05.316240+0000","last_peered":"2024-04-01T22:34:05.316240+0000","last_clean":"2024-04-01T22:34:05.316240+0000","last_became_active":"2024-04-01T22:33:26.846052+0000","last_became_peered":"2024-04-01T22:33:26.846052+0000","last_unstale":"2024-04-01T22:34:05.316240+0000","last_undegraded":"2024-04-01T22:34:05.316240+0000","last_fullsized":"2024-04-01T22:34:05.316240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:41:58.838710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.935885+0000","last_change":"2024-04-01T22:33:32.846766+0000","last_active":"2024-04-01T22:34:04.935885+0000","last_peered":"2024-04-01T22:34:04.935885+0000","last_clean":"2024-04-01T22:34:04.935885+0000","last_became_active":"2024-04-01T22:33:32.846422+0000","last_became_peered":"2024-04-01T22:33:32.846422+0000","last_unstale":"2024-04-01T22:34:04.935885+0000","last_undegraded":"2024-04-01T22:34:04.935885+0000","last_fullsized":"2024-04-01T22:34:04.935885+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:41:50.766262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.935195+0000","last_change":"2024-04-01T22:33:27.855299+0000","last_active":"2024-04-01T22:34:04.935195+0000","last_peered":"2024-04-01T22:34:04.935195+0000","last_clean":"2024-04-01T22:34:04.935195+0000","last_became_active":"2024-04-01T22:33:27.855035+0000","last_became_peered":"2024-04-01T22:33:27.855035+0000","last_unstale":"2024-04-01T22:34:04.935195+0000","last_undegraded":"2024-04-01T22:34:04.935195+0000","last_fullsized":"2024-04-01T22:34:04.935195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:48:53.083180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.893005+0000","last_change":"2024-04-01T22:33:26.856300+0000","last_active":"2024-04-01T22:34:04.893005+0000","last_peered":"2024-04-01T22:34:04.893005+0000","last_clean":"2024-04-01T22:34:04.893005+0000","last_became_active":"2024-04-01T22:33:26.855864+0000","last_became_peered":"2024-04-01T22:33:26.855864+0000","last_unstale":"2024-04-01T22:34:04.893005+0000","last_undegraded":"2024-04-01T22:34:04.893005+0000","last_fullsized":"2024-04-01T22:34:04.893005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:38:14.576161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.317957+0000","last_change":"2024-04-01T22:34:05.317101+0000","last_active":"2024-04-01T22:34:05.317957+0000","last_peered":"2024-04-01T22:34:05.317957+0000","last_clean":"2024-04-01T22:34:05.317957+0000","last_became_active":"2024-04-01T22:34:05.316665+0000","last_became_peered":"2024-04-01T22:34:05.316665+0000","last_unstale":"2024-04-01T22:34:05.317957+0000","last_undegraded":"2024-04-01T22:34:05.317957+0000","last_fullsized":"2024-04-01T22:34:05.317957+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:47:09.903506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.894392+0000","last_change":"2024-04-01T22:33:27.949013+0000","last_active":"2024-04-01T22:34:04.894392+0000","last_peered":"2024-04-01T22:34:04.894392+0000","last_clean":"2024-04-01T22:34:04.894392+0000","last_became_active":"2024-04-01T22:33:27.948687+0000","last_became_peered":"2024-04-01T22:33:27.948687+0000","last_unstale":"2024-04-01T22:34:04.894392+0000","last_undegraded":"2024-04-01T22:34:04.894392+0000","last_fullsized":"2024-04-01T22:34:04.894392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:50:54.852207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.890115+0000","last_change":"2024-04-01T22:33:26.848366+0000","last_active":"2024-04-01T22:34:04.890115+0000","last_peered":"2024-04-01T22:34:04.890115+0000","last_clean":"2024-04-01T22:34:04.890115+0000","last_became_active":"2024-04-01T22:33:26.848019+0000","last_became_peered":"2024-04-01T22:33:26.848019+0000","last_unstale":"2024-04-01T22:34:04.890115+0000","last_undegraded":"2024-04-01T22:34:04.890115+0000","last_fullsized":"2024-04-01T22:34:04.890115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:41:58.838710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.895340+0000","last_change":"2024-04-01T22:33:33.253077+0000","last_active":"2024-04-01T22:34:04.895340+0000","last_peered":"2024-04-01T22:34:04.895340+0000","last_clean":"2024-04-01T22:34:04.895340+0000","last_became_active":"2024-04-01T22:33:33.252725+0000","last_became_peered":"2024-04-01T22:33:33.252725+0000","last_unstale":"2024-04-01T22:34:04.895340+0000","last_undegraded":"2024-04-01T22:34:04.895340+0000","last_fullsized":"2024-04-01T22:34:04.895340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:28:17.970808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.896965+0000","last_change":"2024-04-01T22:33:27.975039+0000","last_active":"2024-04-01T22:34:04.896965+0000","last_peered":"2024-04-01T22:34:04.896965+0000","last_clean":"2024-04-01T22:34:04.896965+0000","last_became_active":"2024-04-01T22:33:27.974751+0000","last_became_peered":"2024-04-01T22:33:27.974751+0000","last_unstale":"2024-04-01T22:34:04.896965+0000","last_undegraded":"2024-04-01T22:34:04.896965+0000","last_fullsized":"2024-04-01T22:34:04.896965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:43:03.166262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.315889+0000","last_change":"2024-04-01T22:33:26.831690+0000","last_active":"2024-04-01T22:34:05.315889+0000","last_peered":"2024-04-01T22:34:05.315889+0000","last_clean":"2024-04-01T22:34:05.315889+0000","last_became_active":"2024-04-01T22:33:26.831398+0000","last_became_peered":"2024-04-01T22:33:26.831398+0000","last_unstale":"2024-04-01T22:34:05.315889+0000","last_undegraded":"2024-04-01T22:34:05.315889+0000","last_fullsized":"2024-04-01T22:34:05.315889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:38:14.576161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":182,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.890173+0000","last_change":"2024-04-01T22:33:15.962585+0000","last_active":"2024-04-01T22:34:04.890173+0000","last_peered":"2024-04-01T22:34:04.890173+0000","last_clean":"2024-04-01T22:34:04.890173+0000","last_became_active":"2024-04-01T22:33:15.961762+0000","last_became_peered":"2024-04-01T22:33:15.961762+0000","last_unstale":"2024-04-01T22:34:04.890173+0000","last_undegraded":"2024-04-01T22:34:04.890173+0000","last_fullsized":"2024-04-01T22:34:04.890173+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:13.756389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:13.756389+0000","last_clean_scrub_stamp":"2024-04-01T22:33:13.756389+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:33:28.684533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.403864+0000","last_change":"2024-04-01T22:33:33.252863+0000","last_active":"2024-04-01T22:34:05.403864+0000","last_peered":"2024-04-01T22:34:05.403864+0000","last_clean":"2024-04-01T22:34:05.403864+0000","last_became_active":"2024-04-01T22:33:33.252494+0000","last_became_peered":"2024-04-01T22:33:33.252494+0000","last_unstale":"2024-04-01T22:34:05.403864+0000","last_undegraded":"2024-04-01T22:34:05.403864+0000","last_fullsized":"2024-04-01T22:34:05.403864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:47:09.903506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.937211+0000","last_change":"2024-04-01T22:34:04.937211+0000","last_active":"2024-04-01T22:34:04.937211+0000","last_peered":"2024-04-01T22:34:04.937211+0000","last_clean":"2024-04-01T22:34:04.937211+0000","last_became_active":"2024-04-01T22:34:04.936886+0000","last_became_peered":"2024-04-01T22:34:04.936886+0000","last_unstale":"2024-04-01T22:34:04.937211+0000","last_undegraded":"2024-04-01T22:34:04.937211+0000","last_fullsized":"2024-04-01T22:34:04.937211+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:53:33.542832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.893356+0000","last_change":"2024-04-01T22:33:26.832331+0000","last_active":"2024-04-01T22:34:04.893356+0000","last_peered":"2024-04-01T22:34:04.893356+0000","last_clean":"2024-04-01T22:34:04.893356+0000","last_became_active":"2024-04-01T22:33:26.832078+0000","last_became_peered":"2024-04-01T22:33:26.832078+0000","last_unstale":"2024-04-01T22:34:04.893356+0000","last_undegraded":"2024-04-01T22:34:04.893356+0000","last_fullsized":"2024-04-01T22:34:04.893356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:40:49.124240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.403719+0000","last_change":"2024-04-01T22:33:33.249696+0000","last_active":"2024-04-01T22:34:05.403719+0000","last_peered":"2024-04-01T22:34:05.403719+0000","last_clean":"2024-04-01T22:34:05.403719+0000","last_became_active":"2024-04-01T22:33:33.249313+0000","last_became_peered":"2024-04-01T22:33:33.249313+0000","last_unstale":"2024-04-01T22:34:05.403719+0000","last_undegraded":"2024-04-01T22:34:05.403719+0000","last_fullsized":"2024-04-01T22:34:05.403719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:39:33.591520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.315935+0000","last_change":"2024-04-01T22:33:27.971916+0000","last_active":"2024-04-01T22:34:05.315935+0000","last_peered":"2024-04-01T22:34:05.315935+0000","last_clean":"2024-04-01T22:34:05.315935+0000","last_became_active":"2024-04-01T22:33:27.971672+0000","last_became_peered":"2024-04-01T22:33:27.971672+0000","last_unstale":"2024-04-01T22:34:05.315935+0000","last_undegraded":"2024-04-01T22:34:05.315935+0000","last_fullsized":"2024-04-01T22:34:05.315935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:43:39.489075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.936257+0000","last_change":"2024-04-01T22:33:26.849350+0000","last_active":"2024-04-01T22:34:04.936257+0000","last_peered":"2024-04-01T22:34:04.936257+0000","last_clean":"2024-04-01T22:34:04.936257+0000","last_became_active":"2024-04-01T22:33:26.849098+0000","last_became_peered":"2024-04-01T22:33:26.849098+0000","last_unstale":"2024-04-01T22:34:04.936257+0000","last_undegraded":"2024-04-01T22:34:04.936257+0000","last_fullsized":"2024-04-01T22:34:04.936257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:47:18.407469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.894909+0000","last_change":"2024-04-01T22:33:32.847889+0000","last_active":"2024-04-01T22:34:04.894909+0000","last_peered":"2024-04-01T22:34:04.894909+0000","last_clean":"2024-04-01T22:34:04.894909+0000","last_became_active":"2024-04-01T22:33:32.847546+0000","last_became_peered":"2024-04-01T22:33:32.847546+0000","last_unstale":"2024-04-01T22:34:04.894909+0000","last_undegraded":"2024-04-01T22:34:04.894909+0000","last_fullsized":"2024-04-01T22:34:04.894909+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:57:05.158344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.890886+0000","last_change":"2024-04-01T22:33:27.881170+0000","last_active":"2024-04-01T22:34:04.890886+0000","last_peered":"2024-04-01T22:34:04.890886+0000","last_clean":"2024-04-01T22:34:04.890886+0000","last_became_active":"2024-04-01T22:33:27.880870+0000","last_became_peered":"2024-04-01T22:33:27.880870+0000","last_unstale":"2024-04-01T22:34:04.890886+0000","last_undegraded":"2024-04-01T22:34:04.890886+0000","last_fullsized":"2024-04-01T22:34:04.890886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:43:39.489075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.893268+0000","last_change":"2024-04-01T22:33:26.856069+0000","last_active":"2024-04-01T22:34:04.893268+0000","last_peered":"2024-04-01T22:34:04.893268+0000","last_clean":"2024-04-01T22:34:04.893268+0000","last_became_active":"2024-04-01T22:33:26.855705+0000","last_became_peered":"2024-04-01T22:33:26.855705+0000","last_unstale":"2024-04-01T22:34:04.893268+0000","last_undegraded":"2024-04-01T22:34:04.893268+0000","last_fullsized":"2024-04-01T22:34:04.893268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:56:04.675231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.315507+0000","last_change":"2024-04-01T22:33:33.249689+0000","last_active":"2024-04-01T22:34:05.315507+0000","last_peered":"2024-04-01T22:34:05.315507+0000","last_clean":"2024-04-01T22:34:05.315507+0000","last_became_active":"2024-04-01T22:33:33.249315+0000","last_became_peered":"2024-04-01T22:33:33.249315+0000","last_unstale":"2024-04-01T22:34:05.315507+0000","last_undegraded":"2024-04-01T22:34:05.315507+0000","last_fullsized":"2024-04-01T22:34:05.315507+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:19:44.325870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.890692+0000","last_change":"2024-04-01T22:33:27.881320+0000","last_active":"2024-04-01T22:34:04.890692+0000","last_peered":"2024-04-01T22:34:04.890692+0000","last_clean":"2024-04-01T22:34:04.890692+0000","last_became_active":"2024-04-01T22:33:27.880973+0000","last_became_peered":"2024-04-01T22:33:27.880973+0000","last_unstale":"2024-04-01T22:34:04.890692+0000","last_undegraded":"2024-04-01T22:34:04.890692+0000","last_fullsized":"2024-04-01T22:34:04.890692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:04:44.021944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.289266+0000","last_change":"2024-04-01T22:33:26.845121+0000","last_active":"2024-04-01T22:34:05.289266+0000","last_peered":"2024-04-01T22:34:05.289266+0000","last_clean":"2024-04-01T22:34:05.289266+0000","last_became_active":"2024-04-01T22:33:26.844852+0000","last_became_peered":"2024-04-01T22:33:26.844852+0000","last_unstale":"2024-04-01T22:34:05.289266+0000","last_undegraded":"2024-04-01T22:34:05.289266+0000","last_fullsized":"2024-04-01T22:34:05.289266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:58:40.837557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.288473+0000","last_change":"2024-04-01T22:33:32.846922+0000","last_active":"2024-04-01T22:34:05.288473+0000","last_peered":"2024-04-01T22:34:05.288473+0000","last_clean":"2024-04-01T22:34:05.288473+0000","last_became_active":"2024-04-01T22:33:32.846387+0000","last_became_peered":"2024-04-01T22:33:32.846387+0000","last_unstale":"2024-04-01T22:34:05.288473+0000","last_undegraded":"2024-04-01T22:34:05.288473+0000","last_fullsized":"2024-04-01T22:34:05.288473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:08:05.436698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.890208+0000","last_change":"2024-04-01T22:33:27.884447+0000","last_active":"2024-04-01T22:34:04.890208+0000","last_peered":"2024-04-01T22:34:04.890208+0000","last_clean":"2024-04-01T22:34:04.890208+0000","last_became_active":"2024-04-01T22:33:27.884148+0000","last_became_peered":"2024-04-01T22:33:27.884148+0000","last_unstale":"2024-04-01T22:34:04.890208+0000","last_undegraded":"2024-04-01T22:34:04.890208+0000","last_fullsized":"2024-04-01T22:34:04.890208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:08:00.537270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.892643+0000","last_change":"2024-04-01T22:33:26.844884+0000","last_active":"2024-04-01T22:34:04.892643+0000","last_peered":"2024-04-01T22:34:04.892643+0000","last_clean":"2024-04-01T22:34:04.892643+0000","last_became_active":"2024-04-01T22:33:26.844583+0000","last_became_peered":"2024-04-01T22:33:26.844583+0000","last_unstale":"2024-04-01T22:34:04.892643+0000","last_undegraded":"2024-04-01T22:34:04.892643+0000","last_fullsized":"2024-04-01T22:34:04.892643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:25:41.744696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.895307+0000","last_change":"2024-04-01T22:33:32.845036+0000","last_active":"2024-04-01T22:34:04.895307+0000","last_peered":"2024-04-01T22:34:04.895307+0000","last_clean":"2024-04-01T22:34:04.895307+0000","last_became_active":"2024-04-01T22:33:32.844555+0000","last_became_peered":"2024-04-01T22:33:32.844555+0000","last_unstale":"2024-04-01T22:34:04.895307+0000","last_undegraded":"2024-04-01T22:34:04.895307+0000","last_fullsized":"2024-04-01T22:34:04.895307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:43:44.388503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.403752+0000","last_change":"2024-04-01T22:33:27.950227+0000","last_active":"2024-04-01T22:34:05.403752+0000","last_peered":"2024-04-01T22:34:05.403752+0000","last_clean":"2024-04-01T22:34:05.403752+0000","last_became_active":"2024-04-01T22:33:27.949366+0000","last_became_peered":"2024-04-01T22:33:27.949366+0000","last_unstale":"2024-04-01T22:34:05.403752+0000","last_undegraded":"2024-04-01T22:34:05.403752+0000","last_fullsized":"2024-04-01T22:34:05.403752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:16:58.889368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.403834+0000","last_change":"2024-04-01T22:33:26.830463+0000","last_active":"2024-04-01T22:34:05.403834+0000","last_peered":"2024-04-01T22:34:05.403834+0000","last_clean":"2024-04-01T22:34:05.403834+0000","last_became_active":"2024-04-01T22:33:26.830179+0000","last_became_peered":"2024-04-01T22:33:26.830179+0000","last_unstale":"2024-04-01T22:34:05.403834+0000","last_undegraded":"2024-04-01T22:34:05.403834+0000","last_fullsized":"2024-04-01T22:34:05.403834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:38:14.576161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.896415+0000","last_change":"2024-04-01T22:33:33.252812+0000","last_active":"2024-04-01T22:34:04.896415+0000","last_peered":"2024-04-01T22:34:04.896415+0000","last_clean":"2024-04-01T22:34:04.896415+0000","last_became_active":"2024-04-01T22:33:33.252412+0000","last_became_peered":"2024-04-01T22:33:33.252412+0000","last_unstale":"2024-04-01T22:34:04.896415+0000","last_undegraded":"2024-04-01T22:34:04.896415+0000","last_fullsized":"2024-04-01T22:34:04.896415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:53:38.442260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.890447+0000","last_change":"2024-04-01T22:33:27.880363+0000","last_active":"2024-04-01T22:34:04.890447+0000","last_peered":"2024-04-01T22:34:04.890447+0000","last_clean":"2024-04-01T22:34:04.890447+0000","last_became_active":"2024-04-01T22:33:27.880096+0000","last_became_peered":"2024-04-01T22:33:27.880096+0000","last_unstale":"2024-04-01T22:34:04.890447+0000","last_undegraded":"2024-04-01T22:34:04.890447+0000","last_fullsized":"2024-04-01T22:34:04.890447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:19:20.248510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.316196+0000","last_change":"2024-04-01T22:33:26.855823+0000","last_active":"2024-04-01T22:34:05.316196+0000","last_peered":"2024-04-01T22:34:05.316196+0000","last_clean":"2024-04-01T22:34:05.316196+0000","last_became_active":"2024-04-01T22:33:26.855475+0000","last_became_peered":"2024-04-01T22:33:26.855475+0000","last_unstale":"2024-04-01T22:34:05.316196+0000","last_undegraded":"2024-04-01T22:34:05.316196+0000","last_fullsized":"2024-04-01T22:34:05.316196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:39:29.846272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.897132+0000","last_change":"2024-04-01T22:33:33.249941+0000","last_active":"2024-04-01T22:34:04.897132+0000","last_peered":"2024-04-01T22:34:04.897132+0000","last_clean":"2024-04-01T22:34:04.897132+0000","last_became_active":"2024-04-01T22:33:33.249352+0000","last_became_peered":"2024-04-01T22:33:33.249352+0000","last_unstale":"2024-04-01T22:34:04.897132+0000","last_undegraded":"2024-04-01T22:34:04.897132+0000","last_fullsized":"2024-04-01T22:34:04.897132+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:36:10.226231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.894871+0000","last_change":"2024-04-01T22:33:27.948988+0000","last_active":"2024-04-01T22:34:04.894871+0000","last_peered":"2024-04-01T22:34:04.894871+0000","last_clean":"2024-04-01T22:34:04.894871+0000","last_became_active":"2024-04-01T22:33:27.948691+0000","last_became_peered":"2024-04-01T22:33:27.948691+0000","last_unstale":"2024-04-01T22:34:04.894871+0000","last_undegraded":"2024-04-01T22:34:04.894871+0000","last_fullsized":"2024-04-01T22:34:04.894871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:23:08.563134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.895290+0000","last_change":"2024-04-01T22:33:26.849911+0000","last_active":"2024-04-01T22:34:04.895290+0000","last_peered":"2024-04-01T22:34:04.895290+0000","last_clean":"2024-04-01T22:34:04.895290+0000","last_became_active":"2024-04-01T22:33:26.849646+0000","last_became_peered":"2024-04-01T22:33:26.849646+0000","last_unstale":"2024-04-01T22:34:04.895290+0000","last_undegraded":"2024-04-01T22:34:04.895290+0000","last_fullsized":"2024-04-01T22:34:04.895290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:29:59.992702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.315876+0000","last_change":"2024-04-01T22:33:33.250214+0000","last_active":"2024-04-01T22:34:05.315876+0000","last_peered":"2024-04-01T22:34:05.315876+0000","last_clean":"2024-04-01T22:34:05.315876+0000","last_became_active":"2024-04-01T22:33:33.249853+0000","last_became_peered":"2024-04-01T22:33:33.249853+0000","last_unstale":"2024-04-01T22:34:05.315876+0000","last_undegraded":"2024-04-01T22:34:05.315876+0000","last_fullsized":"2024-04-01T22:34:05.315876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:57:12.343606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.898920+0000","last_change":"2024-04-01T22:34:04.898357+0000","last_active":"2024-04-01T22:34:04.898920+0000","last_peered":"2024-04-01T22:34:04.898920+0000","last_clean":"2024-04-01T22:34:04.898920+0000","last_became_active":"2024-04-01T22:34:04.898014+0000","last_became_peered":"2024-04-01T22:34:04.898014+0000","last_unstale":"2024-04-01T22:34:04.898920+0000","last_undegraded":"2024-04-01T22:34:04.898920+0000","last_fullsized":"2024-04-01T22:34:04.898920+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:56:25.952727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.404016+0000","last_change":"2024-04-01T22:33:26.855687+0000","last_active":"2024-04-01T22:34:05.404016+0000","last_peered":"2024-04-01T22:34:05.404016+0000","last_clean":"2024-04-01T22:34:05.404016+0000","last_became_active":"2024-04-01T22:33:26.855400+0000","last_became_peered":"2024-04-01T22:33:26.855400+0000","last_unstale":"2024-04-01T22:34:05.404016+0000","last_undegraded":"2024-04-01T22:34:05.404016+0000","last_fullsized":"2024-04-01T22:34:05.404016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:39:29.846272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.935610+0000","last_change":"2024-04-01T22:33:32.846727+0000","last_active":"2024-04-01T22:34:04.935610+0000","last_peered":"2024-04-01T22:34:04.935610+0000","last_clean":"2024-04-01T22:34:04.935610+0000","last_became_active":"2024-04-01T22:33:32.846156+0000","last_became_peered":"2024-04-01T22:33:32.846156+0000","last_unstale":"2024-04-01T22:34:04.935610+0000","last_undegraded":"2024-04-01T22:34:04.935610+0000","last_fullsized":"2024-04-01T22:34:04.935610+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:57:05.158344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.289050+0000","last_change":"2024-04-01T22:33:27.879445+0000","last_active":"2024-04-01T22:34:05.289050+0000","last_peered":"2024-04-01T22:34:05.289050+0000","last_clean":"2024-04-01T22:34:05.289050+0000","last_became_active":"2024-04-01T22:33:27.879165+0000","last_became_peered":"2024-04-01T22:33:27.879165+0000","last_unstale":"2024-04-01T22:34:05.289050+0000","last_undegraded":"2024-04-01T22:34:05.289050+0000","last_fullsized":"2024-04-01T22:34:05.289050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:18:56.971360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.936151+0000","last_change":"2024-04-01T22:33:26.851767+0000","last_active":"2024-04-01T22:34:04.936151+0000","last_peered":"2024-04-01T22:34:04.936151+0000","last_clean":"2024-04-01T22:34:04.936151+0000","last_became_active":"2024-04-01T22:33:26.851489+0000","last_became_peered":"2024-04-01T22:33:26.851489+0000","last_unstale":"2024-04-01T22:34:04.936151+0000","last_undegraded":"2024-04-01T22:34:04.936151+0000","last_fullsized":"2024-04-01T22:34:04.936151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:49:51.408086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.288786+0000","last_change":"2024-04-01T22:33:32.846386+0000","last_active":"2024-04-01T22:34:05.288786+0000","last_peered":"2024-04-01T22:34:05.288786+0000","last_clean":"2024-04-01T22:34:05.288786+0000","last_became_active":"2024-04-01T22:33:32.846024+0000","last_became_peered":"2024-04-01T22:33:32.846024+0000","last_unstale":"2024-04-01T22:34:05.288786+0000","last_undegraded":"2024-04-01T22:34:05.288786+0000","last_fullsized":"2024-04-01T22:34:05.288786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:39:33.591520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.895208+0000","last_change":"2024-04-01T22:33:27.974120+0000","last_active":"2024-04-01T22:34:04.895208+0000","last_peered":"2024-04-01T22:34:04.895208+0000","last_clean":"2024-04-01T22:34:04.895208+0000","last_became_active":"2024-04-01T22:33:27.973846+0000","last_became_peered":"2024-04-01T22:33:27.973846+0000","last_unstale":"2024-04-01T22:34:04.895208+0000","last_undegraded":"2024-04-01T22:34:04.895208+0000","last_fullsized":"2024-04-01T22:34:04.895208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:15:46.224658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.315912+0000","last_change":"2024-04-01T22:33:26.831927+0000","last_active":"2024-04-01T22:34:05.315912+0000","last_peered":"2024-04-01T22:34:05.315912+0000","last_clean":"2024-04-01T22:34:05.315912+0000","last_became_active":"2024-04-01T22:33:26.831676+0000","last_became_peered":"2024-04-01T22:33:26.831676+0000","last_unstale":"2024-04-01T22:34:05.315912+0000","last_undegraded":"2024-04-01T22:34:05.315912+0000","last_fullsized":"2024-04-01T22:34:05.315912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:40:49.124240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.896543+0000","last_change":"2024-04-01T22:33:32.849983+0000","last_active":"2024-04-01T22:34:04.896543+0000","last_peered":"2024-04-01T22:34:04.896543+0000","last_clean":"2024-04-01T22:34:04.896543+0000","last_became_active":"2024-04-01T22:33:32.849661+0000","last_became_peered":"2024-04-01T22:33:32.849661+0000","last_unstale":"2024-04-01T22:34:04.896543+0000","last_undegraded":"2024-04-01T22:34:04.896543+0000","last_fullsized":"2024-04-01T22:34:04.896543+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:41:40.370250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.315868+0000","last_change":"2024-04-01T22:33:27.972417+0000","last_active":"2024-04-01T22:34:05.315868+0000","last_peered":"2024-04-01T22:34:05.315868+0000","last_clean":"2024-04-01T22:34:05.315868+0000","last_became_active":"2024-04-01T22:33:27.972173+0000","last_became_peered":"2024-04-01T22:33:27.972173+0000","last_unstale":"2024-04-01T22:34:05.315868+0000","last_undegraded":"2024-04-01T22:34:05.315868+0000","last_fullsized":"2024-04-01T22:34:05.315868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:47:05.004078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.404131+0000","last_change":"2024-04-01T22:33:26.831934+0000","last_active":"2024-04-01T22:34:05.404131+0000","last_peered":"2024-04-01T22:34:05.404131+0000","last_clean":"2024-04-01T22:34:05.404131+0000","last_became_active":"2024-04-01T22:33:26.831702+0000","last_became_peered":"2024-04-01T22:33:26.831702+0000","last_unstale":"2024-04-01T22:34:05.404131+0000","last_undegraded":"2024-04-01T22:34:05.404131+0000","last_fullsized":"2024-04-01T22:34:05.404131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:56:04.675231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.896776+0000","last_change":"2024-04-01T22:33:33.254394+0000","last_active":"2024-04-01T22:34:04.896776+0000","last_peered":"2024-04-01T22:34:04.896776+0000","last_clean":"2024-04-01T22:34:04.896776+0000","last_became_active":"2024-04-01T22:33:33.253993+0000","last_became_peered":"2024-04-01T22:33:33.253993+0000","last_unstale":"2024-04-01T22:34:04.896776+0000","last_undegraded":"2024-04-01T22:34:04.896776+0000","last_fullsized":"2024-04-01T22:34:04.896776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:11:05.243371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.895217+0000","last_change":"2024-04-01T22:33:33.253062+0000","last_active":"2024-04-01T22:34:04.895217+0000","last_peered":"2024-04-01T22:34:04.895217+0000","last_clean":"2024-04-01T22:34:04.895217+0000","last_became_active":"2024-04-01T22:33:33.252690+0000","last_became_peered":"2024-04-01T22:33:33.252690+0000","last_unstale":"2024-04-01T22:34:04.895217+0000","last_undegraded":"2024-04-01T22:34:04.895217+0000","last_fullsized":"2024-04-01T22:34:04.895217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:04:48.921372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.935296+0000","last_change":"2024-04-01T22:33:27.855871+0000","last_active":"2024-04-01T22:34:04.935296+0000","last_peered":"2024-04-01T22:34:04.935296+0000","last_clean":"2024-04-01T22:34:04.935296+0000","last_became_active":"2024-04-01T22:33:27.855609+0000","last_became_peered":"2024-04-01T22:33:27.855609+0000","last_unstale":"2024-04-01T22:34:04.935296+0000","last_undegraded":"2024-04-01T22:34:04.935296+0000","last_fullsized":"2024-04-01T22:34:04.935296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:43:03.166262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.315726+0000","last_change":"2024-04-01T22:33:26.831819+0000","last_active":"2024-04-01T22:34:05.315726+0000","last_peered":"2024-04-01T22:34:05.315726+0000","last_clean":"2024-04-01T22:34:05.315726+0000","last_became_active":"2024-04-01T22:33:26.831554+0000","last_became_peered":"2024-04-01T22:33:26.831554+0000","last_unstale":"2024-04-01T22:34:05.315726+0000","last_undegraded":"2024-04-01T22:34:05.315726+0000","last_fullsized":"2024-04-01T22:34:05.315726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:56:04.675231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.404014+0000","last_change":"2024-04-01T22:33:32.849917+0000","last_active":"2024-04-01T22:34:05.404014+0000","last_peered":"2024-04-01T22:34:05.404014+0000","last_clean":"2024-04-01T22:34:05.404014+0000","last_became_active":"2024-04-01T22:33:32.849536+0000","last_became_peered":"2024-04-01T22:33:32.849536+0000","last_unstale":"2024-04-01T22:34:05.404014+0000","last_undegraded":"2024-04-01T22:34:05.404014+0000","last_fullsized":"2024-04-01T22:34:05.404014+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:41:50.766262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.896628+0000","last_change":"2024-04-01T22:33:27.950424+0000","last_active":"2024-04-01T22:34:04.896628+0000","last_peered":"2024-04-01T22:34:04.896628+0000","last_clean":"2024-04-01T22:34:04.896628+0000","last_became_active":"2024-04-01T22:33:27.950148+0000","last_became_peered":"2024-04-01T22:33:27.950148+0000","last_unstale":"2024-04-01T22:34:04.896628+0000","last_undegraded":"2024-04-01T22:34:04.896628+0000","last_fullsized":"2024-04-01T22:34:04.896628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:50:04.913482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.896943+0000","last_change":"2024-04-01T22:33:26.855715+0000","last_active":"2024-04-01T22:34:04.896943+0000","last_peered":"2024-04-01T22:34:04.896943+0000","last_clean":"2024-04-01T22:34:04.896943+0000","last_became_active":"2024-04-01T22:33:26.855136+0000","last_became_peered":"2024-04-01T22:33:26.855136+0000","last_unstale":"2024-04-01T22:34:04.896943+0000","last_undegraded":"2024-04-01T22:34:04.896943+0000","last_fullsized":"2024-04-01T22:34:04.896943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:19:52.712250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.403895+0000","last_change":"2024-04-01T22:33:26.830837+0000","last_active":"2024-04-01T22:34:05.403895+0000","last_peered":"2024-04-01T22:34:05.403895+0000","last_clean":"2024-04-01T22:34:05.403895+0000","last_became_active":"2024-04-01T22:33:26.830563+0000","last_became_peered":"2024-04-01T22:33:26.830563+0000","last_unstale":"2024-04-01T22:34:05.403895+0000","last_undegraded":"2024-04-01T22:34:05.403895+0000","last_fullsized":"2024-04-01T22:34:05.403895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:40:49.124240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.895092+0000","last_change":"2024-04-01T22:33:27.951393+0000","last_active":"2024-04-01T22:34:04.895092+0000","last_peered":"2024-04-01T22:34:04.895092+0000","last_clean":"2024-04-01T22:34:04.895092+0000","last_became_active":"2024-04-01T22:33:27.951103+0000","last_became_peered":"2024-04-01T22:33:27.951103+0000","last_unstale":"2024-04-01T22:34:04.895092+0000","last_undegraded":"2024-04-01T22:34:04.895092+0000","last_fullsized":"2024-04-01T22:34:04.895092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:43:57.121738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.893055+0000","last_change":"2024-04-01T22:33:32.846734+0000","last_active":"2024-04-01T22:34:04.893055+0000","last_peered":"2024-04-01T22:34:04.893055+0000","last_clean":"2024-04-01T22:34:04.893055+0000","last_became_active":"2024-04-01T22:33:32.846376+0000","last_became_peered":"2024-04-01T22:33:32.846376+0000","last_unstale":"2024-04-01T22:34:04.893055+0000","last_undegraded":"2024-04-01T22:34:04.893055+0000","last_fullsized":"2024-04-01T22:34:04.893055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:50:41.471405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.896992+0000","last_change":"2024-04-01T22:33:26.855529+0000","last_active":"2024-04-01T22:34:04.896992+0000","last_peered":"2024-04-01T22:34:04.896992+0000","last_clean":"2024-04-01T22:34:04.896992+0000","last_became_active":"2024-04-01T22:33:26.855101+0000","last_became_peered":"2024-04-01T22:33:26.855101+0000","last_unstale":"2024-04-01T22:34:04.896992+0000","last_undegraded":"2024-04-01T22:34:04.896992+0000","last_fullsized":"2024-04-01T22:34:04.896992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:40:49.124240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.288739+0000","last_change":"2024-04-01T22:33:27.868702+0000","last_active":"2024-04-01T22:34:05.288739+0000","last_peered":"2024-04-01T22:34:05.288739+0000","last_clean":"2024-04-01T22:34:05.288739+0000","last_became_active":"2024-04-01T22:33:27.868297+0000","last_became_peered":"2024-04-01T22:33:27.868297+0000","last_unstale":"2024-04-01T22:34:05.288739+0000","last_undegraded":"2024-04-01T22:34:05.288739+0000","last_fullsized":"2024-04-01T22:34:05.288739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:39:30.974746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.319978+0000","last_change":"2024-04-01T22:34:05.319978+0000","last_active":"2024-04-01T22:34:05.319978+0000","last_peered":"2024-04-01T22:34:05.319978+0000","last_clean":"2024-04-01T22:34:05.319978+0000","last_became_active":"2024-04-01T22:34:05.319550+0000","last_became_peered":"2024-04-01T22:34:05.319550+0000","last_unstale":"2024-04-01T22:34:05.319978+0000","last_undegraded":"2024-04-01T22:34:05.319978+0000","last_fullsized":"2024-04-01T22:34:05.319978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:34:03.139988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.403686+0000","last_change":"2024-04-01T22:33:27.950106+0000","last_active":"2024-04-01T22:34:05.403686+0000","last_peered":"2024-04-01T22:34:05.403686+0000","last_clean":"2024-04-01T22:34:05.403686+0000","last_became_active":"2024-04-01T22:33:27.949843+0000","last_became_peered":"2024-04-01T22:33:27.949843+0000","last_unstale":"2024-04-01T22:34:05.403686+0000","last_undegraded":"2024-04-01T22:34:05.403686+0000","last_fullsized":"2024-04-01T22:34:05.403686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:23:08.563134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.892578+0000","last_change":"2024-04-01T22:33:27.974409+0000","last_active":"2024-04-01T22:34:04.892578+0000","last_peered":"2024-04-01T22:34:04.892578+0000","last_clean":"2024-04-01T22:34:04.892578+0000","last_became_active":"2024-04-01T22:33:27.974128+0000","last_became_peered":"2024-04-01T22:33:27.974128+0000","last_unstale":"2024-04-01T22:34:04.892578+0000","last_undegraded":"2024-04-01T22:34:04.892578+0000","last_fullsized":"2024-04-01T22:34:04.892578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:49:52.536559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.316114+0000","last_change":"2024-04-01T22:33:27.974885+0000","last_active":"2024-04-01T22:34:05.316114+0000","last_peered":"2024-04-01T22:34:05.316114+0000","last_clean":"2024-04-01T22:34:05.316114+0000","last_became_active":"2024-04-01T22:33:27.973988+0000","last_became_peered":"2024-04-01T22:33:27.973988+0000","last_unstale":"2024-04-01T22:34:05.316114+0000","last_undegraded":"2024-04-01T22:34:05.316114+0000","last_fullsized":"2024-04-01T22:34:05.316114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:56:25.952727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.895003+0000","last_change":"2024-04-01T22:33:27.950817+0000","last_active":"2024-04-01T22:34:04.895003+0000","last_peered":"2024-04-01T22:34:04.895003+0000","last_clean":"2024-04-01T22:34:04.895003+0000","last_became_active":"2024-04-01T22:33:27.950515+0000","last_became_peered":"2024-04-01T22:33:27.950515+0000","last_unstale":"2024-04-01T22:34:04.895003+0000","last_undegraded":"2024-04-01T22:34:04.895003+0000","last_fullsized":"2024-04-01T22:34:04.895003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:48:53.083180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.897222+0000","last_change":"2024-04-01T22:33:27.869385+0000","last_active":"2024-04-01T22:34:04.897222+0000","last_peered":"2024-04-01T22:34:04.897222+0000","last_clean":"2024-04-01T22:34:04.897222+0000","last_became_active":"2024-04-01T22:33:27.869102+0000","last_became_peered":"2024-04-01T22:33:27.869102+0000","last_unstale":"2024-04-01T22:34:04.897222+0000","last_undegraded":"2024-04-01T22:34:04.897222+0000","last_fullsized":"2024-04-01T22:34:04.897222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:43:57.121738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.935921+0000","last_change":"2024-04-01T22:33:27.856463+0000","last_active":"2024-04-01T22:34:04.935921+0000","last_peered":"2024-04-01T22:34:04.935921+0000","last_clean":"2024-04-01T22:34:04.935921+0000","last_became_active":"2024-04-01T22:33:27.856213+0000","last_became_peered":"2024-04-01T22:33:27.856213+0000","last_unstale":"2024-04-01T22:34:04.935921+0000","last_undegraded":"2024-04-01T22:34:04.935921+0000","last_fullsized":"2024-04-01T22:34:04.935921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:43:57.121738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.404010+0000","last_change":"2024-04-01T22:33:27.921487+0000","last_active":"2024-04-01T22:34:05.404010+0000","last_peered":"2024-04-01T22:34:05.404010+0000","last_clean":"2024-04-01T22:34:05.404010+0000","last_became_active":"2024-04-01T22:33:27.921229+0000","last_became_peered":"2024-04-01T22:33:27.921229+0000","last_unstale":"2024-04-01T22:34:05.404010+0000","last_undegraded":"2024-04-01T22:34:05.404010+0000","last_fullsized":"2024-04-01T22:34:05.404010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:43:03.166262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.896523+0000","last_change":"2024-04-01T22:33:27.868732+0000","last_active":"2024-04-01T22:34:04.896523+0000","last_peered":"2024-04-01T22:34:04.896523+0000","last_clean":"2024-04-01T22:34:04.896523+0000","last_became_active":"2024-04-01T22:33:27.868496+0000","last_became_peered":"2024-04-01T22:33:27.868496+0000","last_unstale":"2024-04-01T22:34:04.896523+0000","last_undegraded":"2024-04-01T22:34:04.896523+0000","last_fullsized":"2024-04-01T22:34:04.896523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:56:25.952727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.315642+0000","last_change":"2024-04-01T22:33:27.974270+0000","last_active":"2024-04-01T22:34:05.315642+0000","last_peered":"2024-04-01T22:34:05.315642+0000","last_clean":"2024-04-01T22:34:05.315642+0000","last_became_active":"2024-04-01T22:33:27.973851+0000","last_became_peered":"2024-04-01T22:33:27.973851+0000","last_unstale":"2024-04-01T22:34:05.315642+0000","last_undegraded":"2024-04-01T22:34:05.315642+0000","last_fullsized":"2024-04-01T22:34:05.315642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:43:57.121738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.290919+0000","last_change":"2024-04-01T22:34:05.290057+0000","last_active":"2024-04-01T22:34:05.290919+0000","last_peered":"2024-04-01T22:34:05.290919+0000","last_clean":"2024-04-01T22:34:05.290919+0000","last_became_active":"2024-04-01T22:34:05.289755+0000","last_became_peered":"2024-04-01T22:34:05.289755+0000","last_unstale":"2024-04-01T22:34:05.290919+0000","last_undegraded":"2024-04-01T22:34:05.290919+0000","last_fullsized":"2024-04-01T22:34:05.290919+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:19:20.248510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.315870+0000","last_change":"2024-04-01T22:33:27.979380+0000","last_active":"2024-04-01T22:34:05.315870+0000","last_peered":"2024-04-01T22:34:05.315870+0000","last_clean":"2024-04-01T22:34:05.315870+0000","last_became_active":"2024-04-01T22:33:27.979108+0000","last_became_peered":"2024-04-01T22:33:27.979108+0000","last_unstale":"2024-04-01T22:34:05.315870+0000","last_undegraded":"2024-04-01T22:34:05.315870+0000","last_fullsized":"2024-04-01T22:34:05.315870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:50:04.913482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.894800+0000","last_change":"2024-04-01T22:33:27.953950+0000","last_active":"2024-04-01T22:34:04.894800+0000","last_peered":"2024-04-01T22:34:04.894800+0000","last_clean":"2024-04-01T22:34:04.894800+0000","last_became_active":"2024-04-01T22:33:27.953674+0000","last_became_peered":"2024-04-01T22:33:27.953674+0000","last_unstale":"2024-04-01T22:34:04.894800+0000","last_undegraded":"2024-04-01T22:34:04.894800+0000","last_fullsized":"2024-04-01T22:34:04.894800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:01:14.826403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.403892+0000","last_change":"2024-04-01T22:33:27.919041+0000","last_active":"2024-04-01T22:34:05.403892+0000","last_peered":"2024-04-01T22:34:05.403892+0000","last_clean":"2024-04-01T22:34:05.403892+0000","last_became_active":"2024-04-01T22:33:27.918815+0000","last_became_peered":"2024-04-01T22:33:27.918815+0000","last_unstale":"2024-04-01T22:34:05.403892+0000","last_undegraded":"2024-04-01T22:34:05.403892+0000","last_fullsized":"2024-04-01T22:34:05.403892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:15:08.500466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.890886+0000","last_change":"2024-04-01T22:33:27.881613+0000","last_active":"2024-04-01T22:34:04.890886+0000","last_peered":"2024-04-01T22:34:04.890886+0000","last_clean":"2024-04-01T22:34:04.890886+0000","last_became_active":"2024-04-01T22:33:27.881372+0000","last_became_peered":"2024-04-01T22:33:27.881372+0000","last_unstale":"2024-04-01T22:34:04.890886+0000","last_undegraded":"2024-04-01T22:34:04.890886+0000","last_fullsized":"2024-04-01T22:34:04.890886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:28:13.071380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.893169+0000","last_change":"2024-04-01T22:33:27.919025+0000","last_active":"2024-04-01T22:34:04.893169+0000","last_peered":"2024-04-01T22:34:04.893169+0000","last_clean":"2024-04-01T22:34:04.893169+0000","last_became_active":"2024-04-01T22:33:27.918749+0000","last_became_peered":"2024-04-01T22:33:27.918749+0000","last_unstale":"2024-04-01T22:34:04.893169+0000","last_undegraded":"2024-04-01T22:34:04.893169+0000","last_fullsized":"2024-04-01T22:34:04.893169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:47:19.535942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.316018+0000","last_change":"2024-04-01T22:33:27.979289+0000","last_active":"2024-04-01T22:34:05.316018+0000","last_peered":"2024-04-01T22:34:05.316018+0000","last_clean":"2024-04-01T22:34:05.316018+0000","last_became_active":"2024-04-01T22:33:27.979036+0000","last_became_peered":"2024-04-01T22:33:27.979036+0000","last_unstale":"2024-04-01T22:34:05.316018+0000","last_undegraded":"2024-04-01T22:34:05.316018+0000","last_fullsized":"2024-04-01T22:34:05.316018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:19:20.248510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.315515+0000","last_change":"2024-04-01T22:33:27.974214+0000","last_active":"2024-04-01T22:34:05.315515+0000","last_peered":"2024-04-01T22:34:05.315515+0000","last_clean":"2024-04-01T22:34:05.315515+0000","last_became_active":"2024-04-01T22:33:27.973962+0000","last_became_peered":"2024-04-01T22:33:27.973962+0000","last_unstale":"2024-04-01T22:34:05.315515+0000","last_undegraded":"2024-04-01T22:34:05.315515+0000","last_fullsized":"2024-04-01T22:34:05.315515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:15:08.500466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.935389+0000","last_change":"2024-04-01T22:33:27.869600+0000","last_active":"2024-04-01T22:34:04.935389+0000","last_peered":"2024-04-01T22:34:04.935389+0000","last_clean":"2024-04-01T22:34:04.935389+0000","last_became_active":"2024-04-01T22:33:27.869279+0000","last_became_peered":"2024-04-01T22:33:27.869279+0000","last_unstale":"2024-04-01T22:34:04.935389+0000","last_undegraded":"2024-04-01T22:34:04.935389+0000","last_fullsized":"2024-04-01T22:34:04.935389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:16:58.889368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.894777+0000","last_change":"2024-04-01T22:33:27.948313+0000","last_active":"2024-04-01T22:34:04.894777+0000","last_peered":"2024-04-01T22:34:04.894777+0000","last_clean":"2024-04-01T22:34:04.894777+0000","last_became_active":"2024-04-01T22:33:27.947834+0000","last_became_peered":"2024-04-01T22:33:27.947834+0000","last_unstale":"2024-04-01T22:34:04.894777+0000","last_undegraded":"2024-04-01T22:34:04.894777+0000","last_fullsized":"2024-04-01T22:34:04.894777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:50:36.571977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.896828+0000","last_change":"2024-04-01T22:33:27.915571+0000","last_active":"2024-04-01T22:34:04.896828+0000","last_peered":"2024-04-01T22:34:04.896828+0000","last_clean":"2024-04-01T22:34:04.896828+0000","last_became_active":"2024-04-01T22:33:27.915372+0000","last_became_peered":"2024-04-01T22:33:27.915372+0000","last_unstale":"2024-04-01T22:34:04.896828+0000","last_undegraded":"2024-04-01T22:34:04.896828+0000","last_fullsized":"2024-04-01T22:34:04.896828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:15:46.224658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.289027+0000","last_change":"2024-04-01T22:33:27.915752+0000","last_active":"2024-04-01T22:34:05.289027+0000","last_peered":"2024-04-01T22:34:05.289027+0000","last_clean":"2024-04-01T22:34:05.289027+0000","last_became_active":"2024-04-01T22:33:27.915515+0000","last_became_peered":"2024-04-01T22:33:27.915515+0000","last_unstale":"2024-04-01T22:34:05.289027+0000","last_undegraded":"2024-04-01T22:34:05.289027+0000","last_fullsized":"2024-04-01T22:34:05.289027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:47:19.535942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.403929+0000","last_change":"2024-04-01T22:33:27.974798+0000","last_active":"2024-04-01T22:34:05.403929+0000","last_peered":"2024-04-01T22:34:05.403929+0000","last_clean":"2024-04-01T22:34:05.403929+0000","last_became_active":"2024-04-01T22:33:27.974558+0000","last_became_peered":"2024-04-01T22:33:27.974558+0000","last_unstale":"2024-04-01T22:34:05.403929+0000","last_undegraded":"2024-04-01T22:34:05.403929+0000","last_fullsized":"2024-04-01T22:34:05.403929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:15:46.224658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.403932+0000","last_change":"2024-04-01T22:33:27.974420+0000","last_active":"2024-04-01T22:34:05.403932+0000","last_peered":"2024-04-01T22:34:05.403932+0000","last_clean":"2024-04-01T22:34:05.403932+0000","last_became_active":"2024-04-01T22:33:27.974139+0000","last_became_peered":"2024-04-01T22:33:27.974139+0000","last_unstale":"2024-04-01T22:34:05.403932+0000","last_undegraded":"2024-04-01T22:34:05.403932+0000","last_fullsized":"2024-04-01T22:34:05.403932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:48:53.083180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.890835+0000","last_change":"2024-04-01T22:33:27.972053+0000","last_active":"2024-04-01T22:34:04.890835+0000","last_peered":"2024-04-01T22:34:04.890835+0000","last_clean":"2024-04-01T22:34:04.890835+0000","last_became_active":"2024-04-01T22:33:27.971803+0000","last_became_peered":"2024-04-01T22:33:27.971803+0000","last_unstale":"2024-04-01T22:34:04.890835+0000","last_undegraded":"2024-04-01T22:34:04.890835+0000","last_fullsized":"2024-04-01T22:34:04.890835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:41:45.866834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.896441+0000","last_change":"2024-04-01T22:33:27.974447+0000","last_active":"2024-04-01T22:34:04.896441+0000","last_peered":"2024-04-01T22:34:04.896441+0000","last_clean":"2024-04-01T22:34:04.896441+0000","last_became_active":"2024-04-01T22:33:27.974205+0000","last_became_peered":"2024-04-01T22:33:27.974205+0000","last_unstale":"2024-04-01T22:34:04.896441+0000","last_undegraded":"2024-04-01T22:34:04.896441+0000","last_fullsized":"2024-04-01T22:34:04.896441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:23:08.563134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.890173+0000","last_change":"2024-04-01T22:33:27.949226+0000","last_active":"2024-04-01T22:34:04.890173+0000","last_peered":"2024-04-01T22:34:04.890173+0000","last_clean":"2024-04-01T22:34:04.890173+0000","last_became_active":"2024-04-01T22:33:27.948929+0000","last_became_peered":"2024-04-01T22:33:27.948929+0000","last_unstale":"2024-04-01T22:34:04.890173+0000","last_undegraded":"2024-04-01T22:34:04.890173+0000","last_fullsized":"2024-04-01T22:34:04.890173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:50:04.913482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.315783+0000","last_change":"2024-04-01T22:33:27.974650+0000","last_active":"2024-04-01T22:34:05.315783+0000","last_peered":"2024-04-01T22:34:05.315783+0000","last_clean":"2024-04-01T22:34:05.315783+0000","last_became_active":"2024-04-01T22:33:27.973891+0000","last_became_peered":"2024-04-01T22:33:27.973891+0000","last_unstale":"2024-04-01T22:34:05.315783+0000","last_undegraded":"2024-04-01T22:34:05.315783+0000","last_fullsized":"2024-04-01T22:34:05.315783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:08:00.537270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.890354+0000","last_change":"2024-04-01T22:33:27.879045+0000","last_active":"2024-04-01T22:34:04.890354+0000","last_peered":"2024-04-01T22:34:04.890354+0000","last_clean":"2024-04-01T22:34:04.890354+0000","last_became_active":"2024-04-01T22:33:27.878782+0000","last_became_peered":"2024-04-01T22:33:27.878782+0000","last_unstale":"2024-04-01T22:34:04.890354+0000","last_undegraded":"2024-04-01T22:34:04.890354+0000","last_fullsized":"2024-04-01T22:34:04.890354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:56:25.952727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.315891+0000","last_change":"2024-04-01T22:33:27.974592+0000","last_active":"2024-04-01T22:34:05.315891+0000","last_peered":"2024-04-01T22:34:05.315891+0000","last_clean":"2024-04-01T22:34:05.315891+0000","last_became_active":"2024-04-01T22:33:27.973592+0000","last_became_peered":"2024-04-01T22:33:27.973592+0000","last_unstale":"2024-04-01T22:34:05.315891+0000","last_undegraded":"2024-04-01T22:34:05.315891+0000","last_fullsized":"2024-04-01T22:34:05.315891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:08:15.465415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.895050+0000","last_change":"2024-04-01T22:33:27.948715+0000","last_active":"2024-04-01T22:34:04.895050+0000","last_peered":"2024-04-01T22:34:04.895050+0000","last_clean":"2024-04-01T22:34:04.895050+0000","last_became_active":"2024-04-01T22:33:27.948371+0000","last_became_peered":"2024-04-01T22:33:27.948371+0000","last_unstale":"2024-04-01T22:34:04.895050+0000","last_undegraded":"2024-04-01T22:34:04.895050+0000","last_fullsized":"2024-04-01T22:34:04.895050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:19:48.595176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.936468+0000","last_change":"2024-04-01T22:33:27.949784+0000","last_active":"2024-04-01T22:34:04.936468+0000","last_peered":"2024-04-01T22:34:04.936468+0000","last_clean":"2024-04-01T22:34:04.936468+0000","last_became_active":"2024-04-01T22:33:27.949522+0000","last_became_peered":"2024-04-01T22:33:27.949522+0000","last_unstale":"2024-04-01T22:34:04.936468+0000","last_undegraded":"2024-04-01T22:34:04.936468+0000","last_fullsized":"2024-04-01T22:34:04.936468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:15:08.500466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.890728+0000","last_change":"2024-04-01T22:33:27.915533+0000","last_active":"2024-04-01T22:34:04.890728+0000","last_peered":"2024-04-01T22:34:04.890728+0000","last_clean":"2024-04-01T22:34:04.890728+0000","last_became_active":"2024-04-01T22:33:27.915245+0000","last_became_peered":"2024-04-01T22:33:27.915245+0000","last_unstale":"2024-04-01T22:34:04.890728+0000","last_undegraded":"2024-04-01T22:34:04.890728+0000","last_fullsized":"2024-04-01T22:34:04.890728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:39:28.692092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65062,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":709974,"data_compressed":32531,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":303104,"data_stored":122866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":119114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":303104,"data_stored":119150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":303104,"data_stored":122866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":290816,"data_stored":119024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":119184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31540,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340300,"statfs":{"total":96636764160,"available":96604467200,"internally_reserved":0,"allocated":368640,"data_stored":710030,"data_compressed":32531,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32531,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32531,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T22:34:10.329 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T22:34:10.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.467+0000 7f303a9bc640 1 Processor -- start 2024-04-01T22:34:10.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.467+0000 7f303a9bc640 1 -- start start 2024-04-01T22:34:10.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.468+0000 7f303a9bc640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f303406c250 0x7f303415aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:10.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.468+0000 7f303a9bc640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f303415bb20 0x7f303415bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:10.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.468+0000 7f303a9bc640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3034154b70 con 0x7f303406c630 2024-04-01T22:34:10.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.468+0000 7f303a9bc640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f30340ce990 con 0x7f303406c250 2024-04-01T22:34:10.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.468+0000 7f303a9bc640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f30340cdac0 con 0x7f303415bb20 2024-04-01T22:34:10.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.469+0000 7f30337fe640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f303406c630 0x7f30340ceb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:51730/0 (socket says 172.21.15.47:51730) 2024-04-01T22:34:10.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.469+0000 7f30337fe640 1 -- 172.21.15.47:0/2902941930 learned_addr learned my addr 172.21.15.47:0/2902941930 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T22:34:10.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.469+0000 7f3033fff640 1 --2- 172.21.15.47:0/2902941930 >> v2:172.21.15.181:3300/0 conn(0x7f303406c250 0x7f303415aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:10.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.469+0000 7f3038f59640 1 --2- 172.21.15.47:0/2902941930 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f303415bb20 0x7f303415bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:10.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.471+0000 7f3033fff640 1 -- 172.21.15.47:0/2902941930 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f303415bb20 msgr2=0x7f303415bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:10.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.471+0000 7f3033fff640 1 --2- 172.21.15.47:0/2902941930 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f303415bb20 0x7f303415bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:10.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.471+0000 7f3033fff640 1 -- 172.21.15.47:0/2902941930 >> v1:172.21.15.47:6789/0 conn(0x7f303406c630 legacy=0x7f30340ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:10.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.471+0000 7f3033fff640 1 -- 172.21.15.47:0/2902941930 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30340cf2a0 con 0x7f303406c250 2024-04-01T22:34:10.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.473+0000 7f3033fff640 1 --2- 172.21.15.47:0/2902941930 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f303406c250 0x7f303415aec0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f30280097a0 tx=0x7f302802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4e279a08db806cf server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:10.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.475+0000 7f3032ffd640 1 -- 172.21.15.47:0/2902941930 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3028034070 con 0x7f303406c250 2024-04-01T22:34:10.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.477+0000 7f3032ffd640 1 -- 172.21.15.47:0/2902941930 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3028030610 con 0x7f303406c250 2024-04-01T22:34:10.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.477+0000 7f3032ffd640 1 -- 172.21.15.47:0/2902941930 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30280309e0 con 0x7f303406c250 2024-04-01T22:34:10.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.477+0000 7f303a9bc640 1 -- 172.21.15.47:0/2902941930 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f303406c250 msgr2=0x7f303415aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:10.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.477+0000 7f303a9bc640 1 --2- 172.21.15.47:0/2902941930 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f303406c250 0x7f303415aec0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f30280097a0 tx=0x7f302802b960 comp rx=0 tx=0).stop 2024-04-01T22:34:10.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.477+0000 7f303a9bc640 1 -- 172.21.15.47:0/2902941930 shutdown_connections 2024-04-01T22:34:10.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.477+0000 7f303a9bc640 1 --2- 172.21.15.47:0/2902941930 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f303415bb20 0x7f303415bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:10.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.477+0000 7f303a9bc640 1 --2- 172.21.15.47:0/2902941930 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f303406c250 0x7f303415aec0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:10.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.477+0000 7f303a9bc640 1 -- 172.21.15.47:0/2902941930 >> 172.21.15.47:0/2902941930 conn(0x7f30340cfdb0 msgr2=0x7f30340d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:10.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.477+0000 7f303a9bc640 1 -- 172.21.15.47:0/2902941930 shutdown_connections 2024-04-01T22:34:10.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.477+0000 7f303a9bc640 1 -- 172.21.15.47:0/2902941930 wait complete. 2024-04-01T22:34:10.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.479+0000 7f303a9bc640 1 Processor -- start 2024-04-01T22:34:10.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.479+0000 7f303a9bc640 1 -- start start 2024-04-01T22:34:10.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.479+0000 7f303a9bc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f303406c250 0x7f3034152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:10.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.479+0000 7f303a9bc640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f303406c630 0x7f30340b29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:10.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.479+0000 7f303a9bc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f303415bb20 0x7f30340caea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:10.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.479+0000 7f303a9bc640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f30340ce060 con 0x7f303415bb20 2024-04-01T22:34:10.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.479+0000 7f303a9bc640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f30340cdd80 con 0x7f303406c250 2024-04-01T22:34:10.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.479+0000 7f303a9bc640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f30340ce340 con 0x7f303406c630 2024-04-01T22:34:10.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.480+0000 7f3038f59640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f303415bb20 0x7f30340caea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:10.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.480+0000 7f3033fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f303406c250 0x7f3034152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:10.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.480+0000 7f30337fe640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f303406c630 0x7f30340b29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:10.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.480+0000 7f3038f59640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f303415bb20 0x7f30340caea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34778/0 (socket says 172.21.15.47:34778) 2024-04-01T22:34:10.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.480+0000 7f3038f59640 1 -- 172.21.15.47:0/1470339236 learned_addr learned my addr 172.21.15.47:0/1470339236 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:10.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.484+0000 7f3038f59640 1 -- 172.21.15.47:0/1470339236 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f303406c630 msgr2=0x7f30340b29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:10.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.484+0000 7f3038f59640 1 --2- 172.21.15.47:0/1470339236 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f303406c630 0x7f30340b29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:10.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.484+0000 7f3038f59640 1 -- 172.21.15.47:0/1470339236 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f303406c250 msgr2=0x7f3034152430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:10.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.484+0000 7f3038f59640 1 --2- 172.21.15.47:0/1470339236 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f303406c250 0x7f3034152430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:10.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.484+0000 7f3038f59640 1 -- 172.21.15.47:0/1470339236 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30340b3210 con 0x7f303415bb20 2024-04-01T22:34:10.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.486+0000 7f3038f59640 1 --2- 172.21.15.47:0/1470339236 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f303415bb20 0x7f30340caea0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f302c009d30 tx=0x7f302c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:10.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.490+0000 7f3030ff9640 1 -- 172.21.15.47:0/1470339236 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f302c018020 con 0x7f303415bb20 2024-04-01T22:34:10.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.490+0000 7f3030ff9640 1 -- 172.21.15.47:0/1470339236 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f302c014480 con 0x7f303415bb20 2024-04-01T22:34:10.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.490+0000 7f303a9bc640 1 -- 172.21.15.47:0/1470339236 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30340b5710 con 0x7f303415bb20 2024-04-01T22:34:10.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.490+0000 7f3030ff9640 1 -- 172.21.15.47:0/1470339236 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f302c014870 con 0x7f303415bb20 2024-04-01T22:34:10.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.490+0000 7f303a9bc640 1 -- 172.21.15.47:0/1470339236 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3034155130 con 0x7f303415bb20 2024-04-01T22:34:10.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.491+0000 7f303a9bc640 1 -- 172.21.15.47:0/1470339236 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3034068210 con 0x7f303415bb20 2024-04-01T22:34:10.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.510+0000 7f3030ff9640 1 -- 172.21.15.47:0/1470339236 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f302c005d10 con 0x7f303415bb20 2024-04-01T22:34:10.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.510+0000 7f3030ff9640 1 --2- 172.21.15.47:0/1470339236 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f302006b9e0 0x7f302006dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:10.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.510+0000 7f3033fff640 1 --2- 172.21.15.47:0/1470339236 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f302006b9e0 0x7f302006dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:10.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.511+0000 7f3033fff640 1 --2- 172.21.15.47:0/1470339236 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f302006b9e0 0x7f302006dea0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3028036000 tx=0x7f302803b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:10.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.513+0000 7f3030ff9640 1 -- 172.21.15.47:0/1470339236 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f302c0580c0 con 0x7f303415bb20 2024-04-01T22:34:10.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.772+0000 7f3030ff9640 1 -- 172.21.15.47:0/1470339236 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f302c022030 con 0x7f303415bb20 2024-04-01T22:34:10.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.951+0000 7f303a9bc640 1 -- 172.21.15.47:0/1470339236 --> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f30340ce610 con 0x7f302006b9e0 2024-04-01T22:34:10.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.959+0000 7f3030ff9640 1 -- 172.21.15.47:0/1470339236 <== mgr.4107 v2:172.21.15.47:6800/1257047371 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332611 (secure 0 0 0) 0x7f30340ce610 con 0x7f302006b9e0 2024-04-01T22:34:10.963 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:34:10.964 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-01T22:34:10.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.963+0000 7f303a9bc640 1 -- 172.21.15.47:0/1470339236 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f302006b9e0 msgr2=0x7f302006dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:10.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.963+0000 7f303a9bc640 1 --2- 172.21.15.47:0/1470339236 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f302006b9e0 0x7f302006dea0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3028036000 tx=0x7f302803b040 comp rx=0 tx=0).stop 2024-04-01T22:34:10.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.963+0000 7f303a9bc640 1 -- 172.21.15.47:0/1470339236 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f303415bb20 msgr2=0x7f30340caea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:10.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.963+0000 7f303a9bc640 1 --2- 172.21.15.47:0/1470339236 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f303415bb20 0x7f30340caea0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f302c009d30 tx=0x7f302c00c490 comp rx=0 tx=0).stop 2024-04-01T22:34:10.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.963+0000 7f303a9bc640 1 -- 172.21.15.47:0/1470339236 shutdown_connections 2024-04-01T22:34:10.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.963+0000 7f303a9bc640 1 --2- 172.21.15.47:0/1470339236 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f302006b9e0 0x7f302006dea0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:10.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.963+0000 7f303a9bc640 1 --2- 172.21.15.47:0/1470339236 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f303415bb20 0x7f30340caea0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:10.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.963+0000 7f303a9bc640 1 --2- 172.21.15.47:0/1470339236 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f303406c630 0x7f30340b29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:10.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.963+0000 7f303a9bc640 1 --2- 172.21.15.47:0/1470339236 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f303406c250 0x7f3034152430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:10.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.963+0000 7f303a9bc640 1 -- 172.21.15.47:0/1470339236 >> 172.21.15.47:0/1470339236 conn(0x7f30340cfdb0 msgr2=0x7f30340d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:10.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.963+0000 7f303a9bc640 1 -- 172.21.15.47:0/1470339236 shutdown_connections 2024-04-01T22:34:10.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:10.963+0000 7f303a9bc640 1 -- 172.21.15.47:0/1470339236 wait complete. 2024-04-01T22:34:10.974 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2024-04-01T22:34:10.788511+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":319,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226944,"kb_used_data":2464,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754747776,"statfs":{"total":773094113280,"available":772861722624,"internally_reserved":0,"allocated":2523136,"data_stored":2142208,"data_compressed":65062,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002227"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.895291+0000","last_change":"2024-04-01T22:33:26.849312+0000","last_active":"2024-04-01T22:34:04.895291+0000","last_peered":"2024-04-01T22:34:04.895291+0000","last_clean":"2024-04-01T22:34:04.895291+0000","last_became_active":"2024-04-01T22:33:26.849009+0000","last_became_peered":"2024-04-01T22:33:26.849009+0000","last_unstale":"2024-04-01T22:34:04.895291+0000","last_undegraded":"2024-04-01T22:34:04.895291+0000","last_fullsized":"2024-04-01T22:34:04.895291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:58:40.837557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.896574+0000","last_change":"2024-04-01T22:33:27.919006+0000","last_active":"2024-04-01T22:34:04.896574+0000","last_peered":"2024-04-01T22:34:04.896574+0000","last_clean":"2024-04-01T22:34:04.896574+0000","last_became_active":"2024-04-01T22:33:27.918702+0000","last_became_peered":"2024-04-01T22:33:27.918702+0000","last_unstale":"2024-04-01T22:34:04.896574+0000","last_undegraded":"2024-04-01T22:34:04.896574+0000","last_fullsized":"2024-04-01T22:34:04.896574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:08:00.537270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.896715+0000","last_change":"2024-04-01T22:33:33.255162+0000","last_active":"2024-04-01T22:34:04.896715+0000","last_peered":"2024-04-01T22:34:04.896715+0000","last_clean":"2024-04-01T22:34:04.896715+0000","last_became_active":"2024-04-01T22:33:33.254187+0000","last_became_peered":"2024-04-01T22:33:33.254187+0000","last_unstale":"2024-04-01T22:34:04.896715+0000","last_undegraded":"2024-04-01T22:34:04.896715+0000","last_fullsized":"2024-04-01T22:34:04.896715+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:57:12.343606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.896476+0000","last_change":"2024-04-01T22:33:26.855377+0000","last_active":"2024-04-01T22:34:04.896476+0000","last_peered":"2024-04-01T22:34:04.896476+0000","last_clean":"2024-04-01T22:34:04.896476+0000","last_became_active":"2024-04-01T22:33:26.855119+0000","last_became_peered":"2024-04-01T22:33:26.855119+0000","last_unstale":"2024-04-01T22:34:04.896476+0000","last_undegraded":"2024-04-01T22:34:04.896476+0000","last_fullsized":"2024-04-01T22:34:04.896476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:25:41.744696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.895106+0000","last_change":"2024-04-01T22:33:27.974175+0000","last_active":"2024-04-01T22:34:04.895106+0000","last_peered":"2024-04-01T22:34:04.895106+0000","last_clean":"2024-04-01T22:34:04.895106+0000","last_became_active":"2024-04-01T22:33:27.973915+0000","last_became_peered":"2024-04-01T22:33:27.973915+0000","last_unstale":"2024-04-01T22:34:04.895106+0000","last_undegraded":"2024-04-01T22:34:04.895106+0000","last_fullsized":"2024-04-01T22:34:04.895106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:43:03.166262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.288355+0000","last_change":"2024-04-01T22:33:32.853556+0000","last_active":"2024-04-01T22:34:05.288355+0000","last_peered":"2024-04-01T22:34:05.288355+0000","last_clean":"2024-04-01T22:34:05.288355+0000","last_became_active":"2024-04-01T22:33:32.853215+0000","last_became_peered":"2024-04-01T22:33:32.853215+0000","last_unstale":"2024-04-01T22:34:05.288355+0000","last_undegraded":"2024-04-01T22:34:05.288355+0000","last_fullsized":"2024-04-01T22:34:05.288355+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:50:09.812910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.890789+0000","last_change":"2024-04-01T22:33:26.849967+0000","last_active":"2024-04-01T22:34:04.890789+0000","last_peered":"2024-04-01T22:34:04.890789+0000","last_clean":"2024-04-01T22:34:04.890789+0000","last_became_active":"2024-04-01T22:33:26.849432+0000","last_became_peered":"2024-04-01T22:33:26.849432+0000","last_unstale":"2024-04-01T22:34:04.890789+0000","last_undegraded":"2024-04-01T22:34:04.890789+0000","last_fullsized":"2024-04-01T22:34:04.890789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:47:18.407469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.290623+0000","last_change":"2024-04-01T22:34:05.289795+0000","last_active":"2024-04-01T22:34:05.290623+0000","last_peered":"2024-04-01T22:34:05.290623+0000","last_clean":"2024-04-01T22:34:05.290623+0000","last_became_active":"2024-04-01T22:34:05.289454+0000","last_became_peered":"2024-04-01T22:34:05.289454+0000","last_unstale":"2024-04-01T22:34:05.290623+0000","last_undegraded":"2024-04-01T22:34:05.290623+0000","last_fullsized":"2024-04-01T22:34:05.290623+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:08:15.465415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.288947+0000","last_change":"2024-04-01T22:33:32.847230+0000","last_active":"2024-04-01T22:34:05.288947+0000","last_peered":"2024-04-01T22:34:05.288947+0000","last_clean":"2024-04-01T22:34:05.288947+0000","last_became_active":"2024-04-01T22:33:32.846382+0000","last_became_peered":"2024-04-01T22:33:32.846382+0000","last_unstale":"2024-04-01T22:34:05.288947+0000","last_undegraded":"2024-04-01T22:34:05.288947+0000","last_fullsized":"2024-04-01T22:34:05.288947+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:41:50.766262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.890435+0000","last_change":"2024-04-01T22:33:26.852784+0000","last_active":"2024-04-01T22:34:04.890435+0000","last_peered":"2024-04-01T22:34:04.890435+0000","last_clean":"2024-04-01T22:34:04.890435+0000","last_became_active":"2024-04-01T22:33:26.852530+0000","last_became_peered":"2024-04-01T22:33:26.852530+0000","last_unstale":"2024-04-01T22:34:04.890435+0000","last_undegraded":"2024-04-01T22:34:04.890435+0000","last_fullsized":"2024-04-01T22:34:04.890435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:39:29.846272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.315985+0000","last_change":"2024-04-01T22:33:27.974358+0000","last_active":"2024-04-01T22:34:05.315985+0000","last_peered":"2024-04-01T22:34:05.315985+0000","last_clean":"2024-04-01T22:34:05.315985+0000","last_became_active":"2024-04-01T22:33:27.974117+0000","last_became_peered":"2024-04-01T22:33:27.974117+0000","last_unstale":"2024-04-01T22:34:05.315985+0000","last_undegraded":"2024-04-01T22:34:05.315985+0000","last_fullsized":"2024-04-01T22:34:05.315985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:39:28.692092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.288607+0000","last_change":"2024-04-01T22:33:32.844681+0000","last_active":"2024-04-01T22:34:05.288607+0000","last_peered":"2024-04-01T22:34:05.288607+0000","last_clean":"2024-04-01T22:34:05.288607+0000","last_became_active":"2024-04-01T22:33:32.844334+0000","last_became_peered":"2024-04-01T22:33:32.844334+0000","last_unstale":"2024-04-01T22:34:05.288607+0000","last_undegraded":"2024-04-01T22:34:05.288607+0000","last_fullsized":"2024-04-01T22:34:05.288607+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:56:30.852155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.403722+0000","last_change":"2024-04-01T22:33:27.918822+0000","last_active":"2024-04-01T22:34:05.403722+0000","last_peered":"2024-04-01T22:34:05.403722+0000","last_clean":"2024-04-01T22:34:05.403722+0000","last_became_active":"2024-04-01T22:33:27.918466+0000","last_became_peered":"2024-04-01T22:33:27.918466+0000","last_unstale":"2024-04-01T22:34:05.403722+0000","last_undegraded":"2024-04-01T22:34:05.403722+0000","last_fullsized":"2024-04-01T22:34:05.403722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:43:57.121738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.890470+0000","last_change":"2024-04-01T22:33:26.850443+0000","last_active":"2024-04-01T22:34:04.890470+0000","last_peered":"2024-04-01T22:34:04.890470+0000","last_clean":"2024-04-01T22:34:04.890470+0000","last_became_active":"2024-04-01T22:33:26.849954+0000","last_became_peered":"2024-04-01T22:33:26.849954+0000","last_unstale":"2024-04-01T22:34:04.890470+0000","last_undegraded":"2024-04-01T22:34:04.890470+0000","last_fullsized":"2024-04-01T22:34:04.890470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:49:51.408086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.289098+0000","last_change":"2024-04-01T22:33:32.853569+0000","last_active":"2024-04-01T22:34:05.289098+0000","last_peered":"2024-04-01T22:34:05.289098+0000","last_clean":"2024-04-01T22:34:05.289098+0000","last_became_active":"2024-04-01T22:33:32.853185+0000","last_became_peered":"2024-04-01T22:33:32.853185+0000","last_unstale":"2024-04-01T22:34:05.289098+0000","last_undegraded":"2024-04-01T22:34:05.289098+0000","last_fullsized":"2024-04-01T22:34:05.289098+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:19:25.147938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.896929+0000","last_change":"2024-04-01T22:33:27.949789+0000","last_active":"2024-04-01T22:34:04.896929+0000","last_peered":"2024-04-01T22:34:04.896929+0000","last_clean":"2024-04-01T22:34:04.896929+0000","last_became_active":"2024-04-01T22:33:27.949518+0000","last_became_peered":"2024-04-01T22:33:27.949518+0000","last_unstale":"2024-04-01T22:34:04.896929+0000","last_undegraded":"2024-04-01T22:34:04.896929+0000","last_fullsized":"2024-04-01T22:34:04.896929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:15:08.500466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.935696+0000","last_change":"2024-04-01T22:33:26.856856+0000","last_active":"2024-04-01T22:34:04.935696+0000","last_peered":"2024-04-01T22:34:04.935696+0000","last_clean":"2024-04-01T22:34:04.935696+0000","last_became_active":"2024-04-01T22:33:26.856591+0000","last_became_peered":"2024-04-01T22:33:26.856591+0000","last_unstale":"2024-04-01T22:34:04.935696+0000","last_undegraded":"2024-04-01T22:34:04.935696+0000","last_fullsized":"2024-04-01T22:34:04.935696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:38:14.576161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.288898+0000","last_change":"2024-04-01T22:33:32.847352+0000","last_active":"2024-04-01T22:34:05.288898+0000","last_peered":"2024-04-01T22:34:05.288898+0000","last_clean":"2024-04-01T22:34:05.288898+0000","last_became_active":"2024-04-01T22:33:32.846849+0000","last_became_peered":"2024-04-01T22:33:32.846849+0000","last_unstale":"2024-04-01T22:34:05.288898+0000","last_undegraded":"2024-04-01T22:34:05.288898+0000","last_fullsized":"2024-04-01T22:34:05.288898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:04:48.921372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.896722+0000","last_change":"2024-04-01T22:33:27.855387+0000","last_active":"2024-04-01T22:34:04.896722+0000","last_peered":"2024-04-01T22:34:04.896722+0000","last_clean":"2024-04-01T22:34:04.896722+0000","last_became_active":"2024-04-01T22:33:27.855123+0000","last_became_peered":"2024-04-01T22:33:27.855123+0000","last_unstale":"2024-04-01T22:34:04.896722+0000","last_undegraded":"2024-04-01T22:34:04.896722+0000","last_fullsized":"2024-04-01T22:34:04.896722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:16:58.889368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.935482+0000","last_change":"2024-04-01T22:33:26.848128+0000","last_active":"2024-04-01T22:34:04.935482+0000","last_peered":"2024-04-01T22:34:04.935482+0000","last_clean":"2024-04-01T22:34:04.935482+0000","last_became_active":"2024-04-01T22:33:26.847904+0000","last_became_peered":"2024-04-01T22:33:26.847904+0000","last_unstale":"2024-04-01T22:34:04.935482+0000","last_undegraded":"2024-04-01T22:34:04.935482+0000","last_fullsized":"2024-04-01T22:34:04.935482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:41:58.838710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.290928+0000","last_change":"2024-04-01T22:34:05.290215+0000","last_active":"2024-04-01T22:34:05.290928+0000","last_peered":"2024-04-01T22:34:05.290928+0000","last_clean":"2024-04-01T22:34:05.290928+0000","last_became_active":"2024-04-01T22:34:05.289769+0000","last_became_peered":"2024-04-01T22:34:05.289769+0000","last_unstale":"2024-04-01T22:34:05.290928+0000","last_undegraded":"2024-04-01T22:34:05.290928+0000","last_fullsized":"2024-04-01T22:34:05.290928+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:39:33.591520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,7],"acting":[2,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.288692+0000","last_change":"2024-04-01T22:33:27.868997+0000","last_active":"2024-04-01T22:34:05.288692+0000","last_peered":"2024-04-01T22:34:05.288692+0000","last_clean":"2024-04-01T22:34:05.288692+0000","last_became_active":"2024-04-01T22:33:27.868713+0000","last_became_peered":"2024-04-01T22:33:27.868713+0000","last_unstale":"2024-04-01T22:34:05.288692+0000","last_undegraded":"2024-04-01T22:34:05.288692+0000","last_fullsized":"2024-04-01T22:34:05.288692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:41:59.967183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.890068+0000","last_change":"2024-04-01T22:33:26.848037+0000","last_active":"2024-04-01T22:34:04.890068+0000","last_peered":"2024-04-01T22:34:04.890068+0000","last_clean":"2024-04-01T22:34:04.890068+0000","last_became_active":"2024-04-01T22:33:26.847736+0000","last_became_peered":"2024-04-01T22:33:26.847736+0000","last_unstale":"2024-04-01T22:34:04.890068+0000","last_undegraded":"2024-04-01T22:34:04.890068+0000","last_fullsized":"2024-04-01T22:34:04.890068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:56:04.675231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.289161+0000","last_change":"2024-04-01T22:33:32.847015+0000","last_active":"2024-04-01T22:34:05.289161+0000","last_peered":"2024-04-01T22:34:05.289161+0000","last_clean":"2024-04-01T22:34:05.289161+0000","last_became_active":"2024-04-01T22:33:32.846639+0000","last_became_peered":"2024-04-01T22:33:32.846639+0000","last_unstale":"2024-04-01T22:34:05.289161+0000","last_undegraded":"2024-04-01T22:34:05.289161+0000","last_fullsized":"2024-04-01T22:34:05.289161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:47:09.903506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.895438+0000","last_change":"2024-04-01T22:33:27.948117+0000","last_active":"2024-04-01T22:34:04.895438+0000","last_peered":"2024-04-01T22:34:04.895438+0000","last_clean":"2024-04-01T22:34:04.895438+0000","last_became_active":"2024-04-01T22:33:27.947735+0000","last_became_peered":"2024-04-01T22:33:27.947735+0000","last_unstale":"2024-04-01T22:34:04.895438+0000","last_undegraded":"2024-04-01T22:34:04.895438+0000","last_fullsized":"2024-04-01T22:34:04.895438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:16:58.889368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.404225+0000","last_change":"2024-04-01T22:33:26.849404+0000","last_active":"2024-04-01T22:34:05.404225+0000","last_peered":"2024-04-01T22:34:05.404225+0000","last_clean":"2024-04-01T22:34:05.404225+0000","last_became_active":"2024-04-01T22:33:26.849086+0000","last_became_peered":"2024-04-01T22:33:26.849086+0000","last_unstale":"2024-04-01T22:34:05.404225+0000","last_undegraded":"2024-04-01T22:34:05.404225+0000","last_fullsized":"2024-04-01T22:34:05.404225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:41:58.838710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.288674+0000","last_change":"2024-04-01T22:33:33.249726+0000","last_active":"2024-04-01T22:34:05.288674+0000","last_peered":"2024-04-01T22:34:05.288674+0000","last_clean":"2024-04-01T22:34:05.288674+0000","last_became_active":"2024-04-01T22:33:33.249309+0000","last_became_peered":"2024-04-01T22:33:33.249309+0000","last_unstale":"2024-04-01T22:34:05.288674+0000","last_undegraded":"2024-04-01T22:34:05.288674+0000","last_fullsized":"2024-04-01T22:34:05.288674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:08:20.364843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.896624+0000","last_change":"2024-04-01T22:33:27.879797+0000","last_active":"2024-04-01T22:34:04.896624+0000","last_peered":"2024-04-01T22:34:04.896624+0000","last_clean":"2024-04-01T22:34:04.896624+0000","last_became_active":"2024-04-01T22:33:27.879582+0000","last_became_peered":"2024-04-01T22:33:27.879582+0000","last_unstale":"2024-04-01T22:34:04.896624+0000","last_undegraded":"2024-04-01T22:34:04.896624+0000","last_fullsized":"2024-04-01T22:34:04.896624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:08:15.465415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.936562+0000","last_change":"2024-04-01T22:33:26.847504+0000","last_active":"2024-04-01T22:34:04.936562+0000","last_peered":"2024-04-01T22:34:04.936562+0000","last_clean":"2024-04-01T22:34:04.936562+0000","last_became_active":"2024-04-01T22:33:26.847333+0000","last_became_peered":"2024-04-01T22:33:26.847333+0000","last_unstale":"2024-04-01T22:34:04.936562+0000","last_undegraded":"2024-04-01T22:34:04.936562+0000","last_fullsized":"2024-04-01T22:34:04.936562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:39:29.846272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.896278+0000","last_change":"2024-04-01T22:33:33.255030+0000","last_active":"2024-04-01T22:34:04.896278+0000","last_peered":"2024-04-01T22:34:04.896278+0000","last_clean":"2024-04-01T22:34:04.896278+0000","last_became_active":"2024-04-01T22:33:33.254621+0000","last_became_peered":"2024-04-01T22:33:33.254621+0000","last_unstale":"2024-04-01T22:34:04.896278+0000","last_undegraded":"2024-04-01T22:34:04.896278+0000","last_fullsized":"2024-04-01T22:34:04.896278+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:19:44.325870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.936119+0000","last_change":"2024-04-01T22:33:27.855669+0000","last_active":"2024-04-01T22:34:04.936119+0000","last_peered":"2024-04-01T22:34:04.936119+0000","last_clean":"2024-04-01T22:34:04.936119+0000","last_became_active":"2024-04-01T22:33:27.855419+0000","last_became_peered":"2024-04-01T22:33:27.855419+0000","last_unstale":"2024-04-01T22:34:04.936119+0000","last_undegraded":"2024-04-01T22:34:04.936119+0000","last_fullsized":"2024-04-01T22:34:04.936119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:15:46.224658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.890932+0000","last_change":"2024-04-01T22:33:26.850176+0000","last_active":"2024-04-01T22:34:04.890932+0000","last_peered":"2024-04-01T22:34:04.890932+0000","last_clean":"2024-04-01T22:34:04.890932+0000","last_became_active":"2024-04-01T22:33:26.849717+0000","last_became_peered":"2024-04-01T22:33:26.849717+0000","last_unstale":"2024-04-01T22:34:04.890932+0000","last_undegraded":"2024-04-01T22:34:04.890932+0000","last_fullsized":"2024-04-01T22:34:04.890932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:18:55.842886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.893929+0000","last_change":"2024-04-01T22:33:33.249765+0000","last_active":"2024-04-01T22:34:04.893929+0000","last_peered":"2024-04-01T22:34:04.893929+0000","last_clean":"2024-04-01T22:34:04.893929+0000","last_became_active":"2024-04-01T22:33:33.249370+0000","last_became_peered":"2024-04-01T22:33:33.249370+0000","last_unstale":"2024-04-01T22:34:04.893929+0000","last_undegraded":"2024-04-01T22:34:04.893929+0000","last_fullsized":"2024-04-01T22:34:04.893929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:41:50.766262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.316076+0000","last_change":"2024-04-01T22:33:27.979163+0000","last_active":"2024-04-01T22:34:05.316076+0000","last_peered":"2024-04-01T22:34:05.316076+0000","last_clean":"2024-04-01T22:34:05.316076+0000","last_became_active":"2024-04-01T22:33:27.978902+0000","last_became_peered":"2024-04-01T22:33:27.978902+0000","last_unstale":"2024-04-01T22:34:05.316076+0000","last_undegraded":"2024-04-01T22:34:05.316076+0000","last_fullsized":"2024-04-01T22:34:05.316076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:04:44.021944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.936216+0000","last_change":"2024-04-01T22:33:26.846575+0000","last_active":"2024-04-01T22:34:04.936216+0000","last_peered":"2024-04-01T22:34:04.936216+0000","last_clean":"2024-04-01T22:34:04.936216+0000","last_became_active":"2024-04-01T22:33:26.846265+0000","last_became_peered":"2024-04-01T22:33:26.846265+0000","last_unstale":"2024-04-01T22:34:04.936216+0000","last_undegraded":"2024-04-01T22:34:04.936216+0000","last_fullsized":"2024-04-01T22:34:04.936216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:56:04.675231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.935218+0000","last_change":"2024-04-01T22:33:32.850553+0000","last_active":"2024-04-01T22:34:04.935218+0000","last_peered":"2024-04-01T22:34:04.935218+0000","last_clean":"2024-04-01T22:34:04.935218+0000","last_became_active":"2024-04-01T22:33:32.849774+0000","last_became_peered":"2024-04-01T22:33:32.849774+0000","last_unstale":"2024-04-01T22:34:04.935218+0000","last_undegraded":"2024-04-01T22:34:04.935218+0000","last_fullsized":"2024-04-01T22:34:04.935218+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:04:48.921372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.289106+0000","last_change":"2024-04-01T22:33:27.949879+0000","last_active":"2024-04-01T22:34:05.289106+0000","last_peered":"2024-04-01T22:34:05.289106+0000","last_clean":"2024-04-01T22:34:05.289106+0000","last_became_active":"2024-04-01T22:33:27.949620+0000","last_became_peered":"2024-04-01T22:33:27.949620+0000","last_unstale":"2024-04-01T22:34:05.289106+0000","last_undegraded":"2024-04-01T22:34:05.289106+0000","last_fullsized":"2024-04-01T22:34:05.289106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:49:52.536559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.316240+0000","last_change":"2024-04-01T22:33:26.846346+0000","last_active":"2024-04-01T22:34:05.316240+0000","last_peered":"2024-04-01T22:34:05.316240+0000","last_clean":"2024-04-01T22:34:05.316240+0000","last_became_active":"2024-04-01T22:33:26.846052+0000","last_became_peered":"2024-04-01T22:33:26.846052+0000","last_unstale":"2024-04-01T22:34:05.316240+0000","last_undegraded":"2024-04-01T22:34:05.316240+0000","last_fullsized":"2024-04-01T22:34:05.316240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:41:58.838710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.935885+0000","last_change":"2024-04-01T22:33:32.846766+0000","last_active":"2024-04-01T22:34:04.935885+0000","last_peered":"2024-04-01T22:34:04.935885+0000","last_clean":"2024-04-01T22:34:04.935885+0000","last_became_active":"2024-04-01T22:33:32.846422+0000","last_became_peered":"2024-04-01T22:33:32.846422+0000","last_unstale":"2024-04-01T22:34:04.935885+0000","last_undegraded":"2024-04-01T22:34:04.935885+0000","last_fullsized":"2024-04-01T22:34:04.935885+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:41:50.766262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.935195+0000","last_change":"2024-04-01T22:33:27.855299+0000","last_active":"2024-04-01T22:34:04.935195+0000","last_peered":"2024-04-01T22:34:04.935195+0000","last_clean":"2024-04-01T22:34:04.935195+0000","last_became_active":"2024-04-01T22:33:27.855035+0000","last_became_peered":"2024-04-01T22:33:27.855035+0000","last_unstale":"2024-04-01T22:34:04.935195+0000","last_undegraded":"2024-04-01T22:34:04.935195+0000","last_fullsized":"2024-04-01T22:34:04.935195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:48:53.083180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.893005+0000","last_change":"2024-04-01T22:33:26.856300+0000","last_active":"2024-04-01T22:34:04.893005+0000","last_peered":"2024-04-01T22:34:04.893005+0000","last_clean":"2024-04-01T22:34:04.893005+0000","last_became_active":"2024-04-01T22:33:26.855864+0000","last_became_peered":"2024-04-01T22:33:26.855864+0000","last_unstale":"2024-04-01T22:34:04.893005+0000","last_undegraded":"2024-04-01T22:34:04.893005+0000","last_fullsized":"2024-04-01T22:34:04.893005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:38:14.576161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.317957+0000","last_change":"2024-04-01T22:34:05.317101+0000","last_active":"2024-04-01T22:34:05.317957+0000","last_peered":"2024-04-01T22:34:05.317957+0000","last_clean":"2024-04-01T22:34:05.317957+0000","last_became_active":"2024-04-01T22:34:05.316665+0000","last_became_peered":"2024-04-01T22:34:05.316665+0000","last_unstale":"2024-04-01T22:34:05.317957+0000","last_undegraded":"2024-04-01T22:34:05.317957+0000","last_fullsized":"2024-04-01T22:34:05.317957+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:47:09.903506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.894392+0000","last_change":"2024-04-01T22:33:27.949013+0000","last_active":"2024-04-01T22:34:04.894392+0000","last_peered":"2024-04-01T22:34:04.894392+0000","last_clean":"2024-04-01T22:34:04.894392+0000","last_became_active":"2024-04-01T22:33:27.948687+0000","last_became_peered":"2024-04-01T22:33:27.948687+0000","last_unstale":"2024-04-01T22:34:04.894392+0000","last_undegraded":"2024-04-01T22:34:04.894392+0000","last_fullsized":"2024-04-01T22:34:04.894392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:50:54.852207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.890115+0000","last_change":"2024-04-01T22:33:26.848366+0000","last_active":"2024-04-01T22:34:04.890115+0000","last_peered":"2024-04-01T22:34:04.890115+0000","last_clean":"2024-04-01T22:34:04.890115+0000","last_became_active":"2024-04-01T22:33:26.848019+0000","last_became_peered":"2024-04-01T22:33:26.848019+0000","last_unstale":"2024-04-01T22:34:04.890115+0000","last_undegraded":"2024-04-01T22:34:04.890115+0000","last_fullsized":"2024-04-01T22:34:04.890115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:41:58.838710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.895340+0000","last_change":"2024-04-01T22:33:33.253077+0000","last_active":"2024-04-01T22:34:04.895340+0000","last_peered":"2024-04-01T22:34:04.895340+0000","last_clean":"2024-04-01T22:34:04.895340+0000","last_became_active":"2024-04-01T22:33:33.252725+0000","last_became_peered":"2024-04-01T22:33:33.252725+0000","last_unstale":"2024-04-01T22:34:04.895340+0000","last_undegraded":"2024-04-01T22:34:04.895340+0000","last_fullsized":"2024-04-01T22:34:04.895340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:28:17.970808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.896965+0000","last_change":"2024-04-01T22:33:27.975039+0000","last_active":"2024-04-01T22:34:04.896965+0000","last_peered":"2024-04-01T22:34:04.896965+0000","last_clean":"2024-04-01T22:34:04.896965+0000","last_became_active":"2024-04-01T22:33:27.974751+0000","last_became_peered":"2024-04-01T22:33:27.974751+0000","last_unstale":"2024-04-01T22:34:04.896965+0000","last_undegraded":"2024-04-01T22:34:04.896965+0000","last_fullsized":"2024-04-01T22:34:04.896965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:43:03.166262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.315889+0000","last_change":"2024-04-01T22:33:26.831690+0000","last_active":"2024-04-01T22:34:05.315889+0000","last_peered":"2024-04-01T22:34:05.315889+0000","last_clean":"2024-04-01T22:34:05.315889+0000","last_became_active":"2024-04-01T22:33:26.831398+0000","last_became_peered":"2024-04-01T22:33:26.831398+0000","last_unstale":"2024-04-01T22:34:05.315889+0000","last_undegraded":"2024-04-01T22:34:05.315889+0000","last_fullsized":"2024-04-01T22:34:05.315889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:38:14.576161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":182,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.890173+0000","last_change":"2024-04-01T22:33:15.962585+0000","last_active":"2024-04-01T22:34:04.890173+0000","last_peered":"2024-04-01T22:34:04.890173+0000","last_clean":"2024-04-01T22:34:04.890173+0000","last_became_active":"2024-04-01T22:33:15.961762+0000","last_became_peered":"2024-04-01T22:33:15.961762+0000","last_unstale":"2024-04-01T22:34:04.890173+0000","last_undegraded":"2024-04-01T22:34:04.890173+0000","last_fullsized":"2024-04-01T22:34:04.890173+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:13.756389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:13.756389+0000","last_clean_scrub_stamp":"2024-04-01T22:33:13.756389+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:33:28.684533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.403864+0000","last_change":"2024-04-01T22:33:33.252863+0000","last_active":"2024-04-01T22:34:05.403864+0000","last_peered":"2024-04-01T22:34:05.403864+0000","last_clean":"2024-04-01T22:34:05.403864+0000","last_became_active":"2024-04-01T22:33:33.252494+0000","last_became_peered":"2024-04-01T22:33:33.252494+0000","last_unstale":"2024-04-01T22:34:05.403864+0000","last_undegraded":"2024-04-01T22:34:05.403864+0000","last_fullsized":"2024-04-01T22:34:05.403864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:47:09.903506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.937211+0000","last_change":"2024-04-01T22:34:04.937211+0000","last_active":"2024-04-01T22:34:04.937211+0000","last_peered":"2024-04-01T22:34:04.937211+0000","last_clean":"2024-04-01T22:34:04.937211+0000","last_became_active":"2024-04-01T22:34:04.936886+0000","last_became_peered":"2024-04-01T22:34:04.936886+0000","last_unstale":"2024-04-01T22:34:04.937211+0000","last_undegraded":"2024-04-01T22:34:04.937211+0000","last_fullsized":"2024-04-01T22:34:04.937211+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:53:33.542832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.893356+0000","last_change":"2024-04-01T22:33:26.832331+0000","last_active":"2024-04-01T22:34:04.893356+0000","last_peered":"2024-04-01T22:34:04.893356+0000","last_clean":"2024-04-01T22:34:04.893356+0000","last_became_active":"2024-04-01T22:33:26.832078+0000","last_became_peered":"2024-04-01T22:33:26.832078+0000","last_unstale":"2024-04-01T22:34:04.893356+0000","last_undegraded":"2024-04-01T22:34:04.893356+0000","last_fullsized":"2024-04-01T22:34:04.893356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:40:49.124240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.403719+0000","last_change":"2024-04-01T22:33:33.249696+0000","last_active":"2024-04-01T22:34:05.403719+0000","last_peered":"2024-04-01T22:34:05.403719+0000","last_clean":"2024-04-01T22:34:05.403719+0000","last_became_active":"2024-04-01T22:33:33.249313+0000","last_became_peered":"2024-04-01T22:33:33.249313+0000","last_unstale":"2024-04-01T22:34:05.403719+0000","last_undegraded":"2024-04-01T22:34:05.403719+0000","last_fullsized":"2024-04-01T22:34:05.403719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:39:33.591520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.315935+0000","last_change":"2024-04-01T22:33:27.971916+0000","last_active":"2024-04-01T22:34:05.315935+0000","last_peered":"2024-04-01T22:34:05.315935+0000","last_clean":"2024-04-01T22:34:05.315935+0000","last_became_active":"2024-04-01T22:33:27.971672+0000","last_became_peered":"2024-04-01T22:33:27.971672+0000","last_unstale":"2024-04-01T22:34:05.315935+0000","last_undegraded":"2024-04-01T22:34:05.315935+0000","last_fullsized":"2024-04-01T22:34:05.315935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:43:39.489075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.936257+0000","last_change":"2024-04-01T22:33:26.849350+0000","last_active":"2024-04-01T22:34:04.936257+0000","last_peered":"2024-04-01T22:34:04.936257+0000","last_clean":"2024-04-01T22:34:04.936257+0000","last_became_active":"2024-04-01T22:33:26.849098+0000","last_became_peered":"2024-04-01T22:33:26.849098+0000","last_unstale":"2024-04-01T22:34:04.936257+0000","last_undegraded":"2024-04-01T22:34:04.936257+0000","last_fullsized":"2024-04-01T22:34:04.936257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:47:18.407469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.894909+0000","last_change":"2024-04-01T22:33:32.847889+0000","last_active":"2024-04-01T22:34:04.894909+0000","last_peered":"2024-04-01T22:34:04.894909+0000","last_clean":"2024-04-01T22:34:04.894909+0000","last_became_active":"2024-04-01T22:33:32.847546+0000","last_became_peered":"2024-04-01T22:33:32.847546+0000","last_unstale":"2024-04-01T22:34:04.894909+0000","last_undegraded":"2024-04-01T22:34:04.894909+0000","last_fullsized":"2024-04-01T22:34:04.894909+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:57:05.158344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.890886+0000","last_change":"2024-04-01T22:33:27.881170+0000","last_active":"2024-04-01T22:34:04.890886+0000","last_peered":"2024-04-01T22:34:04.890886+0000","last_clean":"2024-04-01T22:34:04.890886+0000","last_became_active":"2024-04-01T22:33:27.880870+0000","last_became_peered":"2024-04-01T22:33:27.880870+0000","last_unstale":"2024-04-01T22:34:04.890886+0000","last_undegraded":"2024-04-01T22:34:04.890886+0000","last_fullsized":"2024-04-01T22:34:04.890886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:43:39.489075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.893268+0000","last_change":"2024-04-01T22:33:26.856069+0000","last_active":"2024-04-01T22:34:04.893268+0000","last_peered":"2024-04-01T22:34:04.893268+0000","last_clean":"2024-04-01T22:34:04.893268+0000","last_became_active":"2024-04-01T22:33:26.855705+0000","last_became_peered":"2024-04-01T22:33:26.855705+0000","last_unstale":"2024-04-01T22:34:04.893268+0000","last_undegraded":"2024-04-01T22:34:04.893268+0000","last_fullsized":"2024-04-01T22:34:04.893268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:56:04.675231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.315507+0000","last_change":"2024-04-01T22:33:33.249689+0000","last_active":"2024-04-01T22:34:05.315507+0000","last_peered":"2024-04-01T22:34:05.315507+0000","last_clean":"2024-04-01T22:34:05.315507+0000","last_became_active":"2024-04-01T22:33:33.249315+0000","last_became_peered":"2024-04-01T22:33:33.249315+0000","last_unstale":"2024-04-01T22:34:05.315507+0000","last_undegraded":"2024-04-01T22:34:05.315507+0000","last_fullsized":"2024-04-01T22:34:05.315507+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:19:44.325870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.890692+0000","last_change":"2024-04-01T22:33:27.881320+0000","last_active":"2024-04-01T22:34:04.890692+0000","last_peered":"2024-04-01T22:34:04.890692+0000","last_clean":"2024-04-01T22:34:04.890692+0000","last_became_active":"2024-04-01T22:33:27.880973+0000","last_became_peered":"2024-04-01T22:33:27.880973+0000","last_unstale":"2024-04-01T22:34:04.890692+0000","last_undegraded":"2024-04-01T22:34:04.890692+0000","last_fullsized":"2024-04-01T22:34:04.890692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:04:44.021944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.289266+0000","last_change":"2024-04-01T22:33:26.845121+0000","last_active":"2024-04-01T22:34:05.289266+0000","last_peered":"2024-04-01T22:34:05.289266+0000","last_clean":"2024-04-01T22:34:05.289266+0000","last_became_active":"2024-04-01T22:33:26.844852+0000","last_became_peered":"2024-04-01T22:33:26.844852+0000","last_unstale":"2024-04-01T22:34:05.289266+0000","last_undegraded":"2024-04-01T22:34:05.289266+0000","last_fullsized":"2024-04-01T22:34:05.289266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:58:40.837557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.288473+0000","last_change":"2024-04-01T22:33:32.846922+0000","last_active":"2024-04-01T22:34:05.288473+0000","last_peered":"2024-04-01T22:34:05.288473+0000","last_clean":"2024-04-01T22:34:05.288473+0000","last_became_active":"2024-04-01T22:33:32.846387+0000","last_became_peered":"2024-04-01T22:33:32.846387+0000","last_unstale":"2024-04-01T22:34:05.288473+0000","last_undegraded":"2024-04-01T22:34:05.288473+0000","last_fullsized":"2024-04-01T22:34:05.288473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:08:05.436698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.890208+0000","last_change":"2024-04-01T22:33:27.884447+0000","last_active":"2024-04-01T22:34:04.890208+0000","last_peered":"2024-04-01T22:34:04.890208+0000","last_clean":"2024-04-01T22:34:04.890208+0000","last_became_active":"2024-04-01T22:33:27.884148+0000","last_became_peered":"2024-04-01T22:33:27.884148+0000","last_unstale":"2024-04-01T22:34:04.890208+0000","last_undegraded":"2024-04-01T22:34:04.890208+0000","last_fullsized":"2024-04-01T22:34:04.890208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:08:00.537270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.892643+0000","last_change":"2024-04-01T22:33:26.844884+0000","last_active":"2024-04-01T22:34:04.892643+0000","last_peered":"2024-04-01T22:34:04.892643+0000","last_clean":"2024-04-01T22:34:04.892643+0000","last_became_active":"2024-04-01T22:33:26.844583+0000","last_became_peered":"2024-04-01T22:33:26.844583+0000","last_unstale":"2024-04-01T22:34:04.892643+0000","last_undegraded":"2024-04-01T22:34:04.892643+0000","last_fullsized":"2024-04-01T22:34:04.892643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:25:41.744696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.895307+0000","last_change":"2024-04-01T22:33:32.845036+0000","last_active":"2024-04-01T22:34:04.895307+0000","last_peered":"2024-04-01T22:34:04.895307+0000","last_clean":"2024-04-01T22:34:04.895307+0000","last_became_active":"2024-04-01T22:33:32.844555+0000","last_became_peered":"2024-04-01T22:33:32.844555+0000","last_unstale":"2024-04-01T22:34:04.895307+0000","last_undegraded":"2024-04-01T22:34:04.895307+0000","last_fullsized":"2024-04-01T22:34:04.895307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:43:44.388503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.403752+0000","last_change":"2024-04-01T22:33:27.950227+0000","last_active":"2024-04-01T22:34:05.403752+0000","last_peered":"2024-04-01T22:34:05.403752+0000","last_clean":"2024-04-01T22:34:05.403752+0000","last_became_active":"2024-04-01T22:33:27.949366+0000","last_became_peered":"2024-04-01T22:33:27.949366+0000","last_unstale":"2024-04-01T22:34:05.403752+0000","last_undegraded":"2024-04-01T22:34:05.403752+0000","last_fullsized":"2024-04-01T22:34:05.403752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:16:58.889368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.403834+0000","last_change":"2024-04-01T22:33:26.830463+0000","last_active":"2024-04-01T22:34:05.403834+0000","last_peered":"2024-04-01T22:34:05.403834+0000","last_clean":"2024-04-01T22:34:05.403834+0000","last_became_active":"2024-04-01T22:33:26.830179+0000","last_became_peered":"2024-04-01T22:33:26.830179+0000","last_unstale":"2024-04-01T22:34:05.403834+0000","last_undegraded":"2024-04-01T22:34:05.403834+0000","last_fullsized":"2024-04-01T22:34:05.403834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:38:14.576161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.896415+0000","last_change":"2024-04-01T22:33:33.252812+0000","last_active":"2024-04-01T22:34:04.896415+0000","last_peered":"2024-04-01T22:34:04.896415+0000","last_clean":"2024-04-01T22:34:04.896415+0000","last_became_active":"2024-04-01T22:33:33.252412+0000","last_became_peered":"2024-04-01T22:33:33.252412+0000","last_unstale":"2024-04-01T22:34:04.896415+0000","last_undegraded":"2024-04-01T22:34:04.896415+0000","last_fullsized":"2024-04-01T22:34:04.896415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:53:38.442260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.890447+0000","last_change":"2024-04-01T22:33:27.880363+0000","last_active":"2024-04-01T22:34:04.890447+0000","last_peered":"2024-04-01T22:34:04.890447+0000","last_clean":"2024-04-01T22:34:04.890447+0000","last_became_active":"2024-04-01T22:33:27.880096+0000","last_became_peered":"2024-04-01T22:33:27.880096+0000","last_unstale":"2024-04-01T22:34:04.890447+0000","last_undegraded":"2024-04-01T22:34:04.890447+0000","last_fullsized":"2024-04-01T22:34:04.890447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:19:20.248510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.316196+0000","last_change":"2024-04-01T22:33:26.855823+0000","last_active":"2024-04-01T22:34:05.316196+0000","last_peered":"2024-04-01T22:34:05.316196+0000","last_clean":"2024-04-01T22:34:05.316196+0000","last_became_active":"2024-04-01T22:33:26.855475+0000","last_became_peered":"2024-04-01T22:33:26.855475+0000","last_unstale":"2024-04-01T22:34:05.316196+0000","last_undegraded":"2024-04-01T22:34:05.316196+0000","last_fullsized":"2024-04-01T22:34:05.316196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:39:29.846272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.897132+0000","last_change":"2024-04-01T22:33:33.249941+0000","last_active":"2024-04-01T22:34:04.897132+0000","last_peered":"2024-04-01T22:34:04.897132+0000","last_clean":"2024-04-01T22:34:04.897132+0000","last_became_active":"2024-04-01T22:33:33.249352+0000","last_became_peered":"2024-04-01T22:33:33.249352+0000","last_unstale":"2024-04-01T22:34:04.897132+0000","last_undegraded":"2024-04-01T22:34:04.897132+0000","last_fullsized":"2024-04-01T22:34:04.897132+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:36:10.226231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.894871+0000","last_change":"2024-04-01T22:33:27.948988+0000","last_active":"2024-04-01T22:34:04.894871+0000","last_peered":"2024-04-01T22:34:04.894871+0000","last_clean":"2024-04-01T22:34:04.894871+0000","last_became_active":"2024-04-01T22:33:27.948691+0000","last_became_peered":"2024-04-01T22:33:27.948691+0000","last_unstale":"2024-04-01T22:34:04.894871+0000","last_undegraded":"2024-04-01T22:34:04.894871+0000","last_fullsized":"2024-04-01T22:34:04.894871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:23:08.563134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.895290+0000","last_change":"2024-04-01T22:33:26.849911+0000","last_active":"2024-04-01T22:34:04.895290+0000","last_peered":"2024-04-01T22:34:04.895290+0000","last_clean":"2024-04-01T22:34:04.895290+0000","last_became_active":"2024-04-01T22:33:26.849646+0000","last_became_peered":"2024-04-01T22:33:26.849646+0000","last_unstale":"2024-04-01T22:34:04.895290+0000","last_undegraded":"2024-04-01T22:34:04.895290+0000","last_fullsized":"2024-04-01T22:34:04.895290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:29:59.992702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.315876+0000","last_change":"2024-04-01T22:33:33.250214+0000","last_active":"2024-04-01T22:34:05.315876+0000","last_peered":"2024-04-01T22:34:05.315876+0000","last_clean":"2024-04-01T22:34:05.315876+0000","last_became_active":"2024-04-01T22:33:33.249853+0000","last_became_peered":"2024-04-01T22:33:33.249853+0000","last_unstale":"2024-04-01T22:34:05.315876+0000","last_undegraded":"2024-04-01T22:34:05.315876+0000","last_fullsized":"2024-04-01T22:34:05.315876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:57:12.343606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.898920+0000","last_change":"2024-04-01T22:34:04.898357+0000","last_active":"2024-04-01T22:34:04.898920+0000","last_peered":"2024-04-01T22:34:04.898920+0000","last_clean":"2024-04-01T22:34:04.898920+0000","last_became_active":"2024-04-01T22:34:04.898014+0000","last_became_peered":"2024-04-01T22:34:04.898014+0000","last_unstale":"2024-04-01T22:34:04.898920+0000","last_undegraded":"2024-04-01T22:34:04.898920+0000","last_fullsized":"2024-04-01T22:34:04.898920+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:56:25.952727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.404016+0000","last_change":"2024-04-01T22:33:26.855687+0000","last_active":"2024-04-01T22:34:05.404016+0000","last_peered":"2024-04-01T22:34:05.404016+0000","last_clean":"2024-04-01T22:34:05.404016+0000","last_became_active":"2024-04-01T22:33:26.855400+0000","last_became_peered":"2024-04-01T22:33:26.855400+0000","last_unstale":"2024-04-01T22:34:05.404016+0000","last_undegraded":"2024-04-01T22:34:05.404016+0000","last_fullsized":"2024-04-01T22:34:05.404016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:39:29.846272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.935610+0000","last_change":"2024-04-01T22:33:32.846727+0000","last_active":"2024-04-01T22:34:04.935610+0000","last_peered":"2024-04-01T22:34:04.935610+0000","last_clean":"2024-04-01T22:34:04.935610+0000","last_became_active":"2024-04-01T22:33:32.846156+0000","last_became_peered":"2024-04-01T22:33:32.846156+0000","last_unstale":"2024-04-01T22:34:04.935610+0000","last_undegraded":"2024-04-01T22:34:04.935610+0000","last_fullsized":"2024-04-01T22:34:04.935610+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:57:05.158344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.289050+0000","last_change":"2024-04-01T22:33:27.879445+0000","last_active":"2024-04-01T22:34:05.289050+0000","last_peered":"2024-04-01T22:34:05.289050+0000","last_clean":"2024-04-01T22:34:05.289050+0000","last_became_active":"2024-04-01T22:33:27.879165+0000","last_became_peered":"2024-04-01T22:33:27.879165+0000","last_unstale":"2024-04-01T22:34:05.289050+0000","last_undegraded":"2024-04-01T22:34:05.289050+0000","last_fullsized":"2024-04-01T22:34:05.289050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:18:56.971360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.936151+0000","last_change":"2024-04-01T22:33:26.851767+0000","last_active":"2024-04-01T22:34:04.936151+0000","last_peered":"2024-04-01T22:34:04.936151+0000","last_clean":"2024-04-01T22:34:04.936151+0000","last_became_active":"2024-04-01T22:33:26.851489+0000","last_became_peered":"2024-04-01T22:33:26.851489+0000","last_unstale":"2024-04-01T22:34:04.936151+0000","last_undegraded":"2024-04-01T22:34:04.936151+0000","last_fullsized":"2024-04-01T22:34:04.936151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:49:51.408086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.288786+0000","last_change":"2024-04-01T22:33:32.846386+0000","last_active":"2024-04-01T22:34:05.288786+0000","last_peered":"2024-04-01T22:34:05.288786+0000","last_clean":"2024-04-01T22:34:05.288786+0000","last_became_active":"2024-04-01T22:33:32.846024+0000","last_became_peered":"2024-04-01T22:33:32.846024+0000","last_unstale":"2024-04-01T22:34:05.288786+0000","last_undegraded":"2024-04-01T22:34:05.288786+0000","last_fullsized":"2024-04-01T22:34:05.288786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:39:33.591520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.895208+0000","last_change":"2024-04-01T22:33:27.974120+0000","last_active":"2024-04-01T22:34:04.895208+0000","last_peered":"2024-04-01T22:34:04.895208+0000","last_clean":"2024-04-01T22:34:04.895208+0000","last_became_active":"2024-04-01T22:33:27.973846+0000","last_became_peered":"2024-04-01T22:33:27.973846+0000","last_unstale":"2024-04-01T22:34:04.895208+0000","last_undegraded":"2024-04-01T22:34:04.895208+0000","last_fullsized":"2024-04-01T22:34:04.895208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:15:46.224658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.315912+0000","last_change":"2024-04-01T22:33:26.831927+0000","last_active":"2024-04-01T22:34:05.315912+0000","last_peered":"2024-04-01T22:34:05.315912+0000","last_clean":"2024-04-01T22:34:05.315912+0000","last_became_active":"2024-04-01T22:33:26.831676+0000","last_became_peered":"2024-04-01T22:33:26.831676+0000","last_unstale":"2024-04-01T22:34:05.315912+0000","last_undegraded":"2024-04-01T22:34:05.315912+0000","last_fullsized":"2024-04-01T22:34:05.315912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:40:49.124240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.896543+0000","last_change":"2024-04-01T22:33:32.849983+0000","last_active":"2024-04-01T22:34:04.896543+0000","last_peered":"2024-04-01T22:34:04.896543+0000","last_clean":"2024-04-01T22:34:04.896543+0000","last_became_active":"2024-04-01T22:33:32.849661+0000","last_became_peered":"2024-04-01T22:33:32.849661+0000","last_unstale":"2024-04-01T22:34:04.896543+0000","last_undegraded":"2024-04-01T22:34:04.896543+0000","last_fullsized":"2024-04-01T22:34:04.896543+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:41:40.370250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.315868+0000","last_change":"2024-04-01T22:33:27.972417+0000","last_active":"2024-04-01T22:34:05.315868+0000","last_peered":"2024-04-01T22:34:05.315868+0000","last_clean":"2024-04-01T22:34:05.315868+0000","last_became_active":"2024-04-01T22:33:27.972173+0000","last_became_peered":"2024-04-01T22:33:27.972173+0000","last_unstale":"2024-04-01T22:34:05.315868+0000","last_undegraded":"2024-04-01T22:34:05.315868+0000","last_fullsized":"2024-04-01T22:34:05.315868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:47:05.004078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.404131+0000","last_change":"2024-04-01T22:33:26.831934+0000","last_active":"2024-04-01T22:34:05.404131+0000","last_peered":"2024-04-01T22:34:05.404131+0000","last_clean":"2024-04-01T22:34:05.404131+0000","last_became_active":"2024-04-01T22:33:26.831702+0000","last_became_peered":"2024-04-01T22:33:26.831702+0000","last_unstale":"2024-04-01T22:34:05.404131+0000","last_undegraded":"2024-04-01T22:34:05.404131+0000","last_fullsized":"2024-04-01T22:34:05.404131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:56:04.675231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.896776+0000","last_change":"2024-04-01T22:33:33.254394+0000","last_active":"2024-04-01T22:34:04.896776+0000","last_peered":"2024-04-01T22:34:04.896776+0000","last_clean":"2024-04-01T22:34:04.896776+0000","last_became_active":"2024-04-01T22:33:33.253993+0000","last_became_peered":"2024-04-01T22:33:33.253993+0000","last_unstale":"2024-04-01T22:34:04.896776+0000","last_undegraded":"2024-04-01T22:34:04.896776+0000","last_fullsized":"2024-04-01T22:34:04.896776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:11:05.243371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.895217+0000","last_change":"2024-04-01T22:33:33.253062+0000","last_active":"2024-04-01T22:34:04.895217+0000","last_peered":"2024-04-01T22:34:04.895217+0000","last_clean":"2024-04-01T22:34:04.895217+0000","last_became_active":"2024-04-01T22:33:33.252690+0000","last_became_peered":"2024-04-01T22:33:33.252690+0000","last_unstale":"2024-04-01T22:34:04.895217+0000","last_undegraded":"2024-04-01T22:34:04.895217+0000","last_fullsized":"2024-04-01T22:34:04.895217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:04:48.921372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.935296+0000","last_change":"2024-04-01T22:33:27.855871+0000","last_active":"2024-04-01T22:34:04.935296+0000","last_peered":"2024-04-01T22:34:04.935296+0000","last_clean":"2024-04-01T22:34:04.935296+0000","last_became_active":"2024-04-01T22:33:27.855609+0000","last_became_peered":"2024-04-01T22:33:27.855609+0000","last_unstale":"2024-04-01T22:34:04.935296+0000","last_undegraded":"2024-04-01T22:34:04.935296+0000","last_fullsized":"2024-04-01T22:34:04.935296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:43:03.166262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.315726+0000","last_change":"2024-04-01T22:33:26.831819+0000","last_active":"2024-04-01T22:34:05.315726+0000","last_peered":"2024-04-01T22:34:05.315726+0000","last_clean":"2024-04-01T22:34:05.315726+0000","last_became_active":"2024-04-01T22:33:26.831554+0000","last_became_peered":"2024-04-01T22:33:26.831554+0000","last_unstale":"2024-04-01T22:34:05.315726+0000","last_undegraded":"2024-04-01T22:34:05.315726+0000","last_fullsized":"2024-04-01T22:34:05.315726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:56:04.675231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.404014+0000","last_change":"2024-04-01T22:33:32.849917+0000","last_active":"2024-04-01T22:34:05.404014+0000","last_peered":"2024-04-01T22:34:05.404014+0000","last_clean":"2024-04-01T22:34:05.404014+0000","last_became_active":"2024-04-01T22:33:32.849536+0000","last_became_peered":"2024-04-01T22:33:32.849536+0000","last_unstale":"2024-04-01T22:34:05.404014+0000","last_undegraded":"2024-04-01T22:34:05.404014+0000","last_fullsized":"2024-04-01T22:34:05.404014+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:41:50.766262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.896628+0000","last_change":"2024-04-01T22:33:27.950424+0000","last_active":"2024-04-01T22:34:04.896628+0000","last_peered":"2024-04-01T22:34:04.896628+0000","last_clean":"2024-04-01T22:34:04.896628+0000","last_became_active":"2024-04-01T22:33:27.950148+0000","last_became_peered":"2024-04-01T22:33:27.950148+0000","last_unstale":"2024-04-01T22:34:04.896628+0000","last_undegraded":"2024-04-01T22:34:04.896628+0000","last_fullsized":"2024-04-01T22:34:04.896628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:50:04.913482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.896943+0000","last_change":"2024-04-01T22:33:26.855715+0000","last_active":"2024-04-01T22:34:04.896943+0000","last_peered":"2024-04-01T22:34:04.896943+0000","last_clean":"2024-04-01T22:34:04.896943+0000","last_became_active":"2024-04-01T22:33:26.855136+0000","last_became_peered":"2024-04-01T22:33:26.855136+0000","last_unstale":"2024-04-01T22:34:04.896943+0000","last_undegraded":"2024-04-01T22:34:04.896943+0000","last_fullsized":"2024-04-01T22:34:04.896943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:19:52.712250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.403895+0000","last_change":"2024-04-01T22:33:26.830837+0000","last_active":"2024-04-01T22:34:05.403895+0000","last_peered":"2024-04-01T22:34:05.403895+0000","last_clean":"2024-04-01T22:34:05.403895+0000","last_became_active":"2024-04-01T22:33:26.830563+0000","last_became_peered":"2024-04-01T22:33:26.830563+0000","last_unstale":"2024-04-01T22:34:05.403895+0000","last_undegraded":"2024-04-01T22:34:05.403895+0000","last_fullsized":"2024-04-01T22:34:05.403895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:40:49.124240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.895092+0000","last_change":"2024-04-01T22:33:27.951393+0000","last_active":"2024-04-01T22:34:04.895092+0000","last_peered":"2024-04-01T22:34:04.895092+0000","last_clean":"2024-04-01T22:34:04.895092+0000","last_became_active":"2024-04-01T22:33:27.951103+0000","last_became_peered":"2024-04-01T22:33:27.951103+0000","last_unstale":"2024-04-01T22:34:04.895092+0000","last_undegraded":"2024-04-01T22:34:04.895092+0000","last_fullsized":"2024-04-01T22:34:04.895092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:43:57.121738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.893055+0000","last_change":"2024-04-01T22:33:32.846734+0000","last_active":"2024-04-01T22:34:04.893055+0000","last_peered":"2024-04-01T22:34:04.893055+0000","last_clean":"2024-04-01T22:34:04.893055+0000","last_became_active":"2024-04-01T22:33:32.846376+0000","last_became_peered":"2024-04-01T22:33:32.846376+0000","last_unstale":"2024-04-01T22:34:04.893055+0000","last_undegraded":"2024-04-01T22:34:04.893055+0000","last_fullsized":"2024-04-01T22:34:04.893055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:50:41.471405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.896992+0000","last_change":"2024-04-01T22:33:26.855529+0000","last_active":"2024-04-01T22:34:04.896992+0000","last_peered":"2024-04-01T22:34:04.896992+0000","last_clean":"2024-04-01T22:34:04.896992+0000","last_became_active":"2024-04-01T22:33:26.855101+0000","last_became_peered":"2024-04-01T22:33:26.855101+0000","last_unstale":"2024-04-01T22:34:04.896992+0000","last_undegraded":"2024-04-01T22:34:04.896992+0000","last_fullsized":"2024-04-01T22:34:04.896992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:40:49.124240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.288739+0000","last_change":"2024-04-01T22:33:27.868702+0000","last_active":"2024-04-01T22:34:05.288739+0000","last_peered":"2024-04-01T22:34:05.288739+0000","last_clean":"2024-04-01T22:34:05.288739+0000","last_became_active":"2024-04-01T22:33:27.868297+0000","last_became_peered":"2024-04-01T22:33:27.868297+0000","last_unstale":"2024-04-01T22:34:05.288739+0000","last_undegraded":"2024-04-01T22:34:05.288739+0000","last_fullsized":"2024-04-01T22:34:05.288739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:39:30.974746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.319978+0000","last_change":"2024-04-01T22:34:05.319978+0000","last_active":"2024-04-01T22:34:05.319978+0000","last_peered":"2024-04-01T22:34:05.319978+0000","last_clean":"2024-04-01T22:34:05.319978+0000","last_became_active":"2024-04-01T22:34:05.319550+0000","last_became_peered":"2024-04-01T22:34:05.319550+0000","last_unstale":"2024-04-01T22:34:05.319978+0000","last_undegraded":"2024-04-01T22:34:05.319978+0000","last_fullsized":"2024-04-01T22:34:05.319978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:34:03.139988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.403686+0000","last_change":"2024-04-01T22:33:27.950106+0000","last_active":"2024-04-01T22:34:05.403686+0000","last_peered":"2024-04-01T22:34:05.403686+0000","last_clean":"2024-04-01T22:34:05.403686+0000","last_became_active":"2024-04-01T22:33:27.949843+0000","last_became_peered":"2024-04-01T22:33:27.949843+0000","last_unstale":"2024-04-01T22:34:05.403686+0000","last_undegraded":"2024-04-01T22:34:05.403686+0000","last_fullsized":"2024-04-01T22:34:05.403686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:23:08.563134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.892578+0000","last_change":"2024-04-01T22:33:27.974409+0000","last_active":"2024-04-01T22:34:04.892578+0000","last_peered":"2024-04-01T22:34:04.892578+0000","last_clean":"2024-04-01T22:34:04.892578+0000","last_became_active":"2024-04-01T22:33:27.974128+0000","last_became_peered":"2024-04-01T22:33:27.974128+0000","last_unstale":"2024-04-01T22:34:04.892578+0000","last_undegraded":"2024-04-01T22:34:04.892578+0000","last_fullsized":"2024-04-01T22:34:04.892578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:49:52.536559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.316114+0000","last_change":"2024-04-01T22:33:27.974885+0000","last_active":"2024-04-01T22:34:05.316114+0000","last_peered":"2024-04-01T22:34:05.316114+0000","last_clean":"2024-04-01T22:34:05.316114+0000","last_became_active":"2024-04-01T22:33:27.973988+0000","last_became_peered":"2024-04-01T22:33:27.973988+0000","last_unstale":"2024-04-01T22:34:05.316114+0000","last_undegraded":"2024-04-01T22:34:05.316114+0000","last_fullsized":"2024-04-01T22:34:05.316114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:56:25.952727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.895003+0000","last_change":"2024-04-01T22:33:27.950817+0000","last_active":"2024-04-01T22:34:04.895003+0000","last_peered":"2024-04-01T22:34:04.895003+0000","last_clean":"2024-04-01T22:34:04.895003+0000","last_became_active":"2024-04-01T22:33:27.950515+0000","last_became_peered":"2024-04-01T22:33:27.950515+0000","last_unstale":"2024-04-01T22:34:04.895003+0000","last_undegraded":"2024-04-01T22:34:04.895003+0000","last_fullsized":"2024-04-01T22:34:04.895003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:48:53.083180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.897222+0000","last_change":"2024-04-01T22:33:27.869385+0000","last_active":"2024-04-01T22:34:04.897222+0000","last_peered":"2024-04-01T22:34:04.897222+0000","last_clean":"2024-04-01T22:34:04.897222+0000","last_became_active":"2024-04-01T22:33:27.869102+0000","last_became_peered":"2024-04-01T22:33:27.869102+0000","last_unstale":"2024-04-01T22:34:04.897222+0000","last_undegraded":"2024-04-01T22:34:04.897222+0000","last_fullsized":"2024-04-01T22:34:04.897222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:43:57.121738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.935921+0000","last_change":"2024-04-01T22:33:27.856463+0000","last_active":"2024-04-01T22:34:04.935921+0000","last_peered":"2024-04-01T22:34:04.935921+0000","last_clean":"2024-04-01T22:34:04.935921+0000","last_became_active":"2024-04-01T22:33:27.856213+0000","last_became_peered":"2024-04-01T22:33:27.856213+0000","last_unstale":"2024-04-01T22:34:04.935921+0000","last_undegraded":"2024-04-01T22:34:04.935921+0000","last_fullsized":"2024-04-01T22:34:04.935921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:43:57.121738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.404010+0000","last_change":"2024-04-01T22:33:27.921487+0000","last_active":"2024-04-01T22:34:05.404010+0000","last_peered":"2024-04-01T22:34:05.404010+0000","last_clean":"2024-04-01T22:34:05.404010+0000","last_became_active":"2024-04-01T22:33:27.921229+0000","last_became_peered":"2024-04-01T22:33:27.921229+0000","last_unstale":"2024-04-01T22:34:05.404010+0000","last_undegraded":"2024-04-01T22:34:05.404010+0000","last_fullsized":"2024-04-01T22:34:05.404010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:43:03.166262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.896523+0000","last_change":"2024-04-01T22:33:27.868732+0000","last_active":"2024-04-01T22:34:04.896523+0000","last_peered":"2024-04-01T22:34:04.896523+0000","last_clean":"2024-04-01T22:34:04.896523+0000","last_became_active":"2024-04-01T22:33:27.868496+0000","last_became_peered":"2024-04-01T22:33:27.868496+0000","last_unstale":"2024-04-01T22:34:04.896523+0000","last_undegraded":"2024-04-01T22:34:04.896523+0000","last_fullsized":"2024-04-01T22:34:04.896523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:56:25.952727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.315642+0000","last_change":"2024-04-01T22:33:27.974270+0000","last_active":"2024-04-01T22:34:05.315642+0000","last_peered":"2024-04-01T22:34:05.315642+0000","last_clean":"2024-04-01T22:34:05.315642+0000","last_became_active":"2024-04-01T22:33:27.973851+0000","last_became_peered":"2024-04-01T22:33:27.973851+0000","last_unstale":"2024-04-01T22:34:05.315642+0000","last_undegraded":"2024-04-01T22:34:05.315642+0000","last_fullsized":"2024-04-01T22:34:05.315642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:43:57.121738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.290919+0000","last_change":"2024-04-01T22:34:05.290057+0000","last_active":"2024-04-01T22:34:05.290919+0000","last_peered":"2024-04-01T22:34:05.290919+0000","last_clean":"2024-04-01T22:34:05.290919+0000","last_became_active":"2024-04-01T22:34:05.289755+0000","last_became_peered":"2024-04-01T22:34:05.289755+0000","last_unstale":"2024-04-01T22:34:05.290919+0000","last_undegraded":"2024-04-01T22:34:05.290919+0000","last_fullsized":"2024-04-01T22:34:05.290919+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:19:20.248510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.315870+0000","last_change":"2024-04-01T22:33:27.979380+0000","last_active":"2024-04-01T22:34:05.315870+0000","last_peered":"2024-04-01T22:34:05.315870+0000","last_clean":"2024-04-01T22:34:05.315870+0000","last_became_active":"2024-04-01T22:33:27.979108+0000","last_became_peered":"2024-04-01T22:33:27.979108+0000","last_unstale":"2024-04-01T22:34:05.315870+0000","last_undegraded":"2024-04-01T22:34:05.315870+0000","last_fullsized":"2024-04-01T22:34:05.315870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:50:04.913482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.894800+0000","last_change":"2024-04-01T22:33:27.953950+0000","last_active":"2024-04-01T22:34:04.894800+0000","last_peered":"2024-04-01T22:34:04.894800+0000","last_clean":"2024-04-01T22:34:04.894800+0000","last_became_active":"2024-04-01T22:33:27.953674+0000","last_became_peered":"2024-04-01T22:33:27.953674+0000","last_unstale":"2024-04-01T22:34:04.894800+0000","last_undegraded":"2024-04-01T22:34:04.894800+0000","last_fullsized":"2024-04-01T22:34:04.894800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:01:14.826403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.403892+0000","last_change":"2024-04-01T22:33:27.919041+0000","last_active":"2024-04-01T22:34:05.403892+0000","last_peered":"2024-04-01T22:34:05.403892+0000","last_clean":"2024-04-01T22:34:05.403892+0000","last_became_active":"2024-04-01T22:33:27.918815+0000","last_became_peered":"2024-04-01T22:33:27.918815+0000","last_unstale":"2024-04-01T22:34:05.403892+0000","last_undegraded":"2024-04-01T22:34:05.403892+0000","last_fullsized":"2024-04-01T22:34:05.403892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:15:08.500466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.890886+0000","last_change":"2024-04-01T22:33:27.881613+0000","last_active":"2024-04-01T22:34:04.890886+0000","last_peered":"2024-04-01T22:34:04.890886+0000","last_clean":"2024-04-01T22:34:04.890886+0000","last_became_active":"2024-04-01T22:33:27.881372+0000","last_became_peered":"2024-04-01T22:33:27.881372+0000","last_unstale":"2024-04-01T22:34:04.890886+0000","last_undegraded":"2024-04-01T22:34:04.890886+0000","last_fullsized":"2024-04-01T22:34:04.890886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:28:13.071380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.893169+0000","last_change":"2024-04-01T22:33:27.919025+0000","last_active":"2024-04-01T22:34:04.893169+0000","last_peered":"2024-04-01T22:34:04.893169+0000","last_clean":"2024-04-01T22:34:04.893169+0000","last_became_active":"2024-04-01T22:33:27.918749+0000","last_became_peered":"2024-04-01T22:33:27.918749+0000","last_unstale":"2024-04-01T22:34:04.893169+0000","last_undegraded":"2024-04-01T22:34:04.893169+0000","last_fullsized":"2024-04-01T22:34:04.893169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:47:19.535942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.316018+0000","last_change":"2024-04-01T22:33:27.979289+0000","last_active":"2024-04-01T22:34:05.316018+0000","last_peered":"2024-04-01T22:34:05.316018+0000","last_clean":"2024-04-01T22:34:05.316018+0000","last_became_active":"2024-04-01T22:33:27.979036+0000","last_became_peered":"2024-04-01T22:33:27.979036+0000","last_unstale":"2024-04-01T22:34:05.316018+0000","last_undegraded":"2024-04-01T22:34:05.316018+0000","last_fullsized":"2024-04-01T22:34:05.316018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:19:20.248510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.315515+0000","last_change":"2024-04-01T22:33:27.974214+0000","last_active":"2024-04-01T22:34:05.315515+0000","last_peered":"2024-04-01T22:34:05.315515+0000","last_clean":"2024-04-01T22:34:05.315515+0000","last_became_active":"2024-04-01T22:33:27.973962+0000","last_became_peered":"2024-04-01T22:33:27.973962+0000","last_unstale":"2024-04-01T22:34:05.315515+0000","last_undegraded":"2024-04-01T22:34:05.315515+0000","last_fullsized":"2024-04-01T22:34:05.315515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:15:08.500466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.935389+0000","last_change":"2024-04-01T22:33:27.869600+0000","last_active":"2024-04-01T22:34:04.935389+0000","last_peered":"2024-04-01T22:34:04.935389+0000","last_clean":"2024-04-01T22:34:04.935389+0000","last_became_active":"2024-04-01T22:33:27.869279+0000","last_became_peered":"2024-04-01T22:33:27.869279+0000","last_unstale":"2024-04-01T22:34:04.935389+0000","last_undegraded":"2024-04-01T22:34:04.935389+0000","last_fullsized":"2024-04-01T22:34:04.935389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:16:58.889368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.894777+0000","last_change":"2024-04-01T22:33:27.948313+0000","last_active":"2024-04-01T22:34:04.894777+0000","last_peered":"2024-04-01T22:34:04.894777+0000","last_clean":"2024-04-01T22:34:04.894777+0000","last_became_active":"2024-04-01T22:33:27.947834+0000","last_became_peered":"2024-04-01T22:33:27.947834+0000","last_unstale":"2024-04-01T22:34:04.894777+0000","last_undegraded":"2024-04-01T22:34:04.894777+0000","last_fullsized":"2024-04-01T22:34:04.894777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:50:36.571977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.896828+0000","last_change":"2024-04-01T22:33:27.915571+0000","last_active":"2024-04-01T22:34:04.896828+0000","last_peered":"2024-04-01T22:34:04.896828+0000","last_clean":"2024-04-01T22:34:04.896828+0000","last_became_active":"2024-04-01T22:33:27.915372+0000","last_became_peered":"2024-04-01T22:33:27.915372+0000","last_unstale":"2024-04-01T22:34:04.896828+0000","last_undegraded":"2024-04-01T22:34:04.896828+0000","last_fullsized":"2024-04-01T22:34:04.896828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:15:46.224658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.289027+0000","last_change":"2024-04-01T22:33:27.915752+0000","last_active":"2024-04-01T22:34:05.289027+0000","last_peered":"2024-04-01T22:34:05.289027+0000","last_clean":"2024-04-01T22:34:05.289027+0000","last_became_active":"2024-04-01T22:33:27.915515+0000","last_became_peered":"2024-04-01T22:33:27.915515+0000","last_unstale":"2024-04-01T22:34:05.289027+0000","last_undegraded":"2024-04-01T22:34:05.289027+0000","last_fullsized":"2024-04-01T22:34:05.289027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:47:19.535942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.403929+0000","last_change":"2024-04-01T22:33:27.974798+0000","last_active":"2024-04-01T22:34:05.403929+0000","last_peered":"2024-04-01T22:34:05.403929+0000","last_clean":"2024-04-01T22:34:05.403929+0000","last_became_active":"2024-04-01T22:33:27.974558+0000","last_became_peered":"2024-04-01T22:33:27.974558+0000","last_unstale":"2024-04-01T22:34:05.403929+0000","last_undegraded":"2024-04-01T22:34:05.403929+0000","last_fullsized":"2024-04-01T22:34:05.403929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:15:46.224658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.403932+0000","last_change":"2024-04-01T22:33:27.974420+0000","last_active":"2024-04-01T22:34:05.403932+0000","last_peered":"2024-04-01T22:34:05.403932+0000","last_clean":"2024-04-01T22:34:05.403932+0000","last_became_active":"2024-04-01T22:33:27.974139+0000","last_became_peered":"2024-04-01T22:33:27.974139+0000","last_unstale":"2024-04-01T22:34:05.403932+0000","last_undegraded":"2024-04-01T22:34:05.403932+0000","last_fullsized":"2024-04-01T22:34:05.403932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:48:53.083180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.890835+0000","last_change":"2024-04-01T22:33:27.972053+0000","last_active":"2024-04-01T22:34:04.890835+0000","last_peered":"2024-04-01T22:34:04.890835+0000","last_clean":"2024-04-01T22:34:04.890835+0000","last_became_active":"2024-04-01T22:33:27.971803+0000","last_became_peered":"2024-04-01T22:33:27.971803+0000","last_unstale":"2024-04-01T22:34:04.890835+0000","last_undegraded":"2024-04-01T22:34:04.890835+0000","last_fullsized":"2024-04-01T22:34:04.890835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:41:45.866834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.896441+0000","last_change":"2024-04-01T22:33:27.974447+0000","last_active":"2024-04-01T22:34:04.896441+0000","last_peered":"2024-04-01T22:34:04.896441+0000","last_clean":"2024-04-01T22:34:04.896441+0000","last_became_active":"2024-04-01T22:33:27.974205+0000","last_became_peered":"2024-04-01T22:33:27.974205+0000","last_unstale":"2024-04-01T22:34:04.896441+0000","last_undegraded":"2024-04-01T22:34:04.896441+0000","last_fullsized":"2024-04-01T22:34:04.896441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:23:08.563134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.890173+0000","last_change":"2024-04-01T22:33:27.949226+0000","last_active":"2024-04-01T22:34:04.890173+0000","last_peered":"2024-04-01T22:34:04.890173+0000","last_clean":"2024-04-01T22:34:04.890173+0000","last_became_active":"2024-04-01T22:33:27.948929+0000","last_became_peered":"2024-04-01T22:33:27.948929+0000","last_unstale":"2024-04-01T22:34:04.890173+0000","last_undegraded":"2024-04-01T22:34:04.890173+0000","last_fullsized":"2024-04-01T22:34:04.890173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:50:04.913482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.315783+0000","last_change":"2024-04-01T22:33:27.974650+0000","last_active":"2024-04-01T22:34:05.315783+0000","last_peered":"2024-04-01T22:34:05.315783+0000","last_clean":"2024-04-01T22:34:05.315783+0000","last_became_active":"2024-04-01T22:33:27.973891+0000","last_became_peered":"2024-04-01T22:33:27.973891+0000","last_unstale":"2024-04-01T22:34:05.315783+0000","last_undegraded":"2024-04-01T22:34:05.315783+0000","last_fullsized":"2024-04-01T22:34:05.315783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:08:00.537270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.890354+0000","last_change":"2024-04-01T22:33:27.879045+0000","last_active":"2024-04-01T22:34:04.890354+0000","last_peered":"2024-04-01T22:34:04.890354+0000","last_clean":"2024-04-01T22:34:04.890354+0000","last_became_active":"2024-04-01T22:33:27.878782+0000","last_became_peered":"2024-04-01T22:33:27.878782+0000","last_unstale":"2024-04-01T22:34:04.890354+0000","last_undegraded":"2024-04-01T22:34:04.890354+0000","last_fullsized":"2024-04-01T22:34:04.890354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:56:25.952727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:05.315891+0000","last_change":"2024-04-01T22:33:27.974592+0000","last_active":"2024-04-01T22:34:05.315891+0000","last_peered":"2024-04-01T22:34:05.315891+0000","last_clean":"2024-04-01T22:34:05.315891+0000","last_became_active":"2024-04-01T22:33:27.973592+0000","last_became_peered":"2024-04-01T22:33:27.973592+0000","last_unstale":"2024-04-01T22:34:05.315891+0000","last_undegraded":"2024-04-01T22:34:05.315891+0000","last_fullsized":"2024-04-01T22:34:05.315891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:08:15.465415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.895050+0000","last_change":"2024-04-01T22:33:27.948715+0000","last_active":"2024-04-01T22:34:04.895050+0000","last_peered":"2024-04-01T22:34:04.895050+0000","last_clean":"2024-04-01T22:34:04.895050+0000","last_became_active":"2024-04-01T22:33:27.948371+0000","last_became_peered":"2024-04-01T22:33:27.948371+0000","last_unstale":"2024-04-01T22:34:04.895050+0000","last_undegraded":"2024-04-01T22:34:04.895050+0000","last_fullsized":"2024-04-01T22:34:04.895050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:19:48.595176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.936468+0000","last_change":"2024-04-01T22:33:27.949784+0000","last_active":"2024-04-01T22:34:04.936468+0000","last_peered":"2024-04-01T22:34:04.936468+0000","last_clean":"2024-04-01T22:34:04.936468+0000","last_became_active":"2024-04-01T22:33:27.949522+0000","last_became_peered":"2024-04-01T22:33:27.949522+0000","last_unstale":"2024-04-01T22:34:04.936468+0000","last_undegraded":"2024-04-01T22:34:04.936468+0000","last_fullsized":"2024-04-01T22:34:04.936468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:15:08.500466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:34:04.890728+0000","last_change":"2024-04-01T22:33:27.915533+0000","last_active":"2024-04-01T22:34:04.890728+0000","last_peered":"2024-04-01T22:34:04.890728+0000","last_clean":"2024-04-01T22:34:04.890728+0000","last_became_active":"2024-04-01T22:33:27.915245+0000","last_became_peered":"2024-04-01T22:33:27.915245+0000","last_unstale":"2024-04-01T22:34:04.890728+0000","last_undegraded":"2024-04-01T22:34:04.890728+0000","last_fullsized":"2024-04-01T22:34:04.890728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:39:28.692092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65062,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":709974,"data_compressed":32531,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":303104,"data_stored":122866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":119114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":303104,"data_stored":119150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":303104,"data_stored":122866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":290816,"data_stored":119024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":119184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31540,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340300,"statfs":{"total":96636764160,"available":96604467200,"internally_reserved":0,"allocated":368640,"data_stored":710030,"data_compressed":32531,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32531,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32531,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T22:34:10.980 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-01T22:34:10.981 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-01T22:34:10.981 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-01T22:34:10.981 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-01T22:34:11.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.116+0000 7f7a727f2640 1 Processor -- start 2024-04-01T22:34:11.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.116+0000 7f7a727f2640 1 -- start start 2024-04-01T22:34:11.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.117+0000 7f7a727f2640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7a6c15c230 0x7f7a6c06c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:11.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.117+0000 7f7a727f2640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a6c154b70 con 0x7f7a6c15aec0 2024-04-01T22:34:11.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.117+0000 7f7a727f2640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a6c0cdac0 con 0x7f7a6c06c250 2024-04-01T22:34:11.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.117+0000 7f7a727f2640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f7a6c0ce990 con 0x7f7a6c15c230 2024-04-01T22:34:11.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.118+0000 7f7a6b7fe640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f7a6c15aec0 0x7f7a6c15bb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:51738/0 (socket says 172.21.15.47:51738) 2024-04-01T22:34:11.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.118+0000 7f7a6b7fe640 1 -- 172.21.15.47:0/2882534400 learned_addr learned my addr 172.21.15.47:0/2882534400 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T22:34:11.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.118+0000 7f7a70d8f640 1 --2- 172.21.15.47:0/2882534400 >> v2:172.21.15.181:3300/0 conn(0x7f7a6c15c230 0x7f7a6c06c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:11.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.120+0000 7f7a6affd640 1 -- 172.21.15.47:0/2882534400 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 617028046 0 0) 0x7f7a6c154b70 con 0x7f7a6c15aec0 2024-04-01T22:34:11.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.120+0000 7f7a6affd640 1 -- 172.21.15.47:0/2882534400 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a58003520 con 0x7f7a6c15aec0 2024-04-01T22:34:11.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.121+0000 7f7a70d8f640 1 -- 172.21.15.47:0/2882534400 >> v1:172.21.15.181:6789/0 conn(0x7f7a6c06c250 legacy=0x7f7a6c0ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:11.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.121+0000 7f7a70d8f640 1 -- 172.21.15.47:0/2882534400 >> v1:172.21.15.47:6789/0 conn(0x7f7a6c15aec0 legacy=0x7f7a6c15bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:11.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.121+0000 7f7a70d8f640 1 -- 172.21.15.47:0/2882534400 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a6c0cf2a0 con 0x7f7a6c15c230 2024-04-01T22:34:11.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.126+0000 7f7a70d8f640 1 --2- 172.21.15.47:0/2882534400 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7a6c15c230 0x7f7a6c06c630 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7a64009d90 tx=0x7f7a6402bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c39ad19a4405bda5 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:11.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.130+0000 7f7a6affd640 1 -- 172.21.15.47:0/2882534400 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a64039070 con 0x7f7a6c15c230 2024-04-01T22:34:11.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.130+0000 7f7a6affd640 1 -- 172.21.15.47:0/2882534400 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a6402cd80 con 0x7f7a6c15c230 2024-04-01T22:34:11.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.130+0000 7f7a6affd640 1 -- 172.21.15.47:0/2882534400 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a64034660 con 0x7f7a6c15c230 2024-04-01T22:34:11.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.131+0000 7f7a727f2640 1 -- 172.21.15.47:0/2882534400 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7a6c15c230 msgr2=0x7f7a6c06c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:11.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.131+0000 7f7a727f2640 1 --2- 172.21.15.47:0/2882534400 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7a6c15c230 0x7f7a6c06c630 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7a64009d90 tx=0x7f7a6402bfd0 comp rx=0 tx=0).stop 2024-04-01T22:34:11.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.131+0000 7f7a727f2640 1 -- 172.21.15.47:0/2882534400 shutdown_connections 2024-04-01T22:34:11.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.131+0000 7f7a727f2640 1 --2- 172.21.15.47:0/2882534400 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7a6c15c230 0x7f7a6c06c630 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:11.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.131+0000 7f7a727f2640 1 -- 172.21.15.47:0/2882534400 >> 172.21.15.47:0/2882534400 conn(0x7f7a6c0cfdb0 msgr2=0x7f7a6c0d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:11.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.131+0000 7f7a727f2640 1 -- 172.21.15.47:0/2882534400 shutdown_connections 2024-04-01T22:34:11.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.131+0000 7f7a727f2640 1 -- 172.21.15.47:0/2882534400 wait complete. 2024-04-01T22:34:11.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.132+0000 7f7a727f2640 1 Processor -- start 2024-04-01T22:34:11.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.132+0000 7f7a727f2640 1 -- start start 2024-04-01T22:34:11.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.133+0000 7f7a727f2640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a6c06c250 0x7f7a6c154cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:11.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.133+0000 7f7a727f2640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7a6c15aec0 0x7f7a6c0c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:11.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.133+0000 7f7a727f2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a6c15c230 0x7f7a6c151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:11.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.133+0000 7f7a727f2640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6c0ce340 con 0x7f7a6c15c230 2024-04-01T22:34:11.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.133+0000 7f7a727f2640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6c0ce060 con 0x7f7a6c15aec0 2024-04-01T22:34:11.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.133+0000 7f7a727f2640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f7a6c0ce620 con 0x7f7a6c06c250 2024-04-01T22:34:11.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.134+0000 7f7a70d8f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a6c15c230 0x7f7a6c151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:11.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.134+0000 7f7a6b7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7a6c15aec0 0x7f7a6c0c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:11.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.134+0000 7f7a70d8f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a6c15c230 0x7f7a6c151e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34792/0 (socket says 172.21.15.47:34792) 2024-04-01T22:34:11.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.134+0000 7f7a70d8f640 1 -- 172.21.15.47:0/1515849401 learned_addr learned my addr 172.21.15.47:0/1515849401 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:11.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.136+0000 7f7a6bfff640 1 --2- 172.21.15.47:0/1515849401 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a6c06c250 0x7f7a6c154cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:11.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.138+0000 7f7a6b7fe640 1 -- 172.21.15.47:0/1515849401 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a6c06c250 msgr2=0x7f7a6c154cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:11.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.138+0000 7f7a6b7fe640 1 --2- 172.21.15.47:0/1515849401 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a6c06c250 0x7f7a6c154cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:11.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.138+0000 7f7a6b7fe640 1 -- 172.21.15.47:0/1515849401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a6c15c230 msgr2=0x7f7a6c151e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:11.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.138+0000 7f7a6b7fe640 1 --2- 172.21.15.47:0/1515849401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a6c15c230 0x7f7a6c151e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:11.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.138+0000 7f7a6b7fe640 1 -- 172.21.15.47:0/1515849401 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a6c1576b0 con 0x7f7a6c15aec0 2024-04-01T22:34:11.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.140+0000 7f7a6b7fe640 1 --2- 172.21.15.47:0/1515849401 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7a6c15aec0 0x7f7a6c0c8190 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c00c430 tx=0x7f7a5c00c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:11.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.144+0000 7f7a68ff9640 1 -- 172.21.15.47:0/1515849401 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c017070 con 0x7f7a6c15aec0 2024-04-01T22:34:11.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.144+0000 7f7a68ff9640 1 -- 172.21.15.47:0/1515849401 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a5c005ce0 con 0x7f7a6c15aec0 2024-04-01T22:34:11.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.144+0000 7f7a68ff9640 1 -- 172.21.15.47:0/1515849401 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c0072f0 con 0x7f7a6c15aec0 2024-04-01T22:34:11.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.144+0000 7f7a727f2640 1 -- 172.21.15.47:0/1515849401 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a6c157990 con 0x7f7a6c15aec0 2024-04-01T22:34:11.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.144+0000 7f7a727f2640 1 -- 172.21.15.47:0/1515849401 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a6c1f0850 con 0x7f7a6c15aec0 2024-04-01T22:34:11.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.145+0000 7f7a727f2640 1 -- 172.21.15.47:0/1515849401 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a6c1f0360 con 0x7f7a6c15aec0 2024-04-01T22:34:11.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.166+0000 7f7a68ff9640 1 -- 172.21.15.47:0/1515849401 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f7a5c01a070 con 0x7f7a6c15aec0 2024-04-01T22:34:11.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.167+0000 7f7a68ff9640 1 --2- 172.21.15.47:0/1515849401 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f7a4c06b9e0 0x7f7a4c06dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:11.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.167+0000 7f7a6bfff640 1 --2- 172.21.15.47:0/1515849401 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f7a4c06b9e0 0x7f7a4c06dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:11.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.167+0000 7f7a6bfff640 1 --2- 172.21.15.47:0/1515849401 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f7a4c06b9e0 0x7f7a4c06dea0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7a54001780 tx=0x7f7a54009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:11.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.397+0000 7f7a68ff9640 1 -- 172.21.15.47:0/1515849401 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f7a5c056630 con 0x7f7a6c15aec0 2024-04-01T22:34:11.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.406+0000 7f7a68ff9640 1 -- 172.21.15.47:0/1515849401 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f7a5c021020 con 0x7f7a6c15aec0 2024-04-01T22:34:11.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.630+0000 7f7a727f2640 1 -- 172.21.15.47:0/1515849401 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7a6c068210 con 0x7f7a6c15aec0 2024-04-01T22:34:11.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.635+0000 7f7a68ff9640 1 -- 172.21.15.47:0/1515849401 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f7a5c058590 con 0x7f7a6c15aec0 2024-04-01T22:34:11.635 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:34:11.635 INFO:teuthology.orchestra.run.smithi047.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-01T22:34:11.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.637+0000 7f7a727f2640 1 -- 172.21.15.47:0/1515849401 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f7a4c06b9e0 msgr2=0x7f7a4c06dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:11.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.637+0000 7f7a727f2640 1 --2- 172.21.15.47:0/1515849401 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f7a4c06b9e0 0x7f7a4c06dea0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7a54001780 tx=0x7f7a54009040 comp rx=0 tx=0).stop 2024-04-01T22:34:11.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.637+0000 7f7a727f2640 1 -- 172.21.15.47:0/1515849401 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7a6c15aec0 msgr2=0x7f7a6c0c8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:11.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.637+0000 7f7a727f2640 1 --2- 172.21.15.47:0/1515849401 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7a6c15aec0 0x7f7a6c0c8190 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c00c430 tx=0x7f7a5c00c8f0 comp rx=0 tx=0).stop 2024-04-01T22:34:11.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.637+0000 7f7a727f2640 1 -- 172.21.15.47:0/1515849401 shutdown_connections 2024-04-01T22:34:11.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.637+0000 7f7a727f2640 1 --2- 172.21.15.47:0/1515849401 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f7a4c06b9e0 0x7f7a4c06dea0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:11.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.637+0000 7f7a727f2640 1 --2- 172.21.15.47:0/1515849401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a6c15c230 0x7f7a6c151e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:11.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.637+0000 7f7a727f2640 1 --2- 172.21.15.47:0/1515849401 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7a6c15aec0 0x7f7a6c0c8190 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:11.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.637+0000 7f7a727f2640 1 --2- 172.21.15.47:0/1515849401 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7a6c06c250 0x7f7a6c154cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:11.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.637+0000 7f7a727f2640 1 -- 172.21.15.47:0/1515849401 >> 172.21.15.47:0/1515849401 conn(0x7f7a6c0cfdb0 msgr2=0x7f7a6c1540a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:11.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.637+0000 7f7a727f2640 1 -- 172.21.15.47:0/1515849401 shutdown_connections 2024-04-01T22:34:11.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.637+0000 7f7a727f2640 1 -- 172.21.15.47:0/1515849401 wait complete. 2024-04-01T22:34:11.648 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-01T22:34:11.648 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T22:34:11.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.751+0000 7f872acc0640 1 Processor -- start 2024-04-01T22:34:11.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.751+0000 7f872acc0640 1 -- start start 2024-04-01T22:34:11.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.751+0000 7f872acc0640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f87241549d0 0x7f87240c3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:11.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.752+0000 7f872acc0640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87240ce940 con 0x7f87241545f0 2024-04-01T22:34:11.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.752+0000 7f872acc0640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87240c8890 con 0x7f87240ce470 2024-04-01T22:34:11.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.752+0000 7f872acc0640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f87240c9a60 con 0x7f87241549d0 2024-04-01T22:34:11.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.752+0000 7f8723fff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f87241549d0 0x7f87240c3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:11.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.752+0000 7f8728a5c640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f87241545f0 0x7f87240ca220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:51742/0 (socket says 172.21.15.47:51742) 2024-04-01T22:34:11.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.752+0000 7f8728a5c640 1 -- 172.21.15.47:0/4050440021 learned_addr learned my addr 172.21.15.47:0/4050440021 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T22:34:11.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.755+0000 7f87237fe640 1 -- 172.21.15.47:0/4050440021 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3697515201 0 0) 0x7f87240ce940 con 0x7f87241545f0 2024-04-01T22:34:11.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.755+0000 7f87237fe640 1 -- 172.21.15.47:0/4050440021 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8714003520 con 0x7f87241545f0 2024-04-01T22:34:11.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.755+0000 7f8723fff640 1 -- 172.21.15.47:0/4050440021 >> v1:172.21.15.181:6789/0 conn(0x7f87240ce470 legacy=0x7f87240c3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:11.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.755+0000 7f8723fff640 1 -- 172.21.15.47:0/4050440021 >> v1:172.21.15.47:6789/0 conn(0x7f87241545f0 legacy=0x7f87240ca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:11.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.755+0000 7f8723fff640 1 -- 172.21.15.47:0/4050440021 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87240c8b70 con 0x7f87241549d0 2024-04-01T22:34:11.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.760+0000 7f8723fff640 1 --2- 172.21.15.47:0/4050440021 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87241549d0 0x7f87240c3a50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f87100097a0 tx=0x7f871002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e60f66fbe22a3551 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:11.762 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:34:11.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.764+0000 7f87237fe640 1 -- 172.21.15.47:0/4050440021 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8710034070 con 0x7f87241549d0 2024-04-01T22:34:11.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.764+0000 7f87237fe640 1 -- 172.21.15.47:0/4050440021 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8710030610 con 0x7f87241549d0 2024-04-01T22:34:11.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.764+0000 7f87237fe640 1 -- 172.21.15.47:0/4050440021 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87100309e0 con 0x7f87241549d0 2024-04-01T22:34:11.764 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:34:11.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.764+0000 7f872acc0640 1 -- 172.21.15.47:0/4050440021 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87241549d0 msgr2=0x7f87240c3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:11.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.764+0000 7f872acc0640 1 --2- 172.21.15.47:0/4050440021 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87241549d0 0x7f87240c3a50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f87100097a0 tx=0x7f871002b960 comp rx=0 tx=0).stop 2024-04-01T22:34:11.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.764+0000 7f872acc0640 1 -- 172.21.15.47:0/4050440021 shutdown_connections 2024-04-01T22:34:11.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.764+0000 7f872acc0640 1 --2- 172.21.15.47:0/4050440021 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87241549d0 0x7f87240c3a50 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:11.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.764+0000 7f872acc0640 1 -- 172.21.15.47:0/4050440021 >> 172.21.15.47:0/4050440021 conn(0x7f8724071330 msgr2=0x7f8724071740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:11.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.765+0000 7f872acc0640 1 -- 172.21.15.47:0/4050440021 shutdown_connections 2024-04-01T22:34:11.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.765+0000 7f872acc0640 1 -- 172.21.15.47:0/4050440021 wait complete. 2024-04-01T22:34:11.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.766+0000 7f872acc0640 1 Processor -- start 2024-04-01T22:34:11.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.766+0000 7f872acc0640 1 -- start start 2024-04-01T22:34:11.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.767+0000 7f872acc0640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f87240ce470 0x7f8724149810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:11.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.767+0000 7f872acc0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87241545f0 0x7f87240add50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:11.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.767+0000 7f872acc0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f872415a160 0x7f87240ae290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:11.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.767+0000 7f872acc0640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f87240c46a0 con 0x7f872415a160 2024-04-01T22:34:11.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.767+0000 7f872acc0640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f87240c9070 con 0x7f87241545f0 2024-04-01T22:34:11.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.767+0000 7f872acc0640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f87240c4820 con 0x7f87240ce470 2024-04-01T22:34:11.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.767+0000 7f8723fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87241545f0 0x7f87240add50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:11.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.767+0000 7f872925d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f872415a160 0x7f87240ae290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:11.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.767+0000 7f8728a5c640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f87240ce470 0x7f8724149810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:11.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.767+0000 7f8723fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87241545f0 0x7f87240add50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:56716/0 (socket says 172.21.15.47:56716) 2024-04-01T22:34:11.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.768+0000 7f8723fff640 1 -- 172.21.15.47:0/2264563549 learned_addr learned my addr 172.21.15.47:0/2264563549 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:11.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.771+0000 7f8728a5c640 1 -- 172.21.15.47:0/2264563549 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87241545f0 msgr2=0x7f87240add50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:11.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.771+0000 7f8728a5c640 1 --2- 172.21.15.47:0/2264563549 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87241545f0 0x7f87240add50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:11.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.771+0000 7f8728a5c640 1 -- 172.21.15.47:0/2264563549 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f872415a160 msgr2=0x7f87240ae290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:11.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.771+0000 7f8728a5c640 1 --2- 172.21.15.47:0/2264563549 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f872415a160 0x7f87240ae290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:11.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.771+0000 7f8728a5c640 1 -- 172.21.15.47:0/2264563549 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8724159e80 con 0x7f87240ce470 2024-04-01T22:34:11.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.773+0000 7f8728a5c640 1 --2- 172.21.15.47:0/2264563549 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f87240ce470 0x7f8724149810 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f871800c430 tx=0x7f871800c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:11.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.777+0000 7f87217fa640 1 -- 172.21.15.47:0/2264563549 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8718017070 con 0x7f87240ce470 2024-04-01T22:34:11.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.777+0000 7f87217fa640 1 -- 172.21.15.47:0/2264563549 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8718005ce0 con 0x7f87240ce470 2024-04-01T22:34:11.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.777+0000 7f87217fa640 1 -- 172.21.15.47:0/2264563549 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87180072d0 con 0x7f87240ce470 2024-04-01T22:34:11.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.777+0000 7f872acc0640 1 -- 172.21.15.47:0/2264563549 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8724158590 con 0x7f87240ce470 2024-04-01T22:34:11.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.777+0000 7f872acc0640 1 -- 172.21.15.47:0/2264563549 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8724158830 con 0x7f87240ce470 2024-04-01T22:34:11.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.778+0000 7f872acc0640 1 -- 172.21.15.47:0/2264563549 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8724068210 con 0x7f87240ce470 2024-04-01T22:34:11.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.796+0000 7f87217fa640 1 -- 172.21.15.47:0/2264563549 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f871801a070 con 0x7f87240ce470 2024-04-01T22:34:11.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.797+0000 7f87217fa640 1 --2- 172.21.15.47:0/2264563549 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f870806b9e0 0x7f870806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:11.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.797+0000 7f8723fff640 1 --2- 172.21.15.47:0/2264563549 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f870806b9e0 0x7f870806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:11.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.797+0000 7f8723fff640 1 --2- 172.21.15.47:0/2264563549 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f870806b9e0 0x7f870806dea0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8724150500 tx=0x7f871003b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:11.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:11.799+0000 7f87217fa640 1 -- 172.21.15.47:0/2264563549 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f8718056780 con 0x7f87240ce470 2024-04-01T22:34:12.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.038+0000 7f87217fa640 1 -- 172.21.15.47:0/2264563549 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f8724159e80 con 0x7f87240ce470 2024-04-01T22:34:12.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.224+0000 7f872acc0640 1 -- 172.21.15.47:0/2264563549 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f872406c390 con 0x7f87240ce470 2024-04-01T22:34:12.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.267+0000 7f87217fa640 1 -- 172.21.15.47:0/2264563549 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18914 (secure 0 0 0) 0x7f87180586e0 con 0x7f87240ce470 2024-04-01T22:34:12.267 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:34:12.267 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":27,"fsid":"a6998a48-38bc-4e42-b0d9-04f2fb5c3c87","created":"2024-04-01T22:32:57.112033+0000","modified":"2024-04-01T22:34:04.850029+0000","last_up_change":"2024-04-01T22:33:11.141073+0000","last_in_change":"2024-04-01T22:33:02.650459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T22:33:13.356568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T22:33:25.309421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T22:33:26.268050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-01T22:33:30.588103+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7bd3f25d-e3a5-4932-b381-53dcbb464dde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6811","nonce":3827395709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6813","nonce":3827395709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6817","nonce":3827395709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6815","nonce":3827395709}]},"public_addr":"172.21.15.47:6811/3827395709","cluster_addr":"172.21.15.47:6813/3827395709","heartbeat_back_addr":"172.21.15.47:6817/3827395709","heartbeat_front_addr":"172.21.15.47:6815/3827395709","state":["exists","up"]},{"osd":1,"uuid":"2aa60ba2-67ff-43c7-96c4-82ae2f3855ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6827","nonce":3152157503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6829","nonce":3152157503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6833","nonce":3152157503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6831","nonce":3152157503}]},"public_addr":"172.21.15.47:6827/3152157503","cluster_addr":"172.21.15.47:6829/3152157503","heartbeat_back_addr":"172.21.15.47:6833/3152157503","heartbeat_front_addr":"172.21.15.47:6831/3152157503","state":["exists","up"]},{"osd":2,"uuid":"d83f8a98-6db8-42b7-9ef6-5b16eb9a3492","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6803","nonce":1003968856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6805","nonce":1003968856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6809","nonce":1003968856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6807","nonce":1003968856}]},"public_addr":"172.21.15.47:6803/1003968856","cluster_addr":"172.21.15.47:6805/1003968856","heartbeat_back_addr":"172.21.15.47:6809/1003968856","heartbeat_front_addr":"172.21.15.47:6807/1003968856","state":["exists","up"]},{"osd":3,"uuid":"edc02ed5-d25c-4dc9-a0c3-7a26f20fae07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6819","nonce":2845699561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6821","nonce":2845699561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6825","nonce":2845699561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6823","nonce":2845699561}]},"public_addr":"172.21.15.47:6819/2845699561","cluster_addr":"172.21.15.47:6821/2845699561","heartbeat_back_addr":"172.21.15.47:6825/2845699561","heartbeat_front_addr":"172.21.15.47:6823/2845699561","state":["exists","up"]},{"osd":4,"uuid":"b3d67e74-f51e-4474-9c62-dd0daa60c728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6809","nonce":2961538461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6811","nonce":2961538461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6815","nonce":2961538461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6813","nonce":2961538461}]},"public_addr":"172.21.15.181:6809/2961538461","cluster_addr":"172.21.15.181:6811/2961538461","heartbeat_back_addr":"172.21.15.181:6815/2961538461","heartbeat_front_addr":"172.21.15.181:6813/2961538461","state":["exists","up"]},{"osd":5,"uuid":"d86e8f7a-99f4-4457-9949-cf2cb853e79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6817","nonce":2161566540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6819","nonce":2161566540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6823","nonce":2161566540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6821","nonce":2161566540}]},"public_addr":"172.21.15.181:6817/2161566540","cluster_addr":"172.21.15.181:6819/2161566540","heartbeat_back_addr":"172.21.15.181:6823/2161566540","heartbeat_front_addr":"172.21.15.181:6821/2161566540","state":["exists","up"]},{"osd":6,"uuid":"aa08266c-1719-4abd-afb9-e7e8ac593658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6801","nonce":3792144865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6803","nonce":3792144865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6807","nonce":3792144865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6805","nonce":3792144865}]},"public_addr":"172.21.15.181:6801/3792144865","cluster_addr":"172.21.15.181:6803/3792144865","heartbeat_back_addr":"172.21.15.181:6807/3792144865","heartbeat_front_addr":"172.21.15.181:6805/3792144865","state":["exists","up"]},{"osd":7,"uuid":"6e509762-24c8-46c3-93a1-4c50b11ebcf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6825","nonce":1760995885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6827","nonce":1760995885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6831","nonce":1760995885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6829","nonce":1760995885}]},"public_addr":"172.21.15.181:6825/1760995885","cluster_addr":"172.21.15.181:6827/1760995885","heartbeat_back_addr":"172.21.15.181:6831/1760995885","heartbeat_front_addr":"172.21.15.181:6829/1760995885","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.202426+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.255318+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.170288+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.290065+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.214871+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.176432+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.139940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.299546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.15","mappings":[{"from":7,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T22:34:12.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.269+0000 7f872acc0640 1 -- 172.21.15.47:0/2264563549 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f870806b9e0 msgr2=0x7f870806dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:12.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.269+0000 7f872acc0640 1 --2- 172.21.15.47:0/2264563549 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f870806b9e0 0x7f870806dea0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8724150500 tx=0x7f871003b040 comp rx=0 tx=0).stop 2024-04-01T22:34:12.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.269+0000 7f872acc0640 1 -- 172.21.15.47:0/2264563549 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f87240ce470 msgr2=0x7f8724149810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:12.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.269+0000 7f872acc0640 1 --2- 172.21.15.47:0/2264563549 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f87240ce470 0x7f8724149810 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f871800c430 tx=0x7f871800c8f0 comp rx=0 tx=0).stop 2024-04-01T22:34:12.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.269+0000 7f872acc0640 1 -- 172.21.15.47:0/2264563549 shutdown_connections 2024-04-01T22:34:12.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.269+0000 7f872acc0640 1 --2- 172.21.15.47:0/2264563549 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f870806b9e0 0x7f870806dea0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:12.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.269+0000 7f872acc0640 1 --2- 172.21.15.47:0/2264563549 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f872415a160 0x7f87240ae290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:12.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.269+0000 7f872acc0640 1 --2- 172.21.15.47:0/2264563549 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87241545f0 0x7f87240add50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:12.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.269+0000 7f872acc0640 1 --2- 172.21.15.47:0/2264563549 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f87240ce470 0x7f8724149810 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:12.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.269+0000 7f872acc0640 1 -- 172.21.15.47:0/2264563549 >> 172.21.15.47:0/2264563549 conn(0x7f8724071330 msgr2=0x7f87240cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:12.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.269+0000 7f872acc0640 1 -- 172.21.15.47:0/2264563549 shutdown_connections 2024-04-01T22:34:12.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.269+0000 7f872acc0640 1 -- 172.21.15.47:0/2264563549 wait complete. 2024-04-01T22:34:12.281 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-01T22:33:13.356568+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-01T22:33:25.309421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-01T22:33:26.268050+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-01T22:33:30.588103+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-01T22:34:12.281 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-01T22:34:12.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.387+0000 7f4192701640 1 Processor -- start 2024-04-01T22:34:12.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.387+0000 7f4192701640 1 -- start start 2024-04-01T22:34:12.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.388+0000 7f4192701640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f418c0cee30 0x7f418c15afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:12.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.388+0000 7f4192701640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f418c0cc0d0 0x7f418c0cc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:12.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.388+0000 7f4192701640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f418c0ccaa0 con 0x7f418c0c93f0 2024-04-01T22:34:12.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.388+0000 7f4192701640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f418c15b500 con 0x7f418c0cc0d0 2024-04-01T22:34:12.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.388+0000 7f4192701640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f418c0cdae0 con 0x7f418c0cee30 2024-04-01T22:34:12.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.388+0000 7f4190c9e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f418c0cc0d0 0x7f418c0cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:12.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.388+0000 7f418b7fe640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f418c0cee30 0x7f418c15afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:12.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.388+0000 7f418bfff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f418c0c93f0 0x7f418c06c230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.47:40334/0 (socket says 172.21.15.47:40334) 2024-04-01T22:34:12.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.388+0000 7f418bfff640 1 -- 172.21.15.47:0/2852585181 learned_addr learned my addr 172.21.15.47:0/2852585181 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T22:34:12.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.391+0000 7f418b7fe640 1 -- 172.21.15.47:0/2852585181 >> v2:172.21.15.47:3300/0 conn(0x7f418c0cc0d0 msgr2=0x7f418c0cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:12.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.391+0000 7f418b7fe640 1 --2- 172.21.15.47:0/2852585181 >> v2:172.21.15.47:3300/0 conn(0x7f418c0cc0d0 0x7f418c0cc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:12.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.391+0000 7f418b7fe640 1 -- 172.21.15.47:0/2852585181 >> v1:172.21.15.181:6789/0 conn(0x7f418c0c93f0 legacy=0x7f418c06c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:12.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.391+0000 7f418b7fe640 1 -- 172.21.15.47:0/2852585181 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f418c0c97d0 con 0x7f418c0cee30 2024-04-01T22:34:12.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.393+0000 7f418b7fe640 1 --2- 172.21.15.47:0/2852585181 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f418c0cee30 0x7f418c15afc0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f41800097a0 tx=0x7f418002b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b38ef978112330e server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:12.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.396+0000 7f418affd640 1 -- 172.21.15.47:0/2852585181 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41800315a0 con 0x7f418c0cee30 2024-04-01T22:34:12.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.396+0000 7f418affd640 1 -- 172.21.15.47:0/2852585181 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4180037070 con 0x7f418c0cee30 2024-04-01T22:34:12.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.396+0000 7f418affd640 1 -- 172.21.15.47:0/2852585181 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4180031960 con 0x7f418c0cee30 2024-04-01T22:34:12.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.397+0000 7f4192701640 1 -- 172.21.15.47:0/2852585181 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f418c0cee30 msgr2=0x7f418c15afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:12.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.397+0000 7f4192701640 1 --2- 172.21.15.47:0/2852585181 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f418c0cee30 0x7f418c15afc0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f41800097a0 tx=0x7f418002b840 comp rx=0 tx=0).stop 2024-04-01T22:34:12.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.397+0000 7f4192701640 1 -- 172.21.15.47:0/2852585181 shutdown_connections 2024-04-01T22:34:12.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.397+0000 7f4192701640 1 --2- 172.21.15.47:0/2852585181 >> v2:172.21.15.47:3300/0 conn(0x7f418c0cc0d0 0x7f418c0cc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:12.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.397+0000 7f4192701640 1 --2- 172.21.15.47:0/2852585181 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f418c0cee30 0x7f418c15afc0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:12.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.397+0000 7f4192701640 1 -- 172.21.15.47:0/2852585181 >> 172.21.15.47:0/2852585181 conn(0x7f418c0cfdb0 msgr2=0x7f418c0d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:12.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.397+0000 7f4192701640 1 -- 172.21.15.47:0/2852585181 shutdown_connections 2024-04-01T22:34:12.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.397+0000 7f4192701640 1 -- 172.21.15.47:0/2852585181 wait complete. 2024-04-01T22:34:12.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.398+0000 7f4192701640 1 Processor -- start 2024-04-01T22:34:12.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.398+0000 7f4192701640 1 -- start start 2024-04-01T22:34:12.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.399+0000 7f4192701640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f418c0c93f0 0x7f418c0b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:12.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.399+0000 7f4192701640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f418c0cc0d0 0x7f418c0b5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:12.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.399+0000 7f4192701640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f418c0cee30 0x7f418c0ae110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:12.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.399+0000 7f4192701640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f418c0ce340 con 0x7f418c0cee30 2024-04-01T22:34:12.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.399+0000 7f4192701640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f418c0ce060 con 0x7f418c0cc0d0 2024-04-01T22:34:12.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.399+0000 7f4192701640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f418c0ce620 con 0x7f418c0c93f0 2024-04-01T22:34:12.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.400+0000 7f4190c9e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f418c0cee30 0x7f418c0ae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:12.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.400+0000 7f418bfff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f418c0c93f0 0x7f418c0b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:12.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.400+0000 7f418b7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f418c0cc0d0 0x7f418c0b5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:12.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.400+0000 7f4190c9e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f418c0cee30 0x7f418c0ae110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34818/0 (socket says 172.21.15.47:34818) 2024-04-01T22:34:12.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.400+0000 7f418bfff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f418c0c93f0 0x7f418c0b08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:52644/0 (socket says 172.21.15.47:52644) 2024-04-01T22:34:12.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.400+0000 7f4190c9e640 1 -- 172.21.15.47:0/953917281 learned_addr learned my addr 172.21.15.47:0/953917281 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:12.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.403+0000 7f4190c9e640 1 -- 172.21.15.47:0/953917281 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f418c0c93f0 msgr2=0x7f418c0b08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:12.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.403+0000 7f4190c9e640 1 --2- 172.21.15.47:0/953917281 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f418c0c93f0 0x7f418c0b08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:12.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.403+0000 7f4190c9e640 1 -- 172.21.15.47:0/953917281 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f418c0cc0d0 msgr2=0x7f418c0b5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:12.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.403+0000 7f4190c9e640 1 --2- 172.21.15.47:0/953917281 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f418c0cc0d0 0x7f418c0b5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:12.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.403+0000 7f4190c9e640 1 -- 172.21.15.47:0/953917281 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f418c1f0990 con 0x7f418c0cee30 2024-04-01T22:34:12.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.403+0000 7f418b7fe640 1 --2- 172.21.15.47:0/953917281 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f418c0cc0d0 0x7f418c0b5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T22:34:12.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.406+0000 7f4190c9e640 1 --2- 172.21.15.47:0/953917281 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f418c0cee30 0x7f418c0ae110 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f418400efc0 tx=0x7f418400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:12.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.409+0000 7f4188ff9640 1 -- 172.21.15.47:0/953917281 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4184018020 con 0x7f418c0cee30 2024-04-01T22:34:12.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.409+0000 7f4188ff9640 1 -- 172.21.15.47:0/953917281 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4184014480 con 0x7f418c0cee30 2024-04-01T22:34:12.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.409+0000 7f4188ff9640 1 -- 172.21.15.47:0/953917281 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4184014870 con 0x7f418c0cee30 2024-04-01T22:34:12.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.409+0000 7f4192701640 1 -- 172.21.15.47:0/953917281 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f418c1f0c70 con 0x7f418c0cee30 2024-04-01T22:34:12.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.409+0000 7f4192701640 1 -- 172.21.15.47:0/953917281 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f418c1f1230 con 0x7f418c0cee30 2024-04-01T22:34:12.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.410+0000 7f4192701640 1 -- 172.21.15.47:0/953917281 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f418c068210 con 0x7f418c0cee30 2024-04-01T22:34:12.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.430+0000 7f4188ff9640 1 -- 172.21.15.47:0/953917281 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f4184005d10 con 0x7f418c0cee30 2024-04-01T22:34:12.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.430+0000 7f4188ff9640 1 --2- 172.21.15.47:0/953917281 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f417806ba10 0x7f417806ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:12.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.430+0000 7f418bfff640 1 --2- 172.21.15.47:0/953917281 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f417806ba10 0x7f417806ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:12.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.431+0000 7f418bfff640 1 --2- 172.21.15.47:0/953917281 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f417806ba10 0x7f417806ded0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f417c007fd0 tx=0x7f417c007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:12.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.691+0000 7f4188ff9640 1 -- 172.21.15.47:0/953917281 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f4184058090 con 0x7f418c0cee30 2024-04-01T22:34:12.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.691+0000 7f4188ff9640 1 -- 172.21.15.47:0/953917281 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f4184022070 con 0x7f418c0cee30 2024-04-01T22:34:12.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.874+0000 7f4192701640 1 -- 172.21.15.47:0/953917281 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f418c06cf00 con 0x7f418c0cee30 2024-04-01T22:34:12.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.880+0000 7f4188ff9640 1 -- 172.21.15.47:0/953917281 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f4184010040 con 0x7f418c0cee30 2024-04-01T22:34:12.879 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-01T22:34:12.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.881+0000 7f4192701640 1 -- 172.21.15.47:0/953917281 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f417806ba10 msgr2=0x7f417806ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:12.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.881+0000 7f4192701640 1 --2- 172.21.15.47:0/953917281 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f417806ba10 0x7f417806ded0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f417c007fd0 tx=0x7f417c007e80 comp rx=0 tx=0).stop 2024-04-01T22:34:12.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.881+0000 7f4192701640 1 -- 172.21.15.47:0/953917281 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f418c0cee30 msgr2=0x7f418c0ae110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:12.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.881+0000 7f4192701640 1 --2- 172.21.15.47:0/953917281 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f418c0cee30 0x7f418c0ae110 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f418400efc0 tx=0x7f418400c490 comp rx=0 tx=0).stop 2024-04-01T22:34:12.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.882+0000 7f4192701640 1 -- 172.21.15.47:0/953917281 shutdown_connections 2024-04-01T22:34:12.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.882+0000 7f4192701640 1 --2- 172.21.15.47:0/953917281 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f417806ba10 0x7f417806ded0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:12.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.882+0000 7f4192701640 1 --2- 172.21.15.47:0/953917281 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f418c0cee30 0x7f418c0ae110 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:12.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.882+0000 7f4192701640 1 --2- 172.21.15.47:0/953917281 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f418c0cc0d0 0x7f418c0b5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:12.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.882+0000 7f4192701640 1 --2- 172.21.15.47:0/953917281 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f418c0c93f0 0x7f418c0b08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:12.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.882+0000 7f4192701640 1 -- 172.21.15.47:0/953917281 >> 172.21.15.47:0/953917281 conn(0x7f418c0cfdb0 msgr2=0x7f418c0cb2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:12.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.882+0000 7f4192701640 1 -- 172.21.15.47:0/953917281 shutdown_connections 2024-04-01T22:34:12.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.882+0000 7f4192701640 1 -- 172.21.15.47:0/953917281 wait complete. 2024-04-01T22:34:12.892 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-01T22:34:12.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.999+0000 7fcadc0fb640 1 Processor -- start 2024-04-01T22:34:12.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:12.999+0000 7fcadc0fb640 1 -- start start 2024-04-01T22:34:13.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.000+0000 7fcadc0fb640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcad40c93f0 0x7fcad40cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:13.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.000+0000 7fcadc0fb640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fcad40cc0d0 0x7fcad40cc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:13.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.000+0000 7fcadc0fb640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcad40ccaa0 con 0x7fcad415afc0 2024-04-01T22:34:13.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.000+0000 7fcadc0fb640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fcad40cdae0 con 0x7fcad40cc0d0 2024-04-01T22:34:13.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.000+0000 7fcadc0fb640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fcad40c97d0 con 0x7fcad40c93f0 2024-04-01T22:34:13.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.001+0000 7fcad9e97640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcad40c93f0 0x7fcad40cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:13.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.001+0000 7fcad9e97640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcad40c93f0 0x7fcad40cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:52654/0 (socket says 172.21.15.47:52654) 2024-04-01T22:34:13.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.001+0000 7fcad9e97640 1 -- 172.21.15.47:0/3879627327 learned_addr learned my addr 172.21.15.47:0/3879627327 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:13.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.003+0000 7fcad9e97640 1 -- 172.21.15.47:0/3879627327 >> v2:172.21.15.47:3300/0 conn(0x7fcad40cc0d0 msgr2=0x7fcad40cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:13.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.003+0000 7fcad9e97640 1 --2- 172.21.15.47:0/3879627327 >> v2:172.21.15.47:3300/0 conn(0x7fcad40cc0d0 0x7fcad40cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:13.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.003+0000 7fcad9e97640 1 -- 172.21.15.47:0/3879627327 >> v1:172.21.15.47:6789/0 conn(0x7fcad415afc0 legacy=0x7fcad406c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:13.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.003+0000 7fcad9e97640 1 -- 172.21.15.47:0/3879627327 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcad40cdd80 con 0x7fcad40c93f0 2024-04-01T22:34:13.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.005+0000 7fcad9e97640 1 --2- 172.21.15.47:0/3879627327 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcad40c93f0 0x7fcad40cee30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcad0009870 tx=0x7fcad002b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8f700287c7e23d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:13.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.009+0000 7fcad8e95640 1 -- 172.21.15.47:0/3879627327 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad00317c0 con 0x7fcad40c93f0 2024-04-01T22:34:13.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.009+0000 7fcad8e95640 1 -- 172.21.15.47:0/3879627327 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcad0037070 con 0x7fcad40c93f0 2024-04-01T22:34:13.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.009+0000 7fcad8e95640 1 -- 172.21.15.47:0/3879627327 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad0031b80 con 0x7fcad40c93f0 2024-04-01T22:34:13.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.009+0000 7fcadc0fb640 1 -- 172.21.15.47:0/3879627327 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcad40c93f0 msgr2=0x7fcad40cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:13.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.009+0000 7fcadc0fb640 1 --2- 172.21.15.47:0/3879627327 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcad40c93f0 0x7fcad40cee30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcad0009870 tx=0x7fcad002b860 comp rx=0 tx=0).stop 2024-04-01T22:34:13.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.009+0000 7fcadc0fb640 1 -- 172.21.15.47:0/3879627327 shutdown_connections 2024-04-01T22:34:13.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.009+0000 7fcadc0fb640 1 --2- 172.21.15.47:0/3879627327 >> v2:172.21.15.47:3300/0 conn(0x7fcad40cc0d0 0x7fcad40cc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:13.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.009+0000 7fcadc0fb640 1 --2- 172.21.15.47:0/3879627327 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcad40c93f0 0x7fcad40cee30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:13.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.009+0000 7fcadc0fb640 1 -- 172.21.15.47:0/3879627327 >> 172.21.15.47:0/3879627327 conn(0x7fcad40cfdb0 msgr2=0x7fcad40d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:13.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.010+0000 7fcadc0fb640 1 -- 172.21.15.47:0/3879627327 shutdown_connections 2024-04-01T22:34:13.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.010+0000 7fcadc0fb640 1 -- 172.21.15.47:0/3879627327 wait complete. 2024-04-01T22:34:13.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.011+0000 7fcadc0fb640 1 Processor -- start 2024-04-01T22:34:13.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.011+0000 7fcadc0fb640 1 -- start start 2024-04-01T22:34:13.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.011+0000 7fcadc0fb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcad40c93f0 0x7fcad406c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:13.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.011+0000 7fcadc0fb640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcad40cc0d0 0x7fcad4152030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:13.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.011+0000 7fcadc0fb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcad415afc0 0x7fcad4152570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:13.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.011+0000 7fcadc0fb640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcad40ce620 con 0x7fcad40c93f0 2024-04-01T22:34:13.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.011+0000 7fcadc0fb640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcad40ce340 con 0x7fcad415afc0 2024-04-01T22:34:13.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.011+0000 7fcadc0fb640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fcad415b400 con 0x7fcad40cc0d0 2024-04-01T22:34:13.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.012+0000 7fcad9696640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcad40cc0d0 0x7fcad4152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:13.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.012+0000 7fcada698640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcad415afc0 0x7fcad4152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:13.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.012+0000 7fcad9696640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcad40cc0d0 0x7fcad4152030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:52660/0 (socket says 172.21.15.47:52660) 2024-04-01T22:34:13.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.012+0000 7fcad9696640 1 -- 172.21.15.47:0/2464612368 learned_addr learned my addr 172.21.15.47:0/2464612368 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:13.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.016+0000 7fcada698640 1 -- 172.21.15.47:0/2464612368 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcad40cc0d0 msgr2=0x7fcad4152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:13.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.016+0000 7fcada698640 1 --2- 172.21.15.47:0/2464612368 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcad40cc0d0 0x7fcad4152030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:13.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.016+0000 7fcada698640 1 -- 172.21.15.47:0/2464612368 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcad40c93f0 msgr2=0x7fcad406c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:13.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.016+0000 7fcada698640 1 --2- 172.21.15.47:0/2464612368 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcad40c93f0 0x7fcad406c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:13.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.016+0000 7fcada698640 1 -- 172.21.15.47:0/2464612368 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcad41f0220 con 0x7fcad415afc0 2024-04-01T22:34:13.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.016+0000 7fcad9696640 1 --2- 172.21.15.47:0/2464612368 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcad40cc0d0 0x7fcad4152030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T22:34:13.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.018+0000 7fcada698640 1 --2- 172.21.15.47:0/2464612368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcad415afc0 0x7fcad4152570 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcacc00be80 tx=0x7fcacc00bf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:13.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.022+0000 7fcaca7fc640 1 -- 172.21.15.47:0/2464612368 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcacc019070 con 0x7fcad415afc0 2024-04-01T22:34:13.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.022+0000 7fcaca7fc640 1 -- 172.21.15.47:0/2464612368 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcacc014440 con 0x7fcad415afc0 2024-04-01T22:34:13.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.022+0000 7fcadc0fb640 1 -- 172.21.15.47:0/2464612368 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcad41f0500 con 0x7fcad415afc0 2024-04-01T22:34:13.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.022+0000 7fcaca7fc640 1 -- 172.21.15.47:0/2464612368 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcacc014830 con 0x7fcad415afc0 2024-04-01T22:34:13.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.022+0000 7fcadc0fb640 1 -- 172.21.15.47:0/2464612368 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcad41f0ac0 con 0x7fcad415afc0 2024-04-01T22:34:13.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.023+0000 7fcadc0fb640 1 -- 172.21.15.47:0/2464612368 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcad4068210 con 0x7fcad415afc0 2024-04-01T22:34:13.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.267+0000 7fcaca7fc640 1 -- 172.21.15.47:0/2464612368 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7fcacc01c070 con 0x7fcad415afc0 2024-04-01T22:34:13.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.268+0000 7fcaca7fc640 1 --2- 172.21.15.47:0/2464612368 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fcab806b990 0x7fcab806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:13.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.268+0000 7fcad9e97640 1 --2- 172.21.15.47:0/2464612368 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fcab806b990 0x7fcab806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:13.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.268+0000 7fcad9e97640 1 --2- 172.21.15.47:0/2464612368 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fcab806b990 0x7fcab806de50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcad0036000 tx=0x7fcad0030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:13.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.272+0000 7fcaca7fc640 1 -- 172.21.15.47:0/2464612368 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fcacc057260 con 0x7fcad415afc0 2024-04-01T22:34:13.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.282+0000 7fcaca7fc640 1 -- 172.21.15.47:0/2464612368 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fcacc023020 con 0x7fcad415afc0 2024-04-01T22:34:13.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.465+0000 7fcadc0fb640 1 -- 172.21.15.47:0/2464612368 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fcad406cf00 con 0x7fcad415afc0 2024-04-01T22:34:13.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.470+0000 7fcaca7fc640 1 -- 172.21.15.47:0/2464612368 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7fcacc0591c0 con 0x7fcad415afc0 2024-04-01T22:34:13.470 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-01T22:34:13.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.472+0000 7fcadc0fb640 1 -- 172.21.15.47:0/2464612368 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fcab806b990 msgr2=0x7fcab806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:13.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.472+0000 7fcadc0fb640 1 --2- 172.21.15.47:0/2464612368 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fcab806b990 0x7fcab806de50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcad0036000 tx=0x7fcad0030000 comp rx=0 tx=0).stop 2024-04-01T22:34:13.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.472+0000 7fcadc0fb640 1 -- 172.21.15.47:0/2464612368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcad415afc0 msgr2=0x7fcad4152570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:13.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.472+0000 7fcadc0fb640 1 --2- 172.21.15.47:0/2464612368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcad415afc0 0x7fcad4152570 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcacc00be80 tx=0x7fcacc00bf70 comp rx=0 tx=0).stop 2024-04-01T22:34:13.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.472+0000 7fcadc0fb640 1 -- 172.21.15.47:0/2464612368 shutdown_connections 2024-04-01T22:34:13.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.472+0000 7fcadc0fb640 1 --2- 172.21.15.47:0/2464612368 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fcab806b990 0x7fcab806de50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:13.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.472+0000 7fcadc0fb640 1 --2- 172.21.15.47:0/2464612368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcad415afc0 0x7fcad4152570 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:13.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.472+0000 7fcadc0fb640 1 --2- 172.21.15.47:0/2464612368 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fcad40cc0d0 0x7fcad4152030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:13.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.472+0000 7fcadc0fb640 1 --2- 172.21.15.47:0/2464612368 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcad40c93f0 0x7fcad406c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:13.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.472+0000 7fcadc0fb640 1 -- 172.21.15.47:0/2464612368 >> 172.21.15.47:0/2464612368 conn(0x7fcad40cfdb0 msgr2=0x7fcad4159dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:13.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.472+0000 7fcadc0fb640 1 -- 172.21.15.47:0/2464612368 shutdown_connections 2024-04-01T22:34:13.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.472+0000 7fcadc0fb640 1 -- 172.21.15.47:0/2464612368 wait complete. 2024-04-01T22:34:13.483 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-01T22:34:13.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.588+0000 7f2451864640 1 Processor -- start 2024-04-01T22:34:13.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.588+0000 7f2451864640 1 -- start start 2024-04-01T22:34:13.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.588+0000 7f2451864640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f244c0c9e10 0x7f244c15ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:13.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.588+0000 7f2451864640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f244c1549a0 con 0x7f244c150d50 2024-04-01T22:34:13.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.588+0000 7f2451864640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f244c151130 con 0x7f244c0c7360 2024-04-01T22:34:13.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.588+0000 7f2451864640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f244c0737a0 con 0x7f244c0c9e10 2024-04-01T22:34:13.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.589+0000 7f244b7fe640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f244c0c9e10 0x7f244c15ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:13.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.589+0000 7f244affd640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f244c150d50 0x7f244c0cc8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:51758/0 (socket says 172.21.15.47:51758) 2024-04-01T22:34:13.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.589+0000 7f244affd640 1 -- 172.21.15.47:0/4160804645 learned_addr learned my addr 172.21.15.47:0/4160804645 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T22:34:13.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.591+0000 7f244a7fc640 1 -- 172.21.15.47:0/4160804645 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4257759569 0 0) 0x7f244c151130 con 0x7f244c0c7360 2024-04-01T22:34:13.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.591+0000 7f244a7fc640 1 -- 172.21.15.47:0/4160804645 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2438003520 con 0x7f244c0c7360 2024-04-01T22:34:13.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.592+0000 7f244b7fe640 1 -- 172.21.15.47:0/4160804645 >> v1:172.21.15.181:6789/0 conn(0x7f244c0c7360 legacy=0x7f244c162c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:13.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.592+0000 7f244b7fe640 1 -- 172.21.15.47:0/4160804645 >> v1:172.21.15.47:6789/0 conn(0x7f244c150d50 legacy=0x7f244c0cc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:13.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.592+0000 7f244b7fe640 1 -- 172.21.15.47:0/4160804645 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f244c0731e0 con 0x7f244c0c9e10 2024-04-01T22:34:13.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.594+0000 7f244b7fe640 1 --2- 172.21.15.47:0/4160804645 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f244c0c9e10 0x7f244c15ad60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2444009dc0 tx=0x7f244402bfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2fb774c6ac06cfd server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:13.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.597+0000 7f244a7fc640 1 -- 172.21.15.47:0/4160804645 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2444039070 con 0x7f244c0c9e10 2024-04-01T22:34:13.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.597+0000 7f244a7fc640 1 -- 172.21.15.47:0/4160804645 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f244402cd50 con 0x7f244c0c9e10 2024-04-01T22:34:13.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.597+0000 7f244a7fc640 1 -- 172.21.15.47:0/4160804645 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2444034660 con 0x7f244c0c9e10 2024-04-01T22:34:13.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.598+0000 7f2451864640 1 -- 172.21.15.47:0/4160804645 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f244c0c9e10 msgr2=0x7f244c15ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:13.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.598+0000 7f2451864640 1 --2- 172.21.15.47:0/4160804645 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f244c0c9e10 0x7f244c15ad60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2444009dc0 tx=0x7f244402bfa0 comp rx=0 tx=0).stop 2024-04-01T22:34:13.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.598+0000 7f2451864640 1 -- 172.21.15.47:0/4160804645 shutdown_connections 2024-04-01T22:34:13.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.598+0000 7f2451864640 1 --2- 172.21.15.47:0/4160804645 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f244c0c9e10 0x7f244c15ad60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:13.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.598+0000 7f2451864640 1 -- 172.21.15.47:0/4160804645 >> 172.21.15.47:0/4160804645 conn(0x7f244c06c220 msgr2=0x7f244c06c600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:13.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.598+0000 7f2451864640 1 -- 172.21.15.47:0/4160804645 shutdown_connections 2024-04-01T22:34:13.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.598+0000 7f2451864640 1 -- 172.21.15.47:0/4160804645 wait complete. 2024-04-01T22:34:13.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.599+0000 7f2451864640 1 Processor -- start 2024-04-01T22:34:13.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.599+0000 7f2451864640 1 -- start start 2024-04-01T22:34:13.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.600+0000 7f2451864640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f244c0c7360 0x7f244c158920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:13.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.600+0000 7f2451864640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f244c0c9e10 0x7f244c158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:13.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.600+0000 7f2451864640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f244c150d50 0x7f244c1f0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:13.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.600+0000 7f2451864640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f244c0c9610 con 0x7f244c0c7360 2024-04-01T22:34:13.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.600+0000 7f2451864640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f244c0c9330 con 0x7f244c0c9e10 2024-04-01T22:34:13.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.600+0000 7f2451864640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f244c0c98f0 con 0x7f244c150d50 2024-04-01T22:34:13.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.600+0000 7f244affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f244c0c7360 0x7f244c158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:13.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.600+0000 7f2443fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f244c0c9e10 0x7f244c158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:13.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.601+0000 7f244b7fe640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f244c150d50 0x7f244c1f0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:13.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.601+0000 7f2443fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f244c0c9e10 0x7f244c158e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:56730/0 (socket says 172.21.15.47:56730) 2024-04-01T22:34:13.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.601+0000 7f2443fff640 1 -- 172.21.15.47:0/2441394522 learned_addr learned my addr 172.21.15.47:0/2441394522 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:13.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.604+0000 7f2443fff640 1 -- 172.21.15.47:0/2441394522 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f244c150d50 msgr2=0x7f244c1f0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:13.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.604+0000 7f2443fff640 1 --2- 172.21.15.47:0/2441394522 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f244c150d50 0x7f244c1f0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:13.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.604+0000 7f2443fff640 1 -- 172.21.15.47:0/2441394522 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f244c0c7360 msgr2=0x7f244c158920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:13.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.604+0000 7f2443fff640 1 --2- 172.21.15.47:0/2441394522 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f244c0c7360 0x7f244c158920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:13.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.604+0000 7f2443fff640 1 -- 172.21.15.47:0/2441394522 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f244c0c6970 con 0x7f244c0c9e10 2024-04-01T22:34:13.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.606+0000 7f2443fff640 1 --2- 172.21.15.47:0/2441394522 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f244c0c9e10 0x7f244c158e60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f243400c4c0 tx=0x7f243400c980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:13.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.610+0000 7f2448ff9640 1 -- 172.21.15.47:0/2441394522 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24340052d0 con 0x7f244c0c9e10 2024-04-01T22:34:13.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.610+0000 7f2448ff9640 1 -- 172.21.15.47:0/2441394522 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2434005470 con 0x7f244c0c9e10 2024-04-01T22:34:13.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.610+0000 7f2448ff9640 1 -- 172.21.15.47:0/2441394522 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2434012870 con 0x7f244c0c9e10 2024-04-01T22:34:13.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.610+0000 7f2451864640 1 -- 172.21.15.47:0/2441394522 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f244c0c6c50 con 0x7f244c0c9e10 2024-04-01T22:34:13.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.610+0000 7f2451864640 1 -- 172.21.15.47:0/2441394522 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f244c157e40 con 0x7f244c0c9e10 2024-04-01T22:34:13.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.611+0000 7f2451864640 1 -- 172.21.15.47:0/2441394522 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f244c06f8d0 con 0x7f244c0c9e10 2024-04-01T22:34:13.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.854+0000 7f2448ff9640 1 -- 172.21.15.47:0/2441394522 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f2434012a10 con 0x7f244c0c9e10 2024-04-01T22:34:13.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.854+0000 7f2448ff9640 1 --2- 172.21.15.47:0/2441394522 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f242c06b9e0 0x7f242c06dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:13.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.854+0000 7f244affd640 1 --2- 172.21.15.47:0/2441394522 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f242c06b9e0 0x7f242c06dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:13.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.854+0000 7f244affd640 1 --2- 172.21.15.47:0/2441394522 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f242c06b9e0 0x7f242c06dea0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f243c000f60 tx=0x7f243c007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:13.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.856+0000 7f2448ff9640 1 -- 172.21.15.47:0/2441394522 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f24340574d0 con 0x7f244c0c9e10 2024-04-01T22:34:13.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:13.869+0000 7f2448ff9640 1 -- 172.21.15.47:0/2441394522 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f244c06f8d0 con 0x7f244c0c9e10 2024-04-01T22:34:14.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.061+0000 7f2451864640 1 -- 172.21.15.47:0/2441394522 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f244c14b290 con 0x7f244c0c9e10 2024-04-01T22:34:14.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.066+0000 7f2448ff9640 1 -- 172.21.15.47:0/2441394522 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f244c14b290 con 0x7f244c0c9e10 2024-04-01T22:34:14.066 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-04-01T22:34:14.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.068+0000 7f2451864640 1 -- 172.21.15.47:0/2441394522 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f242c06b9e0 msgr2=0x7f242c06dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:14.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.068+0000 7f2451864640 1 --2- 172.21.15.47:0/2441394522 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f242c06b9e0 0x7f242c06dea0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f243c000f60 tx=0x7f243c007e80 comp rx=0 tx=0).stop 2024-04-01T22:34:14.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.068+0000 7f2451864640 1 -- 172.21.15.47:0/2441394522 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f244c0c9e10 msgr2=0x7f244c158e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:14.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.068+0000 7f2451864640 1 --2- 172.21.15.47:0/2441394522 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f244c0c9e10 0x7f244c158e60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f243400c4c0 tx=0x7f243400c980 comp rx=0 tx=0).stop 2024-04-01T22:34:14.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.068+0000 7f2451864640 1 -- 172.21.15.47:0/2441394522 shutdown_connections 2024-04-01T22:34:14.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.068+0000 7f2451864640 1 --2- 172.21.15.47:0/2441394522 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f242c06b9e0 0x7f242c06dea0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:14.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.068+0000 7f2451864640 1 --2- 172.21.15.47:0/2441394522 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f244c150d50 0x7f244c1f0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:14.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.068+0000 7f2451864640 1 --2- 172.21.15.47:0/2441394522 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f244c0c9e10 0x7f244c158e60 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:14.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.068+0000 7f2451864640 1 --2- 172.21.15.47:0/2441394522 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f244c0c7360 0x7f244c158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:14.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.068+0000 7f2451864640 1 -- 172.21.15.47:0/2441394522 >> 172.21.15.47:0/2441394522 conn(0x7f244c06c220 msgr2=0x7f244c14fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:14.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.068+0000 7f2451864640 1 -- 172.21.15.47:0/2441394522 shutdown_connections 2024-04-01T22:34:14.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.068+0000 7f2451864640 1 -- 172.21.15.47:0/2441394522 wait complete. 2024-04-01T22:34:14.079 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-01T22:34:14.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.185+0000 7f2e470a4640 1 Processor -- start 2024-04-01T22:34:14.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.185+0000 7f2e470a4640 1 -- start start 2024-04-01T22:34:14.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.186+0000 7f2e470a4640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2e400cee30 0x7f2e4015afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:14.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.186+0000 7f2e470a4640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2e400cc0d0 0x7f2e400cc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:14.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.186+0000 7f2e470a4640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e400ccaa0 con 0x7f2e400c93f0 2024-04-01T22:34:14.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.186+0000 7f2e470a4640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f2e4015b500 con 0x7f2e400cee30 2024-04-01T22:34:14.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.186+0000 7f2e470a4640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f2e400cdae0 con 0x7f2e400cc0d0 2024-04-01T22:34:14.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.186+0000 7f2e3ffff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2e400cee30 0x7f2e4015afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:14.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.187+0000 7f2e3ffff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2e400cee30 0x7f2e4015afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:56738/0 (socket says 172.21.15.47:56738) 2024-04-01T22:34:14.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.187+0000 7f2e3ffff640 1 -- 172.21.15.47:0/1814714755 learned_addr learned my addr 172.21.15.47:0/1814714755 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:14.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.187+0000 7f2e45641640 1 --2- 172.21.15.47:0/1814714755 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2e400cc0d0 0x7f2e400cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:14.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.189+0000 7f2e3ffff640 1 -- 172.21.15.47:0/1814714755 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2e400cc0d0 msgr2=0x7f2e400cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:14.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.189+0000 7f2e3ffff640 1 --2- 172.21.15.47:0/1814714755 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2e400cc0d0 0x7f2e400cc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:14.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.189+0000 7f2e3ffff640 1 -- 172.21.15.47:0/1814714755 >> v1:172.21.15.47:6789/0 conn(0x7f2e400c93f0 legacy=0x7f2e4006c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:14.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.189+0000 7f2e3ffff640 1 -- 172.21.15.47:0/1814714755 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e400c97d0 con 0x7f2e400cee30 2024-04-01T22:34:14.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.191+0000 7f2e3ffff640 1 --2- 172.21.15.47:0/1814714755 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2e400cee30 0x7f2e4015afc0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c009870 tx=0x7f2e2c02b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39f91dca3c41facd server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:14.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.194+0000 7f2e3f7fe640 1 -- 172.21.15.47:0/1814714755 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c0317c0 con 0x7f2e400cee30 2024-04-01T22:34:14.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.194+0000 7f2e3f7fe640 1 -- 172.21.15.47:0/1814714755 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e2c037070 con 0x7f2e400cee30 2024-04-01T22:34:14.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.195+0000 7f2e3f7fe640 1 -- 172.21.15.47:0/1814714755 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c031b80 con 0x7f2e400cee30 2024-04-01T22:34:14.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.195+0000 7f2e470a4640 1 -- 172.21.15.47:0/1814714755 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2e400cee30 msgr2=0x7f2e4015afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:14.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.195+0000 7f2e470a4640 1 --2- 172.21.15.47:0/1814714755 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2e400cee30 0x7f2e4015afc0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c009870 tx=0x7f2e2c02b860 comp rx=0 tx=0).stop 2024-04-01T22:34:14.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.195+0000 7f2e470a4640 1 -- 172.21.15.47:0/1814714755 shutdown_connections 2024-04-01T22:34:14.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.195+0000 7f2e470a4640 1 --2- 172.21.15.47:0/1814714755 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2e400cee30 0x7f2e4015afc0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:14.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.195+0000 7f2e470a4640 1 --2- 172.21.15.47:0/1814714755 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2e400cc0d0 0x7f2e400cc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:14.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.195+0000 7f2e470a4640 1 -- 172.21.15.47:0/1814714755 >> 172.21.15.47:0/1814714755 conn(0x7f2e400cfdb0 msgr2=0x7f2e400d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:14.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.195+0000 7f2e470a4640 1 -- 172.21.15.47:0/1814714755 shutdown_connections 2024-04-01T22:34:14.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.195+0000 7f2e470a4640 1 -- 172.21.15.47:0/1814714755 wait complete. 2024-04-01T22:34:14.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.196+0000 7f2e470a4640 1 Processor -- start 2024-04-01T22:34:14.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.196+0000 7f2e470a4640 1 -- start start 2024-04-01T22:34:14.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.197+0000 7f2e470a4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e400c93f0 0x7f2e400b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:14.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.197+0000 7f2e470a4640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2e400cc0d0 0x7f2e400b2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:14.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.197+0000 7f2e470a4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2e400cee30 0x7f2e400b3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:14.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.197+0000 7f2e470a4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2e400ce340 con 0x7f2e400c93f0 2024-04-01T22:34:14.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.197+0000 7f2e470a4640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2e400ce060 con 0x7f2e400cee30 2024-04-01T22:34:14.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.197+0000 7f2e470a4640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f2e400ce620 con 0x7f2e400cc0d0 2024-04-01T22:34:14.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.198+0000 7f2e44e40640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e400c93f0 0x7f2e400b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:14.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.198+0000 7f2e3ffff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2e400cc0d0 0x7f2e400b2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:14.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.198+0000 7f2e45641640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2e400cee30 0x7f2e400b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:14.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.198+0000 7f2e3ffff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2e400cc0d0 0x7f2e400b2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:52684/0 (socket says 172.21.15.47:52684) 2024-04-01T22:34:14.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.198+0000 7f2e3ffff640 1 -- 172.21.15.47:0/3982762972 learned_addr learned my addr 172.21.15.47:0/3982762972 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:14.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.201+0000 7f2e3ffff640 1 -- 172.21.15.47:0/3982762972 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2e400cee30 msgr2=0x7f2e400b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:14.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.201+0000 7f2e3ffff640 1 --2- 172.21.15.47:0/3982762972 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2e400cee30 0x7f2e400b3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:14.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.201+0000 7f2e3ffff640 1 -- 172.21.15.47:0/3982762972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e400c93f0 msgr2=0x7f2e400b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:14.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.201+0000 7f2e3ffff640 1 --2- 172.21.15.47:0/3982762972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e400c93f0 0x7f2e400b50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:14.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.201+0000 7f2e3ffff640 1 -- 172.21.15.47:0/3982762972 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e40157a30 con 0x7f2e400cc0d0 2024-04-01T22:34:14.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.204+0000 7f2e3ffff640 1 --2- 172.21.15.47:0/3982762972 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2e400cc0d0 0x7f2e400b2df0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c0090b0 tx=0x7f2e2c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:14.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.207+0000 7f2e3d7fa640 1 -- 172.21.15.47:0/3982762972 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c032650 con 0x7f2e400cc0d0 2024-04-01T22:34:14.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.207+0000 7f2e3d7fa640 1 -- 172.21.15.47:0/3982762972 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e2c032810 con 0x7f2e400cc0d0 2024-04-01T22:34:14.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.207+0000 7f2e3d7fa640 1 -- 172.21.15.47:0/3982762972 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c032c00 con 0x7f2e400cc0d0 2024-04-01T22:34:14.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.207+0000 7f2e470a4640 1 -- 172.21.15.47:0/3982762972 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e40156eb0 con 0x7f2e400cc0d0 2024-04-01T22:34:14.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.207+0000 7f2e470a4640 1 -- 172.21.15.47:0/3982762972 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e40157470 con 0x7f2e400cc0d0 2024-04-01T22:34:14.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.208+0000 7f2e470a4640 1 -- 172.21.15.47:0/3982762972 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e40068210 con 0x7f2e400cc0d0 2024-04-01T22:34:14.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.450+0000 7f2e3d7fa640 1 -- 172.21.15.47:0/3982762972 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f2e2c04c060 con 0x7f2e400cc0d0 2024-04-01T22:34:14.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.450+0000 7f2e3d7fa640 1 --2- 172.21.15.47:0/3982762972 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f2e2406b9e0 0x7f2e2406dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:14.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.450+0000 7f2e44e40640 1 --2- 172.21.15.47:0/3982762972 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f2e2406b9e0 0x7f2e2406dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:14.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.451+0000 7f2e44e40640 1 --2- 172.21.15.47:0/3982762972 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f2e2406b9e0 0x7f2e2406dea0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2e34004f60 tx=0x7f2e34007e30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:14.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.453+0000 7f2e3d7fa640 1 -- 172.21.15.47:0/3982762972 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f2e2c078640 con 0x7f2e400cc0d0 2024-04-01T22:34:14.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.463+0000 7f2e3d7fa640 1 -- 172.21.15.47:0/3982762972 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f2e2c040070 con 0x7f2e400cc0d0 2024-04-01T22:34:14.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.644+0000 7f2e470a4640 1 -- 172.21.15.47:0/3982762972 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f2e4006cf00 con 0x7f2e400cc0d0 2024-04-01T22:34:14.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.649+0000 7f2e3d7fa640 1 -- 172.21.15.47:0/3982762972 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f2e2c07a5a0 con 0x7f2e400cc0d0 2024-04-01T22:34:14.649 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-01T22:34:14.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.652+0000 7f2e470a4640 1 -- 172.21.15.47:0/3982762972 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f2e2406b9e0 msgr2=0x7f2e2406dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:14.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.652+0000 7f2e470a4640 1 --2- 172.21.15.47:0/3982762972 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f2e2406b9e0 0x7f2e2406dea0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2e34004f60 tx=0x7f2e34007e30 comp rx=0 tx=0).stop 2024-04-01T22:34:14.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.652+0000 7f2e470a4640 1 -- 172.21.15.47:0/3982762972 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2e400cc0d0 msgr2=0x7f2e400b2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:14.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.652+0000 7f2e470a4640 1 --2- 172.21.15.47:0/3982762972 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2e400cc0d0 0x7f2e400b2df0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c0090b0 tx=0x7f2e2c0046c0 comp rx=0 tx=0).stop 2024-04-01T22:34:14.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.652+0000 7f2e470a4640 1 -- 172.21.15.47:0/3982762972 shutdown_connections 2024-04-01T22:34:14.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.652+0000 7f2e470a4640 1 --2- 172.21.15.47:0/3982762972 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f2e2406b9e0 0x7f2e2406dea0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:14.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.652+0000 7f2e470a4640 1 --2- 172.21.15.47:0/3982762972 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2e400cee30 0x7f2e400b3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:14.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.652+0000 7f2e470a4640 1 --2- 172.21.15.47:0/3982762972 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2e400cc0d0 0x7f2e400b2df0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:14.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.652+0000 7f2e470a4640 1 --2- 172.21.15.47:0/3982762972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e400c93f0 0x7f2e400b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:14.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.652+0000 7f2e470a4640 1 -- 172.21.15.47:0/3982762972 >> 172.21.15.47:0/3982762972 conn(0x7f2e400cfdb0 msgr2=0x7f2e401542e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:14.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.652+0000 7f2e470a4640 1 -- 172.21.15.47:0/3982762972 shutdown_connections 2024-04-01T22:34:14.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.652+0000 7f2e470a4640 1 -- 172.21.15.47:0/3982762972 wait complete. 2024-04-01T22:34:14.662 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T22:34:14.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.764+0000 7fb00bffd640 1 Processor -- start 2024-04-01T22:34:14.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.765+0000 7fb00bffd640 1 -- start start 2024-04-01T22:34:14.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.765+0000 7fb00bffd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb0040ca4d0 0x7fb004163ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:14.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.765+0000 7fb00bffd640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0040ca920 con 0x7fb0041524d0 2024-04-01T22:34:14.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.765+0000 7fb00bffd640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0041528b0 con 0x7fb0040ca090 2024-04-01T22:34:14.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.765+0000 7fb00bffd640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb004159130 con 0x7fb0040ca4d0 2024-04-01T22:34:14.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.766+0000 7fb009d99640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fb0041524d0 0x7fb0040c8980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:51772/0 (socket says 172.21.15.47:51772) 2024-04-01T22:34:14.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.766+0000 7fb00a59a640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb0040ca4d0 0x7fb004163ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:14.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.766+0000 7fb009d99640 1 -- 172.21.15.47:0/1715025898 learned_addr learned my addr 172.21.15.47:0/1715025898 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T22:34:14.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.769+0000 7fb008d97640 1 -- 172.21.15.47:0/1715025898 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2868862217 0 0) 0x7fb0041528b0 con 0x7fb0040ca090 2024-04-01T22:34:14.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.769+0000 7fb008d97640 1 -- 172.21.15.47:0/1715025898 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faff0003520 con 0x7fb0040ca090 2024-04-01T22:34:14.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.769+0000 7fb00a59a640 1 -- 172.21.15.47:0/1715025898 >> v1:172.21.15.181:6789/0 conn(0x7fb0040ca090 legacy=0x7fb00415bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:14.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.769+0000 7fb00a59a640 1 -- 172.21.15.47:0/1715025898 >> v1:172.21.15.47:6789/0 conn(0x7fb0041524d0 legacy=0x7fb0040c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:14.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.769+0000 7fb00a59a640 1 -- 172.21.15.47:0/1715025898 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0041585b0 con 0x7fb0040ca4d0 2024-04-01T22:34:14.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.772+0000 7fb00a59a640 1 --2- 172.21.15.47:0/1715025898 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb0040ca4d0 0x7fb004163ae0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faffc009dc0 tx=0x7faffc02bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c37940c68d35a5e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:14.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.776+0000 7fb008d97640 1 -- 172.21.15.47:0/1715025898 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faffc039070 con 0x7fb0040ca4d0 2024-04-01T22:34:14.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.776+0000 7fb008d97640 1 -- 172.21.15.47:0/1715025898 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faffc02ccd0 con 0x7fb0040ca4d0 2024-04-01T22:34:14.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.776+0000 7fb008d97640 1 -- 172.21.15.47:0/1715025898 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faffc034660 con 0x7fb0040ca4d0 2024-04-01T22:34:14.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.776+0000 7fb00bffd640 1 -- 172.21.15.47:0/1715025898 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb0040ca4d0 msgr2=0x7fb004163ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:14.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.776+0000 7fb00bffd640 1 --2- 172.21.15.47:0/1715025898 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb0040ca4d0 0x7fb004163ae0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faffc009dc0 tx=0x7faffc02bf20 comp rx=0 tx=0).stop 2024-04-01T22:34:14.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.776+0000 7fb00bffd640 1 -- 172.21.15.47:0/1715025898 shutdown_connections 2024-04-01T22:34:14.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.776+0000 7fb00bffd640 1 --2- 172.21.15.47:0/1715025898 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb0040ca4d0 0x7fb004163ae0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:14.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.776+0000 7fb00bffd640 1 -- 172.21.15.47:0/1715025898 >> 172.21.15.47:0/1715025898 conn(0x7fb004071330 msgr2=0x7fb004071740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:14.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.776+0000 7fb00bffd640 1 -- 172.21.15.47:0/1715025898 shutdown_connections 2024-04-01T22:34:14.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.776+0000 7fb00bffd640 1 -- 172.21.15.47:0/1715025898 wait complete. 2024-04-01T22:34:14.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.777+0000 7fb00bffd640 1 Processor -- start 2024-04-01T22:34:14.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.777+0000 7fb00bffd640 1 -- start start 2024-04-01T22:34:14.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.778+0000 7fb00bffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0040ca090 0x7fb0041f06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:14.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.778+0000 7fb00bffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0040ca4d0 0x7fb00406c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:14.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.778+0000 7fb00bffd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb0041524d0 0x7fb00414fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:14.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.778+0000 7fb00bffd640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb004158e50 con 0x7fb0040ca4d0 2024-04-01T22:34:14.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.778+0000 7fb00bffd640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb004158b70 con 0x7fb0040ca090 2024-04-01T22:34:14.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.778+0000 7fb00bffd640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb00415b870 con 0x7fb0041524d0 2024-04-01T22:34:14.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.779+0000 7fb00a59a640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb0041524d0 0x7fb00414fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:14.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.779+0000 7fb009d99640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0040ca090 0x7fb0041f06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:14.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.779+0000 7fb009598640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0040ca4d0 0x7fb00406c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:14.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.779+0000 7fb00a59a640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb0041524d0 0x7fb00414fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:52696/0 (socket says 172.21.15.47:52696) 2024-04-01T22:34:14.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.779+0000 7fb00a59a640 1 -- 172.21.15.47:0/1497836054 learned_addr learned my addr 172.21.15.47:0/1497836054 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:14.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.782+0000 7fb009d99640 1 -- 172.21.15.47:0/1497836054 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb0041524d0 msgr2=0x7fb00414fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:14.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.782+0000 7fb009d99640 1 --2- 172.21.15.47:0/1497836054 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb0041524d0 0x7fb00414fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:14.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.782+0000 7fb009d99640 1 -- 172.21.15.47:0/1497836054 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0040ca4d0 msgr2=0x7fb00406c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:14.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.782+0000 7fb009d99640 1 --2- 172.21.15.47:0/1497836054 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0040ca4d0 0x7fb00406c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:14.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.782+0000 7fb009d99640 1 -- 172.21.15.47:0/1497836054 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0041f0c30 con 0x7fb0040ca090 2024-04-01T22:34:14.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.785+0000 7fb009d99640 1 --2- 172.21.15.47:0/1497836054 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0040ca090 0x7fb0041f06f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7faff800c440 tx=0x7faff8001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:14.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.788+0000 7faff67fc640 1 -- 172.21.15.47:0/1497836054 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff8017070 con 0x7fb0040ca090 2024-04-01T22:34:14.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.788+0000 7faff67fc640 1 -- 172.21.15.47:0/1497836054 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faff8005ce0 con 0x7fb0040ca090 2024-04-01T22:34:14.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.788+0000 7fb00bffd640 1 -- 172.21.15.47:0/1497836054 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0040c8ef0 con 0x7fb0040ca090 2024-04-01T22:34:14.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.788+0000 7faff67fc640 1 -- 172.21.15.47:0/1497836054 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff80072d0 con 0x7fb0040ca090 2024-04-01T22:34:14.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.789+0000 7fb00bffd640 1 -- 172.21.15.47:0/1497836054 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb00406de40 con 0x7fb0040ca090 2024-04-01T22:34:14.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:14.789+0000 7fb00bffd640 1 -- 172.21.15.47:0/1497836054 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb004068210 con 0x7fb0040ca090 2024-04-01T22:34:15.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.040+0000 7faff67fc640 1 -- 172.21.15.47:0/1497836054 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7faff801a070 con 0x7fb0040ca090 2024-04-01T22:34:15.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.041+0000 7faff67fc640 1 --2- 172.21.15.47:0/1497836054 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fafe806b990 0x7fafe806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:15.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.041+0000 7fb009598640 1 --2- 172.21.15.47:0/1497836054 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fafe806b990 0x7fafe806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:15.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.041+0000 7fb009598640 1 --2- 172.21.15.47:0/1497836054 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fafe806b990 0x7fafe806de50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb000007fd0 tx=0x7fb000009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:15.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.043+0000 7faff67fc640 1 -- 172.21.15.47:0/1497836054 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7faff8056650 con 0x7fb0040ca090 2024-04-01T22:34:15.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.054+0000 7faff67fc640 1 -- 172.21.15.47:0/1497836054 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7faff80585b0 con 0x7fb0040ca090 2024-04-01T22:34:15.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.280+0000 7fb00bffd640 1 -- 172.21.15.47:0/1497836054 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb00406e120 con 0x7fb0040ca090 2024-04-01T22:34:15.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.292+0000 7faff67fc640 1 -- 172.21.15.47:0/1497836054 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6835 (secure 0 0 0) 0x7faff805c650 con 0x7fb0040ca090 2024-04-01T22:34:15.292 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:34:15.292 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4222,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/1297694239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1297694239},{"type":"v1","addr":"172.21.15.181:6835","nonce":1297694239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4225,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/2435310452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":2435310452},{"type":"v1","addr":"172.21.15.181:6837","nonce":2435310452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4228,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1974242436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1974242436},{"type":"v1","addr":"172.21.15.47:6839","nonce":1974242436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/4251771217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":4251771217},{"type":"v1","addr":"172.21.15.47:6837","nonce":4251771217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/1534194215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1534194215},{"type":"v1","addr":"172.21.15.181:6833","nonce":1534194215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-01T22:33:27.610692+0000","modified":"2024-04-01T22:34:00.874320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.47:6835/1610100855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":1610100855},{"type":"v1","addr":"172.21.15.47:6835","nonce":1610100855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4254,"qdb_cluster":[4254]},"id":1}]} 2024-04-01T22:34:15.293 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 9 2024-04-01T22:34:15.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.294+0000 7fb00bffd640 1 -- 172.21.15.47:0/1497836054 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fafe806b990 msgr2=0x7fafe806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:15.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.294+0000 7fb00bffd640 1 --2- 172.21.15.47:0/1497836054 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fafe806b990 0x7fafe806de50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb000007fd0 tx=0x7fb000009040 comp rx=0 tx=0).stop 2024-04-01T22:34:15.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.294+0000 7fb00bffd640 1 -- 172.21.15.47:0/1497836054 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0040ca090 msgr2=0x7fb0041f06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:15.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.294+0000 7fb00bffd640 1 --2- 172.21.15.47:0/1497836054 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0040ca090 0x7fb0041f06f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7faff800c440 tx=0x7faff8001e70 comp rx=0 tx=0).stop 2024-04-01T22:34:15.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.294+0000 7fb00bffd640 1 -- 172.21.15.47:0/1497836054 shutdown_connections 2024-04-01T22:34:15.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.294+0000 7fb00bffd640 1 --2- 172.21.15.47:0/1497836054 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fafe806b990 0x7fafe806de50 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:15.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.294+0000 7fb00bffd640 1 --2- 172.21.15.47:0/1497836054 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb0041524d0 0x7fb00414fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:15.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.294+0000 7fb00bffd640 1 --2- 172.21.15.47:0/1497836054 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0040ca4d0 0x7fb00406c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:15.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.294+0000 7fb00bffd640 1 --2- 172.21.15.47:0/1497836054 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0040ca090 0x7fb0041f06f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:15.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.294+0000 7fb00bffd640 1 -- 172.21.15.47:0/1497836054 >> 172.21.15.47:0/1497836054 conn(0x7fb004071330 msgr2=0x7fb004159520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:15.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.294+0000 7fb00bffd640 1 -- 172.21.15.47:0/1497836054 shutdown_connections 2024-04-01T22:34:15.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.294+0000 7fb00bffd640 1 -- 172.21.15.47:0/1497836054 wait complete. 2024-04-01T22:34:15.305 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T22:34:15.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.408+0000 7f29c0255640 1 Processor -- start 2024-04-01T22:34:15.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.408+0000 7f29c0255640 1 -- start start 2024-04-01T22:34:15.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.409+0000 7f29c0255640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f29b806c250 0x7f29b815aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:15.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.409+0000 7f29c0255640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f29b815bb20 0x7f29b815bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:15.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.409+0000 7f29c0255640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29b8154b70 con 0x7f29b806c630 2024-04-01T22:34:15.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.409+0000 7f29c0255640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f29b80ce990 con 0x7f29b815bb20 2024-04-01T22:34:15.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.409+0000 7f29c0255640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f29b815c4b0 con 0x7f29b806c250 2024-04-01T22:34:15.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.410+0000 7f29be7f2640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f29b815bb20 0x7f29b815bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:15.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.410+0000 7f29bdff1640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f29b806c250 0x7f29b815aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:15.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.410+0000 7f29bdff1640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f29b806c250 0x7f29b815aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:52702/0 (socket says 172.21.15.47:52702) 2024-04-01T22:34:15.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.410+0000 7f29bdff1640 1 -- 172.21.15.47:0/2489081282 learned_addr learned my addr 172.21.15.47:0/2489081282 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:15.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.412+0000 7f29bdff1640 1 -- 172.21.15.47:0/2489081282 >> v2:172.21.15.181:3300/0 conn(0x7f29b815bb20 msgr2=0x7f29b815bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:15.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.412+0000 7f29bdff1640 1 --2- 172.21.15.47:0/2489081282 >> v2:172.21.15.181:3300/0 conn(0x7f29b815bb20 0x7f29b815bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:15.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.412+0000 7f29bdff1640 1 -- 172.21.15.47:0/2489081282 >> v1:172.21.15.181:6789/0 conn(0x7f29b806c630 legacy=0x7f29b80ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:15.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.412+0000 7f29bdff1640 1 -- 172.21.15.47:0/2489081282 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b80cdac0 con 0x7f29b806c250 2024-04-01T22:34:15.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.414+0000 7f29bdff1640 1 --2- 172.21.15.47:0/2489081282 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f29b806c250 0x7f29b815aec0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f29b4009870 tx=0x7f29b402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e5e0dd30843aada server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:15.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.418+0000 7f29bcfef640 1 -- 172.21.15.47:0/2489081282 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b4034070 con 0x7f29b806c250 2024-04-01T22:34:15.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.418+0000 7f29bcfef640 1 -- 172.21.15.47:0/2489081282 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29b4030840 con 0x7f29b806c250 2024-04-01T22:34:15.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.418+0000 7f29bcfef640 1 -- 172.21.15.47:0/2489081282 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b4030c10 con 0x7f29b806c250 2024-04-01T22:34:15.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.418+0000 7f29c0255640 1 -- 172.21.15.47:0/2489081282 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f29b806c250 msgr2=0x7f29b815aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:15.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.418+0000 7f29c0255640 1 --2- 172.21.15.47:0/2489081282 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f29b806c250 0x7f29b815aec0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f29b4009870 tx=0x7f29b402b980 comp rx=0 tx=0).stop 2024-04-01T22:34:15.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.418+0000 7f29c0255640 1 -- 172.21.15.47:0/2489081282 shutdown_connections 2024-04-01T22:34:15.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.418+0000 7f29c0255640 1 --2- 172.21.15.47:0/2489081282 >> v2:172.21.15.181:3300/0 conn(0x7f29b815bb20 0x7f29b815bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:15.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.418+0000 7f29c0255640 1 --2- 172.21.15.47:0/2489081282 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f29b806c250 0x7f29b815aec0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:15.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.418+0000 7f29c0255640 1 -- 172.21.15.47:0/2489081282 >> 172.21.15.47:0/2489081282 conn(0x7f29b80cfdb0 msgr2=0x7f29b80d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:15.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.418+0000 7f29c0255640 1 -- 172.21.15.47:0/2489081282 shutdown_connections 2024-04-01T22:34:15.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.418+0000 7f29c0255640 1 -- 172.21.15.47:0/2489081282 wait complete. 2024-04-01T22:34:15.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.419+0000 7f29c0255640 1 Processor -- start 2024-04-01T22:34:15.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.419+0000 7f29c0255640 1 -- start start 2024-04-01T22:34:15.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.420+0000 7f29c0255640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29b806c250 0x7f29b81f0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:15.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.420+0000 7f29c0255640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f29b806c630 0x7f29b8158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:15.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.420+0000 7f29c0255640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29b815bb20 0x7f29b81590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:15.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.420+0000 7f29c0255640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f29b80ce060 con 0x7f29b806c250 2024-04-01T22:34:15.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.420+0000 7f29c0255640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f29b80cdd80 con 0x7f29b815bb20 2024-04-01T22:34:15.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.420+0000 7f29c0255640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f29b80ce340 con 0x7f29b806c630 2024-04-01T22:34:15.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.421+0000 7f29bdff1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29b806c250 0x7f29b81f0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:15.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.421+0000 7f29be7f2640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29b815bb20 0x7f29b81590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:15.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.421+0000 7f29bd7f0640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f29b806c630 0x7f29b8158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:15.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.421+0000 7f29be7f2640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29b815bb20 0x7f29b81590f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:56782/0 (socket says 172.21.15.47:56782) 2024-04-01T22:34:15.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.421+0000 7f29be7f2640 1 -- 172.21.15.47:0/1168286335 learned_addr learned my addr 172.21.15.47:0/1168286335 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:15.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.421+0000 7f29bd7f0640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f29b806c630 0x7f29b8158bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:52712/0 (socket says 172.21.15.47:52712) 2024-04-01T22:34:15.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.425+0000 7f29bd7f0640 1 -- 172.21.15.47:0/1168286335 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29b815bb20 msgr2=0x7f29b81590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:15.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.425+0000 7f29bd7f0640 1 --2- 172.21.15.47:0/1168286335 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29b815bb20 0x7f29b81590f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:15.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.425+0000 7f29bd7f0640 1 -- 172.21.15.47:0/1168286335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29b806c250 msgr2=0x7f29b81f0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:15.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.425+0000 7f29bd7f0640 1 --2- 172.21.15.47:0/1168286335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29b806c250 0x7f29b81f0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:15.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.425+0000 7f29bd7f0640 1 -- 172.21.15.47:0/1168286335 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b80b1750 con 0x7f29b806c630 2024-04-01T22:34:15.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.427+0000 7f29bd7f0640 1 --2- 172.21.15.47:0/1168286335 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f29b806c630 0x7f29b8158bb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f29a800c410 tx=0x7f29a800c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:15.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.430+0000 7f29ae7fc640 1 -- 172.21.15.47:0/1168286335 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a8017070 con 0x7f29b806c630 2024-04-01T22:34:15.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.430+0000 7f29ae7fc640 1 -- 172.21.15.47:0/1168286335 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29a8005230 con 0x7f29b806c630 2024-04-01T22:34:15.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.430+0000 7f29ae7fc640 1 -- 172.21.15.47:0/1168286335 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a80045e0 con 0x7f29b806c630 2024-04-01T22:34:15.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.430+0000 7f29c0255640 1 -- 172.21.15.47:0/1168286335 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29b80b1a30 con 0x7f29b806c630 2024-04-01T22:34:15.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.431+0000 7f29c0255640 1 -- 172.21.15.47:0/1168286335 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f29b80b1ff0 con 0x7f29b806c630 2024-04-01T22:34:15.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.431+0000 7f29c0255640 1 -- 172.21.15.47:0/1168286335 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29b8068210 con 0x7f29b806c630 2024-04-01T22:34:15.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.673+0000 7f29ae7fc640 1 -- 172.21.15.47:0/1168286335 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f29a801a070 con 0x7f29b806c630 2024-04-01T22:34:15.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.674+0000 7f29ae7fc640 1 --2- 172.21.15.47:0/1168286335 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f299c06ba10 0x7f299c06ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:15.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.674+0000 7f29bdff1640 1 --2- 172.21.15.47:0/1168286335 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f299c06ba10 0x7f299c06ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:15.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.674+0000 7f29bdff1640 1 --2- 172.21.15.47:0/1168286335 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f299c06ba10 0x7f299c06ded0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f29b4036000 tx=0x7f29b4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:15.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.678+0000 7f29ae7fc640 1 -- 172.21.15.47:0/1168286335 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f29a80562b0 con 0x7f29b806c630 2024-04-01T22:34:15.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.688+0000 7f29ae7fc640 1 -- 172.21.15.47:0/1168286335 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f29a8058210 con 0x7f29b806c630 2024-04-01T22:34:15.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.873+0000 7f29c0255640 1 -- 172.21.15.47:0/1168286335 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f29b80af310 con 0x7f29b806c630 2024-04-01T22:34:15.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.913+0000 7f29ae7fc640 1 -- 172.21.15.47:0/1168286335 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18914 (secure 0 0 0) 0x7f29a805c2b0 con 0x7f29b806c630 2024-04-01T22:34:15.913 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:34:15.913 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":27,"fsid":"a6998a48-38bc-4e42-b0d9-04f2fb5c3c87","created":"2024-04-01T22:32:57.112033+0000","modified":"2024-04-01T22:34:04.850029+0000","last_up_change":"2024-04-01T22:33:11.141073+0000","last_in_change":"2024-04-01T22:33:02.650459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T22:33:13.356568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T22:33:25.309421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T22:33:26.268050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-01T22:33:30.588103+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7bd3f25d-e3a5-4932-b381-53dcbb464dde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6811","nonce":3827395709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6813","nonce":3827395709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6817","nonce":3827395709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6815","nonce":3827395709}]},"public_addr":"172.21.15.47:6811/3827395709","cluster_addr":"172.21.15.47:6813/3827395709","heartbeat_back_addr":"172.21.15.47:6817/3827395709","heartbeat_front_addr":"172.21.15.47:6815/3827395709","state":["exists","up"]},{"osd":1,"uuid":"2aa60ba2-67ff-43c7-96c4-82ae2f3855ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6827","nonce":3152157503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6829","nonce":3152157503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6833","nonce":3152157503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6831","nonce":3152157503}]},"public_addr":"172.21.15.47:6827/3152157503","cluster_addr":"172.21.15.47:6829/3152157503","heartbeat_back_addr":"172.21.15.47:6833/3152157503","heartbeat_front_addr":"172.21.15.47:6831/3152157503","state":["exists","up"]},{"osd":2,"uuid":"d83f8a98-6db8-42b7-9ef6-5b16eb9a3492","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6803","nonce":1003968856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6805","nonce":1003968856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6809","nonce":1003968856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6807","nonce":1003968856}]},"public_addr":"172.21.15.47:6803/1003968856","cluster_addr":"172.21.15.47:6805/1003968856","heartbeat_back_addr":"172.21.15.47:6809/1003968856","heartbeat_front_addr":"172.21.15.47:6807/1003968856","state":["exists","up"]},{"osd":3,"uuid":"edc02ed5-d25c-4dc9-a0c3-7a26f20fae07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6819","nonce":2845699561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6821","nonce":2845699561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6825","nonce":2845699561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6823","nonce":2845699561}]},"public_addr":"172.21.15.47:6819/2845699561","cluster_addr":"172.21.15.47:6821/2845699561","heartbeat_back_addr":"172.21.15.47:6825/2845699561","heartbeat_front_addr":"172.21.15.47:6823/2845699561","state":["exists","up"]},{"osd":4,"uuid":"b3d67e74-f51e-4474-9c62-dd0daa60c728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6809","nonce":2961538461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6811","nonce":2961538461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6815","nonce":2961538461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6813","nonce":2961538461}]},"public_addr":"172.21.15.181:6809/2961538461","cluster_addr":"172.21.15.181:6811/2961538461","heartbeat_back_addr":"172.21.15.181:6815/2961538461","heartbeat_front_addr":"172.21.15.181:6813/2961538461","state":["exists","up"]},{"osd":5,"uuid":"d86e8f7a-99f4-4457-9949-cf2cb853e79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6817","nonce":2161566540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6819","nonce":2161566540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6823","nonce":2161566540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6821","nonce":2161566540}]},"public_addr":"172.21.15.181:6817/2161566540","cluster_addr":"172.21.15.181:6819/2161566540","heartbeat_back_addr":"172.21.15.181:6823/2161566540","heartbeat_front_addr":"172.21.15.181:6821/2161566540","state":["exists","up"]},{"osd":6,"uuid":"aa08266c-1719-4abd-afb9-e7e8ac593658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6801","nonce":3792144865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6803","nonce":3792144865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6807","nonce":3792144865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6805","nonce":3792144865}]},"public_addr":"172.21.15.181:6801/3792144865","cluster_addr":"172.21.15.181:6803/3792144865","heartbeat_back_addr":"172.21.15.181:6807/3792144865","heartbeat_front_addr":"172.21.15.181:6805/3792144865","state":["exists","up"]},{"osd":7,"uuid":"6e509762-24c8-46c3-93a1-4c50b11ebcf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6825","nonce":1760995885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6827","nonce":1760995885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6831","nonce":1760995885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6829","nonce":1760995885}]},"public_addr":"172.21.15.181:6825/1760995885","cluster_addr":"172.21.15.181:6827/1760995885","heartbeat_back_addr":"172.21.15.181:6831/1760995885","heartbeat_front_addr":"172.21.15.181:6829/1760995885","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.202426+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.255318+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.170288+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.290065+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.214871+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.176432+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.139940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.299546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.15","mappings":[{"from":7,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T22:34:15.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.915+0000 7f29c0255640 1 -- 172.21.15.47:0/1168286335 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f299c06ba10 msgr2=0x7f299c06ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:15.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.915+0000 7f29c0255640 1 --2- 172.21.15.47:0/1168286335 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f299c06ba10 0x7f299c06ded0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f29b4036000 tx=0x7f29b4008030 comp rx=0 tx=0).stop 2024-04-01T22:34:15.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.915+0000 7f29c0255640 1 -- 172.21.15.47:0/1168286335 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f29b806c630 msgr2=0x7f29b8158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:15.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.915+0000 7f29c0255640 1 --2- 172.21.15.47:0/1168286335 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f29b806c630 0x7f29b8158bb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f29a800c410 tx=0x7f29a800c8d0 comp rx=0 tx=0).stop 2024-04-01T22:34:15.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.915+0000 7f29c0255640 1 -- 172.21.15.47:0/1168286335 shutdown_connections 2024-04-01T22:34:15.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.915+0000 7f29c0255640 1 --2- 172.21.15.47:0/1168286335 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f299c06ba10 0x7f299c06ded0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:15.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.915+0000 7f29c0255640 1 --2- 172.21.15.47:0/1168286335 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29b815bb20 0x7f29b81590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:15.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.915+0000 7f29c0255640 1 --2- 172.21.15.47:0/1168286335 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f29b806c630 0x7f29b8158bb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:15.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.915+0000 7f29c0255640 1 --2- 172.21.15.47:0/1168286335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29b806c250 0x7f29b81f0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:15.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.915+0000 7f29c0255640 1 -- 172.21.15.47:0/1168286335 >> 172.21.15.47:0/1168286335 conn(0x7f29b80cfdb0 msgr2=0x7f29b8154110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:15.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.915+0000 7f29c0255640 1 -- 172.21.15.47:0/1168286335 shutdown_connections 2024-04-01T22:34:15.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:15.915+0000 7f29c0255640 1 -- 172.21.15.47:0/1168286335 wait complete. 2024-04-01T22:34:15.927 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-01T22:33:13.356568+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-01T22:33:25.309421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-01T22:33:26.268050+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-01T22:33:30.588103+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-01T22:34:15.927 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-01T22:34:16.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.034+0000 7f5f522eb640 1 Processor -- start 2024-04-01T22:34:16.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.034+0000 7f5f522eb640 1 -- start start 2024-04-01T22:34:16.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.035+0000 7f5f522eb640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5f4c152210 0x7f5f4c0c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:16.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.035+0000 7f5f522eb640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f4c1585a0 con 0x7f5f4c0cac90 2024-04-01T22:34:16.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.035+0000 7f5f522eb640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f4c158880 con 0x7f5f4c0c8ce0 2024-04-01T22:34:16.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.035+0000 7f5f522eb640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f5f4c158b60 con 0x7f5f4c152210 2024-04-01T22:34:16.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.036+0000 7f5f50888640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f5f4c0cac90 0x7f5f4c15bd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:51778/0 (socket says 172.21.15.47:51778) 2024-04-01T22:34:16.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.036+0000 7f5f50888640 1 -- 172.21.15.47:0/3774286589 learned_addr learned my addr 172.21.15.47:0/3774286589 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T22:34:16.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.036+0000 7f5f4bfff640 1 --2- 172.21.15.47:0/3774286589 >> v2:172.21.15.181:3300/0 conn(0x7f5f4c152210 0x7f5f4c0c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:16.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.038+0000 7f5f4affd640 1 -- 172.21.15.47:0/3774286589 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1186368422 0 0) 0x7f5f4c1585a0 con 0x7f5f4c0cac90 2024-04-01T22:34:16.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.038+0000 7f5f4affd640 1 -- 172.21.15.47:0/3774286589 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f38003520 con 0x7f5f4c0cac90 2024-04-01T22:34:16.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.041+0000 7f5f4bfff640 1 -- 172.21.15.47:0/3774286589 >> v1:172.21.15.181:6789/0 conn(0x7f5f4c0c8ce0 legacy=0x7f5f4c0ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:16.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.041+0000 7f5f4bfff640 1 -- 172.21.15.47:0/3774286589 >> v1:172.21.15.47:6789/0 conn(0x7f5f4c0cac90 legacy=0x7f5f4c15bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:16.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.041+0000 7f5f4bfff640 1 -- 172.21.15.47:0/3774286589 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f4c158e40 con 0x7f5f4c152210 2024-04-01T22:34:16.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.044+0000 7f5f4bfff640 1 --2- 172.21.15.47:0/3774286589 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f4c152210 0x7f5f4c0c87a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c0097a0 tx=0x7f5f3c02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8762828a8b48f1f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:16.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.048+0000 7f5f4affd640 1 -- 172.21.15.47:0/3774286589 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c034070 con 0x7f5f4c152210 2024-04-01T22:34:16.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.048+0000 7f5f4affd640 1 -- 172.21.15.47:0/3774286589 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f3c030610 con 0x7f5f4c152210 2024-04-01T22:34:16.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.048+0000 7f5f4affd640 1 -- 172.21.15.47:0/3774286589 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c0309e0 con 0x7f5f4c152210 2024-04-01T22:34:16.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.048+0000 7f5f522eb640 1 -- 172.21.15.47:0/3774286589 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f4c152210 msgr2=0x7f5f4c0c87a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:16.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.048+0000 7f5f522eb640 1 --2- 172.21.15.47:0/3774286589 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f4c152210 0x7f5f4c0c87a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c0097a0 tx=0x7f5f3c02b960 comp rx=0 tx=0).stop 2024-04-01T22:34:16.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.048+0000 7f5f522eb640 1 -- 172.21.15.47:0/3774286589 shutdown_connections 2024-04-01T22:34:16.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.048+0000 7f5f522eb640 1 --2- 172.21.15.47:0/3774286589 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f4c152210 0x7f5f4c0c87a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:16.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.048+0000 7f5f522eb640 1 -- 172.21.15.47:0/3774286589 >> 172.21.15.47:0/3774286589 conn(0x7f5f4c071310 msgr2=0x7f5f4c071720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:16.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.048+0000 7f5f522eb640 1 -- 172.21.15.47:0/3774286589 shutdown_connections 2024-04-01T22:34:16.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.048+0000 7f5f522eb640 1 -- 172.21.15.47:0/3774286589 wait complete. 2024-04-01T22:34:16.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.050+0000 7f5f522eb640 1 Processor -- start 2024-04-01T22:34:16.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.050+0000 7f5f522eb640 1 -- start start 2024-04-01T22:34:16.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.050+0000 7f5f522eb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f4c0c8ce0 0x7f5f4c1f3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:16.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.050+0000 7f5f522eb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f4c0cac90 0x7f5f4c14f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:16.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.050+0000 7f5f522eb640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5f4c152210 0x7f5f4c14f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:16.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.050+0000 7f5f522eb640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5f4c0ca250 con 0x7f5f4c0cac90 2024-04-01T22:34:16.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.050+0000 7f5f522eb640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5f4c15b860 con 0x7f5f4c0c8ce0 2024-04-01T22:34:16.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.050+0000 7f5f522eb640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f5f4c158270 con 0x7f5f4c152210 2024-04-01T22:34:16.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.051+0000 7f5f4bfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f4c0c8ce0 0x7f5f4c1f3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:16.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.051+0000 7f5f4b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f4c0cac90 0x7f5f4c14f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:16.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.051+0000 7f5f50888640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5f4c152210 0x7f5f4c14f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:16.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.051+0000 7f5f4bfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f4c0c8ce0 0x7f5f4c1f3210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:56798/0 (socket says 172.21.15.47:56798) 2024-04-01T22:34:16.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.051+0000 7f5f4bfff640 1 -- 172.21.15.47:0/3921475674 learned_addr learned my addr 172.21.15.47:0/3921475674 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:16.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.055+0000 7f5f4bfff640 1 -- 172.21.15.47:0/3921475674 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5f4c152210 msgr2=0x7f5f4c14f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:16.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.055+0000 7f5f4bfff640 1 --2- 172.21.15.47:0/3921475674 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5f4c152210 0x7f5f4c14f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:16.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.055+0000 7f5f4bfff640 1 -- 172.21.15.47:0/3921475674 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f4c0cac90 msgr2=0x7f5f4c14f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:16.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.055+0000 7f5f4bfff640 1 --2- 172.21.15.47:0/3921475674 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f4c0cac90 0x7f5f4c14f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:16.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.055+0000 7f5f4bfff640 1 -- 172.21.15.47:0/3921475674 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f4c1f3c90 con 0x7f5f4c0c8ce0 2024-04-01T22:34:16.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.057+0000 7f5f4bfff640 1 --2- 172.21.15.47:0/3921475674 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f4c0c8ce0 0x7f5f4c1f3210 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c000c00 tx=0x7f5f3c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:16.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.061+0000 7f5f48ff9640 1 -- 172.21.15.47:0/3921475674 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c034040 con 0x7f5f4c0c8ce0 2024-04-01T22:34:16.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.061+0000 7f5f48ff9640 1 -- 172.21.15.47:0/3921475674 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f3c03aba0 con 0x7f5f4c0c8ce0 2024-04-01T22:34:16.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.061+0000 7f5f48ff9640 1 -- 172.21.15.47:0/3921475674 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c0443f0 con 0x7f5f4c0c8ce0 2024-04-01T22:34:16.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.061+0000 7f5f522eb640 1 -- 172.21.15.47:0/3921475674 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f4c1e1c60 con 0x7f5f4c0c8ce0 2024-04-01T22:34:16.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.061+0000 7f5f522eb640 1 -- 172.21.15.47:0/3921475674 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f4c06c350 con 0x7f5f4c0c8ce0 2024-04-01T22:34:16.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.062+0000 7f5f522eb640 1 -- 172.21.15.47:0/3921475674 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f4c068210 con 0x7f5f4c0c8ce0 2024-04-01T22:34:16.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.080+0000 7f5f48ff9640 1 -- 172.21.15.47:0/3921475674 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f5f3c04b060 con 0x7f5f4c0c8ce0 2024-04-01T22:34:16.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.080+0000 7f5f48ff9640 1 --2- 172.21.15.47:0/3921475674 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f5f2c06b9e0 0x7f5f2c06dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:16.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.080+0000 7f5f4b7fe640 1 --2- 172.21.15.47:0/3921475674 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f5f2c06b9e0 0x7f5f2c06dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:16.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.081+0000 7f5f4b7fe640 1 --2- 172.21.15.47:0/3921475674 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f5f2c06b9e0 0x7f5f2c06dea0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c0c8cb0 tx=0x7f5f34009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:16.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.082+0000 7f5f48ff9640 1 -- 172.21.15.47:0/3921475674 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f5f3c0790a0 con 0x7f5f4c0c8ce0 2024-04-01T22:34:16.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.320+0000 7f5f48ff9640 1 -- 172.21.15.47:0/3921475674 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f5f3c03f070 con 0x7f5f4c0c8ce0 2024-04-01T22:34:16.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.506+0000 7f5f522eb640 1 -- 172.21.15.47:0/3921475674 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5f4c0c9370 con 0x7f5f4c0c8ce0 2024-04-01T22:34:16.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.511+0000 7f5f48ff9640 1 -- 172.21.15.47:0/3921475674 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f5f3c07b000 con 0x7f5f4c0c8ce0 2024-04-01T22:34:16.511 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-01T22:34:16.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.513+0000 7f5f522eb640 1 -- 172.21.15.47:0/3921475674 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f5f2c06b9e0 msgr2=0x7f5f2c06dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:16.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.513+0000 7f5f522eb640 1 --2- 172.21.15.47:0/3921475674 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f5f2c06b9e0 0x7f5f2c06dea0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c0c8cb0 tx=0x7f5f34009040 comp rx=0 tx=0).stop 2024-04-01T22:34:16.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.513+0000 7f5f522eb640 1 -- 172.21.15.47:0/3921475674 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f4c0c8ce0 msgr2=0x7f5f4c1f3210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:16.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.513+0000 7f5f522eb640 1 --2- 172.21.15.47:0/3921475674 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f4c0c8ce0 0x7f5f4c1f3210 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c000c00 tx=0x7f5f3c0046c0 comp rx=0 tx=0).stop 2024-04-01T22:34:16.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.513+0000 7f5f522eb640 1 -- 172.21.15.47:0/3921475674 shutdown_connections 2024-04-01T22:34:16.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.513+0000 7f5f522eb640 1 --2- 172.21.15.47:0/3921475674 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f5f2c06b9e0 0x7f5f2c06dea0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:16.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.513+0000 7f5f522eb640 1 --2- 172.21.15.47:0/3921475674 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f5f4c152210 0x7f5f4c14f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:16.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.513+0000 7f5f522eb640 1 --2- 172.21.15.47:0/3921475674 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f4c0cac90 0x7f5f4c14f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:16.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.513+0000 7f5f522eb640 1 --2- 172.21.15.47:0/3921475674 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f4c0c8ce0 0x7f5f4c1f3210 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:16.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.514+0000 7f5f522eb640 1 -- 172.21.15.47:0/3921475674 >> 172.21.15.47:0/3921475674 conn(0x7f5f4c071310 msgr2=0x7f5f4c1516f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:16.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.514+0000 7f5f522eb640 1 -- 172.21.15.47:0/3921475674 shutdown_connections 2024-04-01T22:34:16.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.514+0000 7f5f522eb640 1 -- 172.21.15.47:0/3921475674 wait complete. 2024-04-01T22:34:16.525 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-01T22:34:16.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.630+0000 7fbf6602e640 1 Processor -- start 2024-04-01T22:34:16.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.630+0000 7fbf6602e640 1 -- start start 2024-04-01T22:34:16.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.631+0000 7fbf6602e640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fbf600cc7e0 0x7fbf6015afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:16.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.631+0000 7fbf6602e640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf600cdae0 con 0x7fbf600cee30 2024-04-01T22:34:16.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.631+0000 7fbf6602e640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf600c97d0 con 0x7fbf600c93f0 2024-04-01T22:34:16.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.631+0000 7fbf6602e640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fbf6015b500 con 0x7fbf600cc7e0 2024-04-01T22:34:16.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.631+0000 7fbf5ffff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fbf600cc7e0 0x7fbf6015afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:16.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.631+0000 7fbf5effd640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fbf600cee30 0x7fbf600cc0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:51784/0 (socket says 172.21.15.47:51784) 2024-04-01T22:34:16.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.631+0000 7fbf5effd640 1 -- 172.21.15.47:0/2454926520 learned_addr learned my addr 172.21.15.47:0/2454926520 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T22:34:16.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.634+0000 7fbf5e7fc640 1 -- 172.21.15.47:0/2454926520 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1305049928 0 0) 0x7fbf600cdae0 con 0x7fbf600cee30 2024-04-01T22:34:16.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.634+0000 7fbf5e7fc640 1 -- 172.21.15.47:0/2454926520 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf48003520 con 0x7fbf600cee30 2024-04-01T22:34:16.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.634+0000 7fbf5ffff640 1 -- 172.21.15.47:0/2454926520 >> v1:172.21.15.181:6789/0 conn(0x7fbf600c93f0 legacy=0x7fbf6006c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:16.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.634+0000 7fbf5ffff640 1 -- 172.21.15.47:0/2454926520 >> v1:172.21.15.47:6789/0 conn(0x7fbf600cee30 legacy=0x7fbf600cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:16.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.634+0000 7fbf5ffff640 1 -- 172.21.15.47:0/2454926520 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf600cdd80 con 0x7fbf600cc7e0 2024-04-01T22:34:16.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.636+0000 7fbf5ffff640 1 --2- 172.21.15.47:0/2454926520 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbf600cc7e0 0x7fbf6015afc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbf58009d90 tx=0x7fbf5802beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92b4402e24f47952 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:16.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.641+0000 7fbf5e7fc640 1 -- 172.21.15.47:0/2454926520 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf58039070 con 0x7fbf600cc7e0 2024-04-01T22:34:16.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.641+0000 7fbf5e7fc640 1 -- 172.21.15.47:0/2454926520 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf5802cc60 con 0x7fbf600cc7e0 2024-04-01T22:34:16.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.641+0000 7fbf5e7fc640 1 -- 172.21.15.47:0/2454926520 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf58034660 con 0x7fbf600cc7e0 2024-04-01T22:34:16.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.642+0000 7fbf6602e640 1 -- 172.21.15.47:0/2454926520 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbf600cc7e0 msgr2=0x7fbf6015afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:16.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.642+0000 7fbf6602e640 1 --2- 172.21.15.47:0/2454926520 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbf600cc7e0 0x7fbf6015afc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbf58009d90 tx=0x7fbf5802beb0 comp rx=0 tx=0).stop 2024-04-01T22:34:16.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.642+0000 7fbf6602e640 1 -- 172.21.15.47:0/2454926520 shutdown_connections 2024-04-01T22:34:16.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.642+0000 7fbf6602e640 1 --2- 172.21.15.47:0/2454926520 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbf600cc7e0 0x7fbf6015afc0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:16.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.642+0000 7fbf6602e640 1 -- 172.21.15.47:0/2454926520 >> 172.21.15.47:0/2454926520 conn(0x7fbf600cfdb0 msgr2=0x7fbf600d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:16.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.642+0000 7fbf6602e640 1 -- 172.21.15.47:0/2454926520 shutdown_connections 2024-04-01T22:34:16.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.642+0000 7fbf6602e640 1 -- 172.21.15.47:0/2454926520 wait complete. 2024-04-01T22:34:16.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.643+0000 7fbf6602e640 1 Processor -- start 2024-04-01T22:34:16.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.643+0000 7fbf6602e640 1 -- start start 2024-04-01T22:34:16.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.644+0000 7fbf6602e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf600c93f0 0x7fbf600b4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:16.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.644+0000 7fbf6602e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbf600cc7e0 0x7fbf600b1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:16.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.644+0000 7fbf6602e640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf600cee30 0x7fbf601f0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:16.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.644+0000 7fbf6602e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbf600ce620 con 0x7fbf600c93f0 2024-04-01T22:34:16.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.644+0000 7fbf6602e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fbf600ce340 con 0x7fbf600cc7e0 2024-04-01T22:34:16.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.644+0000 7fbf6602e640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fbf600cf430 con 0x7fbf600cee30 2024-04-01T22:34:16.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.645+0000 7fbf5f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf600c93f0 0x7fbf600b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:16.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.645+0000 7fbf5effd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbf600cc7e0 0x7fbf600b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:16.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.645+0000 7fbf5ffff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf600cee30 0x7fbf601f0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:16.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.645+0000 7fbf5f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf600c93f0 0x7fbf600b4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34880/0 (socket says 172.21.15.47:34880) 2024-04-01T22:34:16.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.645+0000 7fbf5f7fe640 1 -- 172.21.15.47:0/1761998374 learned_addr learned my addr 172.21.15.47:0/1761998374 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:16.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.648+0000 7fbf5effd640 1 -- 172.21.15.47:0/1761998374 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf600cee30 msgr2=0x7fbf601f0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:16.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.648+0000 7fbf5effd640 1 --2- 172.21.15.47:0/1761998374 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf600cee30 0x7fbf601f0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:16.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.648+0000 7fbf5effd640 1 -- 172.21.15.47:0/1761998374 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf600c93f0 msgr2=0x7fbf600b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:16.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.648+0000 7fbf5effd640 1 --2- 172.21.15.47:0/1761998374 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf600c93f0 0x7fbf600b4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:16.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.648+0000 7fbf5effd640 1 -- 172.21.15.47:0/1761998374 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf601e6860 con 0x7fbf600cc7e0 2024-04-01T22:34:16.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.648+0000 7fbf5f7fe640 1 --2- 172.21.15.47:0/1761998374 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf600c93f0 0x7fbf600b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T22:34:16.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.650+0000 7fbf5effd640 1 --2- 172.21.15.47:0/1761998374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbf600cc7e0 0x7fbf600b1290 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbf5400c3f0 tx=0x7fbf54001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:16.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.654+0000 7fbf47fff640 1 -- 172.21.15.47:0/1761998374 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf54017070 con 0x7fbf600cc7e0 2024-04-01T22:34:16.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.654+0000 7fbf47fff640 1 -- 172.21.15.47:0/1761998374 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf54005ce0 con 0x7fbf600cc7e0 2024-04-01T22:34:16.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.654+0000 7fbf47fff640 1 -- 172.21.15.47:0/1761998374 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf540072f0 con 0x7fbf600cc7e0 2024-04-01T22:34:16.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.654+0000 7fbf6602e640 1 -- 172.21.15.47:0/1761998374 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf600b28d0 con 0x7fbf600cc7e0 2024-04-01T22:34:16.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.654+0000 7fbf6602e640 1 -- 172.21.15.47:0/1761998374 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf600b2e90 con 0x7fbf600cc7e0 2024-04-01T22:34:16.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.655+0000 7fbf6602e640 1 -- 172.21.15.47:0/1761998374 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf60068210 con 0x7fbf600cc7e0 2024-04-01T22:34:16.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.900+0000 7fbf47fff640 1 -- 172.21.15.47:0/1761998374 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7fbf5401a070 con 0x7fbf600cc7e0 2024-04-01T22:34:16.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.901+0000 7fbf47fff640 1 --2- 172.21.15.47:0/1761998374 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fbf4c06b990 0x7fbf4c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:16.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.901+0000 7fbf5f7fe640 1 --2- 172.21.15.47:0/1761998374 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fbf4c06b990 0x7fbf4c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:16.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.901+0000 7fbf5f7fe640 1 --2- 172.21.15.47:0/1761998374 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fbf4c06b990 0x7fbf4c06de50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbf50001c30 tx=0x7fbf50009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:16.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.903+0000 7fbf47fff640 1 -- 172.21.15.47:0/1761998374 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fbf54056540 con 0x7fbf600cc7e0 2024-04-01T22:34:16.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:16.914+0000 7fbf47fff640 1 -- 172.21.15.47:0/1761998374 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fbf54021020 con 0x7fbf600cc7e0 2024-04-01T22:34:17.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.096+0000 7fbf6602e640 1 -- 172.21.15.47:0/1761998374 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fbf6006cf00 con 0x7fbf600cc7e0 2024-04-01T22:34:17.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.101+0000 7fbf47fff640 1 -- 172.21.15.47:0/1761998374 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7fbf540584a0 con 0x7fbf600cc7e0 2024-04-01T22:34:17.100 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-01T22:34:17.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.102+0000 7fbf6602e640 1 -- 172.21.15.47:0/1761998374 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fbf4c06b990 msgr2=0x7fbf4c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:17.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.102+0000 7fbf6602e640 1 --2- 172.21.15.47:0/1761998374 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fbf4c06b990 0x7fbf4c06de50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbf50001c30 tx=0x7fbf50009040 comp rx=0 tx=0).stop 2024-04-01T22:34:17.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.102+0000 7fbf6602e640 1 -- 172.21.15.47:0/1761998374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbf600cc7e0 msgr2=0x7fbf600b1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:17.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.102+0000 7fbf6602e640 1 --2- 172.21.15.47:0/1761998374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbf600cc7e0 0x7fbf600b1290 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbf5400c3f0 tx=0x7fbf54001e70 comp rx=0 tx=0).stop 2024-04-01T22:34:17.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.102+0000 7fbf6602e640 1 -- 172.21.15.47:0/1761998374 shutdown_connections 2024-04-01T22:34:17.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.102+0000 7fbf6602e640 1 --2- 172.21.15.47:0/1761998374 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fbf4c06b990 0x7fbf4c06de50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:17.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.103+0000 7fbf6602e640 1 --2- 172.21.15.47:0/1761998374 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf600cee30 0x7fbf601f0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:17.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.103+0000 7fbf6602e640 1 --2- 172.21.15.47:0/1761998374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbf600cc7e0 0x7fbf600b1290 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:17.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.103+0000 7fbf6602e640 1 --2- 172.21.15.47:0/1761998374 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf600c93f0 0x7fbf600b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:17.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.103+0000 7fbf6602e640 1 -- 172.21.15.47:0/1761998374 >> 172.21.15.47:0/1761998374 conn(0x7fbf600cfdb0 msgr2=0x7fbf600d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:17.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.103+0000 7fbf6602e640 1 -- 172.21.15.47:0/1761998374 shutdown_connections 2024-04-01T22:34:17.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.103+0000 7fbf6602e640 1 -- 172.21.15.47:0/1761998374 wait complete. 2024-04-01T22:34:17.113 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-01T22:34:17.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.219+0000 7ff66a3b6640 1 Processor -- start 2024-04-01T22:34:17.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.219+0000 7ff66a3b6640 1 -- start start 2024-04-01T22:34:17.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.220+0000 7ff66a3b6640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff6640c93f0 0x7ff6640cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:17.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.220+0000 7ff66a3b6640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff6640cc0d0 0x7ff6640cc540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:17.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.220+0000 7ff66a3b6640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6640cca80 con 0x7ff66415afc0 2024-04-01T22:34:17.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.220+0000 7ff66a3b6640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7ff6640cdae0 con 0x7ff6640cc0d0 2024-04-01T22:34:17.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.220+0000 7ff66a3b6640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7ff6640c97d0 con 0x7ff6640c93f0 2024-04-01T22:34:17.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.220+0000 7ff663fff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff6640c93f0 0x7ff6640cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:17.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.221+0000 7ff663fff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff6640c93f0 0x7ff6640cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:56838/0 (socket says 172.21.15.47:56838) 2024-04-01T22:34:17.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.221+0000 7ff663fff640 1 -- 172.21.15.47:0/1199939785 learned_addr learned my addr 172.21.15.47:0/1199939785 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:17.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.222+0000 7ff668953640 1 --2- 172.21.15.47:0/1199939785 >> v2:172.21.15.47:3300/0 conn(0x7ff6640cc0d0 0x7ff6640cc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:17.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.223+0000 7ff663fff640 1 -- 172.21.15.47:0/1199939785 >> v2:172.21.15.47:3300/0 conn(0x7ff6640cc0d0 msgr2=0x7ff6640cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:17.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.223+0000 7ff663fff640 1 --2- 172.21.15.47:0/1199939785 >> v2:172.21.15.47:3300/0 conn(0x7ff6640cc0d0 0x7ff6640cc540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:17.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.223+0000 7ff663fff640 1 -- 172.21.15.47:0/1199939785 >> v1:172.21.15.181:6789/0 conn(0x7ff66415afc0 legacy=0x7ff66406c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:17.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.223+0000 7ff663fff640 1 -- 172.21.15.47:0/1199939785 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6640cdd80 con 0x7ff6640c93f0 2024-04-01T22:34:17.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.226+0000 7ff663fff640 1 --2- 172.21.15.47:0/1199939785 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6640c93f0 0x7ff6640cee30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff66408d100 tx=0x7ff64c02b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be1b30ccddd7d273 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:17.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.232+0000 7ff662ffd640 1 -- 172.21.15.47:0/1199939785 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64c02e070 con 0x7ff6640c93f0 2024-04-01T22:34:17.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.232+0000 7ff662ffd640 1 -- 172.21.15.47:0/1199939785 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff64c037070 con 0x7ff6640c93f0 2024-04-01T22:34:17.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.232+0000 7ff662ffd640 1 -- 172.21.15.47:0/1199939785 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64c031a00 con 0x7ff6640c93f0 2024-04-01T22:34:17.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.233+0000 7ff66a3b6640 1 -- 172.21.15.47:0/1199939785 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6640c93f0 msgr2=0x7ff6640cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:17.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.233+0000 7ff66a3b6640 1 --2- 172.21.15.47:0/1199939785 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6640c93f0 0x7ff6640cee30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff66408d100 tx=0x7ff64c02b880 comp rx=0 tx=0).stop 2024-04-01T22:34:17.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.233+0000 7ff66a3b6640 1 -- 172.21.15.47:0/1199939785 shutdown_connections 2024-04-01T22:34:17.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.233+0000 7ff66a3b6640 1 --2- 172.21.15.47:0/1199939785 >> v2:172.21.15.47:3300/0 conn(0x7ff6640cc0d0 0x7ff6640cc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:17.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.233+0000 7ff66a3b6640 1 --2- 172.21.15.47:0/1199939785 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6640c93f0 0x7ff6640cee30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:17.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.233+0000 7ff66a3b6640 1 -- 172.21.15.47:0/1199939785 >> 172.21.15.47:0/1199939785 conn(0x7ff6640cfdb0 msgr2=0x7ff6640d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:17.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.233+0000 7ff66a3b6640 1 -- 172.21.15.47:0/1199939785 shutdown_connections 2024-04-01T22:34:17.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.233+0000 7ff66a3b6640 1 -- 172.21.15.47:0/1199939785 wait complete. 2024-04-01T22:34:17.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.234+0000 7ff66a3b6640 1 Processor -- start 2024-04-01T22:34:17.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.234+0000 7ff66a3b6640 1 -- start start 2024-04-01T22:34:17.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.235+0000 7ff66a3b6640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff6640c93f0 0x7ff6641f1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:17.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.235+0000 7ff66a3b6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6640cc0d0 0x7ff6641f0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:17.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.235+0000 7ff66a3b6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff66415afc0 0x7ff664153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:17.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.235+0000 7ff66a3b6640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff6640ce620 con 0x7ff66415afc0 2024-04-01T22:34:17.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.235+0000 7ff66a3b6640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff6640ce340 con 0x7ff6640cc0d0 2024-04-01T22:34:17.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.235+0000 7ff66a3b6640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7ff66415b400 con 0x7ff6640c93f0 2024-04-01T22:34:17.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.235+0000 7ff668953640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff66415afc0 0x7ff664153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:17.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.236+0000 7ff668953640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff66415afc0 0x7ff664153e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34892/0 (socket says 172.21.15.47:34892) 2024-04-01T22:34:17.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.236+0000 7ff6637fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6640cc0d0 0x7ff6641f0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:17.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.236+0000 7ff668953640 1 -- 172.21.15.47:0/2799267869 learned_addr learned my addr 172.21.15.47:0/2799267869 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:17.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.236+0000 7ff663fff640 1 --2- 172.21.15.47:0/2799267869 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff6640c93f0 0x7ff6641f1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:17.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.239+0000 7ff668953640 1 -- 172.21.15.47:0/2799267869 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff6640c93f0 msgr2=0x7ff6641f1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:17.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.239+0000 7ff668953640 1 --2- 172.21.15.47:0/2799267869 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff6640c93f0 0x7ff6641f1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:17.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.239+0000 7ff668953640 1 -- 172.21.15.47:0/2799267869 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6640cc0d0 msgr2=0x7ff6641f0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:17.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.239+0000 7ff668953640 1 --2- 172.21.15.47:0/2799267869 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6640cc0d0 0x7ff6641f0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:17.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.239+0000 7ff668953640 1 -- 172.21.15.47:0/2799267869 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6641f01f0 con 0x7ff66415afc0 2024-04-01T22:34:17.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.242+0000 7ff668953640 1 --2- 172.21.15.47:0/2799267869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff66415afc0 0x7ff664153e70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff65c00efc0 tx=0x7ff65c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:17.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.246+0000 7ff660ff9640 1 -- 172.21.15.47:0/2799267869 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65c018020 con 0x7ff66415afc0 2024-04-01T22:34:17.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.246+0000 7ff660ff9640 1 -- 172.21.15.47:0/2799267869 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff65c014480 con 0x7ff66415afc0 2024-04-01T22:34:17.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.246+0000 7ff66a3b6640 1 -- 172.21.15.47:0/2799267869 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6641f4210 con 0x7ff66415afc0 2024-04-01T22:34:17.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.246+0000 7ff660ff9640 1 -- 172.21.15.47:0/2799267869 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65c014870 con 0x7ff66415afc0 2024-04-01T22:34:17.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.246+0000 7ff66a3b6640 1 -- 172.21.15.47:0/2799267869 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6641f04b0 con 0x7ff66415afc0 2024-04-01T22:34:17.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.247+0000 7ff66a3b6640 1 -- 172.21.15.47:0/2799267869 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff664068210 con 0x7ff66415afc0 2024-04-01T22:34:17.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.267+0000 7ff660ff9640 1 -- 172.21.15.47:0/2799267869 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7ff65c005d10 con 0x7ff66415afc0 2024-04-01T22:34:17.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.267+0000 7ff660ff9640 1 --2- 172.21.15.47:0/2799267869 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff64406ba10 0x7ff64406ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:17.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.267+0000 7ff663fff640 1 --2- 172.21.15.47:0/2799267869 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff64406ba10 0x7ff64406ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:17.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.268+0000 7ff663fff640 1 --2- 172.21.15.47:0/2799267869 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff64406ba10 0x7ff64406ded0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff64c036000 tx=0x7ff64c03d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:17.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.270+0000 7ff660ff9640 1 -- 172.21.15.47:0/2799267869 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7ff65c0580c0 con 0x7ff66415afc0 2024-04-01T22:34:17.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.528+0000 7ff660ff9640 1 -- 172.21.15.47:0/2799267869 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7ff65c022030 con 0x7ff66415afc0 2024-04-01T22:34:17.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.716+0000 7ff66a3b6640 1 -- 172.21.15.47:0/2799267869 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff66406cf00 con 0x7ff66415afc0 2024-04-01T22:34:17.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.721+0000 7ff660ff9640 1 -- 172.21.15.47:0/2799267869 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7ff65c010040 con 0x7ff66415afc0 2024-04-01T22:34:17.721 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-04-01T22:34:17.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.723+0000 7ff66a3b6640 1 -- 172.21.15.47:0/2799267869 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff64406ba10 msgr2=0x7ff64406ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:17.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.723+0000 7ff66a3b6640 1 --2- 172.21.15.47:0/2799267869 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff64406ba10 0x7ff64406ded0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff64c036000 tx=0x7ff64c03d040 comp rx=0 tx=0).stop 2024-04-01T22:34:17.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.723+0000 7ff66a3b6640 1 -- 172.21.15.47:0/2799267869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff66415afc0 msgr2=0x7ff664153e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:17.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.723+0000 7ff66a3b6640 1 --2- 172.21.15.47:0/2799267869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff66415afc0 0x7ff664153e70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff65c00efc0 tx=0x7ff65c00c490 comp rx=0 tx=0).stop 2024-04-01T22:34:17.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.723+0000 7ff66a3b6640 1 -- 172.21.15.47:0/2799267869 shutdown_connections 2024-04-01T22:34:17.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.723+0000 7ff66a3b6640 1 --2- 172.21.15.47:0/2799267869 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff64406ba10 0x7ff64406ded0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:17.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.723+0000 7ff66a3b6640 1 --2- 172.21.15.47:0/2799267869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff66415afc0 0x7ff664153e70 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:17.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.723+0000 7ff66a3b6640 1 --2- 172.21.15.47:0/2799267869 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff6640cc0d0 0x7ff6641f0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:17.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.723+0000 7ff66a3b6640 1 --2- 172.21.15.47:0/2799267869 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff6640c93f0 0x7ff6641f1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:17.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.723+0000 7ff66a3b6640 1 -- 172.21.15.47:0/2799267869 >> 172.21.15.47:0/2799267869 conn(0x7ff6640cfdb0 msgr2=0x7ff66406d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:17.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.723+0000 7ff66a3b6640 1 -- 172.21.15.47:0/2799267869 shutdown_connections 2024-04-01T22:34:17.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.723+0000 7ff66a3b6640 1 -- 172.21.15.47:0/2799267869 wait complete. 2024-04-01T22:34:17.734 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-01T22:34:17.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.839+0000 7f64aa674640 1 Processor -- start 2024-04-01T22:34:17.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.839+0000 7f64aa674640 1 -- start start 2024-04-01T22:34:17.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.839+0000 7f64aa674640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f64a4152210 0x7f64a40c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:17.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.839+0000 7f64aa674640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f64a40cac90 0x7f64a415bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:17.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.839+0000 7f64aa674640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64a41585a0 con 0x7f64a40c8ce0 2024-04-01T22:34:17.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.839+0000 7f64aa674640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f64a4158880 con 0x7f64a40cac90 2024-04-01T22:34:17.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.839+0000 7f64aa674640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f64a4158b60 con 0x7f64a4152210 2024-04-01T22:34:17.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.840+0000 7f64a3fff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f64a4152210 0x7f64a40c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:17.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.840+0000 7f64a8c11640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f64a40cac90 0x7f64a415bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:17.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.840+0000 7f64a37fe640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f64a40c8ce0 0x7f64a40ca580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:51792/0 (socket says 172.21.15.47:51792) 2024-04-01T22:34:17.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.840+0000 7f64a37fe640 1 -- 172.21.15.47:0/3328536033 learned_addr learned my addr 172.21.15.47:0/3328536033 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T22:34:17.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.843+0000 7f64a3fff640 1 -- 172.21.15.47:0/3328536033 >> v2:172.21.15.47:3300/0 conn(0x7f64a40cac90 msgr2=0x7f64a415bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:17.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.843+0000 7f64a3fff640 1 --2- 172.21.15.47:0/3328536033 >> v2:172.21.15.47:3300/0 conn(0x7f64a40cac90 0x7f64a415bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:17.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.843+0000 7f64a3fff640 1 -- 172.21.15.47:0/3328536033 >> v1:172.21.15.47:6789/0 conn(0x7f64a40c8ce0 legacy=0x7f64a40ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:17.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.843+0000 7f64a3fff640 1 -- 172.21.15.47:0/3328536033 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64a4158e40 con 0x7f64a4152210 2024-04-01T22:34:17.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.845+0000 7f64a3fff640 1 --2- 172.21.15.47:0/3328536033 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f64a4152210 0x7f64a40c87a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f64940097a0 tx=0x7f649402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7773efc65b37a5a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:17.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.848+0000 7f64a2ffd640 1 -- 172.21.15.47:0/3328536033 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6494035020 con 0x7f64a4152210 2024-04-01T22:34:17.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.848+0000 7f64a2ffd640 1 -- 172.21.15.47:0/3328536033 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6494031830 con 0x7f64a4152210 2024-04-01T22:34:17.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.848+0000 7f64a2ffd640 1 -- 172.21.15.47:0/3328536033 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6494031c00 con 0x7f64a4152210 2024-04-01T22:34:17.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.849+0000 7f64aa674640 1 -- 172.21.15.47:0/3328536033 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f64a4152210 msgr2=0x7f64a40c87a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:17.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.849+0000 7f64aa674640 1 --2- 172.21.15.47:0/3328536033 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f64a4152210 0x7f64a40c87a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f64940097a0 tx=0x7f649402b8d0 comp rx=0 tx=0).stop 2024-04-01T22:34:17.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.849+0000 7f64aa674640 1 -- 172.21.15.47:0/3328536033 shutdown_connections 2024-04-01T22:34:17.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.849+0000 7f64aa674640 1 --2- 172.21.15.47:0/3328536033 >> v2:172.21.15.47:3300/0 conn(0x7f64a40cac90 0x7f64a415bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:17.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.849+0000 7f64aa674640 1 --2- 172.21.15.47:0/3328536033 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f64a4152210 0x7f64a40c87a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:17.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.849+0000 7f64aa674640 1 -- 172.21.15.47:0/3328536033 >> 172.21.15.47:0/3328536033 conn(0x7f64a4071310 msgr2=0x7f64a4071720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:17.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.849+0000 7f64aa674640 1 -- 172.21.15.47:0/3328536033 shutdown_connections 2024-04-01T22:34:17.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.849+0000 7f64aa674640 1 -- 172.21.15.47:0/3328536033 wait complete. 2024-04-01T22:34:17.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.850+0000 7f64aa674640 1 Processor -- start 2024-04-01T22:34:17.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.850+0000 7f64aa674640 1 -- start start 2024-04-01T22:34:17.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.851+0000 7f64aa674640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f64a40c8ce0 0x7f64a406c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:17.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.851+0000 7f64aa674640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64a40cac90 0x7f64a414fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:17.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.851+0000 7f64aa674640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f64a4152210 0x7f64a40b0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:17.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.851+0000 7f64aa674640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f64a40ca250 con 0x7f64a40cac90 2024-04-01T22:34:17.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.851+0000 7f64aa674640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f64a415b860 con 0x7f64a4152210 2024-04-01T22:34:17.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.851+0000 7f64aa674640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f64a4158270 con 0x7f64a40c8ce0 2024-04-01T22:34:17.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.852+0000 7f64a37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64a40cac90 0x7f64a414fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:17.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.852+0000 7f64a3fff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f64a40c8ce0 0x7f64a406c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:17.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.852+0000 7f64a8c11640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f64a4152210 0x7f64a40b0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:17.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.852+0000 7f64a37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64a40cac90 0x7f64a414fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34900/0 (socket says 172.21.15.47:34900) 2024-04-01T22:34:17.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.852+0000 7f64a37fe640 1 -- 172.21.15.47:0/2928105767 learned_addr learned my addr 172.21.15.47:0/2928105767 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:17.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.855+0000 7f64a37fe640 1 -- 172.21.15.47:0/2928105767 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f64a40c8ce0 msgr2=0x7f64a406c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:17.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.855+0000 7f64a37fe640 1 --2- 172.21.15.47:0/2928105767 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f64a40c8ce0 0x7f64a406c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:17.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.855+0000 7f64a37fe640 1 -- 172.21.15.47:0/2928105767 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f64a4152210 msgr2=0x7f64a40b0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:17.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.855+0000 7f64a37fe640 1 --2- 172.21.15.47:0/2928105767 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f64a4152210 0x7f64a40b0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:17.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.855+0000 7f64a37fe640 1 -- 172.21.15.47:0/2928105767 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64a41efee0 con 0x7f64a40cac90 2024-04-01T22:34:17.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.857+0000 7f64a37fe640 1 --2- 172.21.15.47:0/2928105767 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64a40cac90 0x7f64a414fb10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f649800c400 tx=0x7f649800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:17.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.861+0000 7f64a0ff9640 1 -- 172.21.15.47:0/2928105767 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6498017070 con 0x7f64a40cac90 2024-04-01T22:34:17.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.861+0000 7f64a0ff9640 1 -- 172.21.15.47:0/2928105767 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6498005ce0 con 0x7f64a40cac90 2024-04-01T22:34:17.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.861+0000 7f64aa674640 1 -- 172.21.15.47:0/2928105767 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64a41f3f00 con 0x7f64a40cac90 2024-04-01T22:34:17.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.861+0000 7f64a0ff9640 1 -- 172.21.15.47:0/2928105767 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64980072f0 con 0x7f64a40cac90 2024-04-01T22:34:17.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.861+0000 7f64aa674640 1 -- 172.21.15.47:0/2928105767 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64a41f01a0 con 0x7f64a40cac90 2024-04-01T22:34:17.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.862+0000 7f64aa674640 1 -- 172.21.15.47:0/2928105767 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64a4068210 con 0x7f64a40cac90 2024-04-01T22:34:17.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.882+0000 7f64a0ff9640 1 -- 172.21.15.47:0/2928105767 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f649801a070 con 0x7f64a40cac90 2024-04-01T22:34:17.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.882+0000 7f64a0ff9640 1 --2- 172.21.15.47:0/2928105767 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f649006ba10 0x7f649006ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:17.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.882+0000 7f64a3fff640 1 --2- 172.21.15.47:0/2928105767 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f649006ba10 0x7f649006ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:17.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:17.883+0000 7f64a3fff640 1 --2- 172.21.15.47:0/2928105767 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f649006ba10 0x7f649006ded0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6494036000 tx=0x7f649403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:18.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.140+0000 7f64a0ff9640 1 -- 172.21.15.47:0/2928105767 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f6498056660 con 0x7f64a40cac90 2024-04-01T22:34:18.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.141+0000 7f64a0ff9640 1 -- 172.21.15.47:0/2928105767 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f6498021020 con 0x7f64a40cac90 2024-04-01T22:34:18.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.324+0000 7f64aa674640 1 -- 172.21.15.47:0/2928105767 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f64a40c9370 con 0x7f64a40cac90 2024-04-01T22:34:18.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.330+0000 7f64a0ff9640 1 -- 172.21.15.47:0/2928105767 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f64980585c0 con 0x7f64a40cac90 2024-04-01T22:34:18.330 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-01T22:34:18.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.333+0000 7f64aa674640 1 -- 172.21.15.47:0/2928105767 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f649006ba10 msgr2=0x7f649006ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:18.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.333+0000 7f64aa674640 1 --2- 172.21.15.47:0/2928105767 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f649006ba10 0x7f649006ded0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6494036000 tx=0x7f649403c040 comp rx=0 tx=0).stop 2024-04-01T22:34:18.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.333+0000 7f64aa674640 1 -- 172.21.15.47:0/2928105767 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64a40cac90 msgr2=0x7f64a414fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:18.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.333+0000 7f64aa674640 1 --2- 172.21.15.47:0/2928105767 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64a40cac90 0x7f64a414fb10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f649800c400 tx=0x7f649800c8c0 comp rx=0 tx=0).stop 2024-04-01T22:34:18.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.333+0000 7f64aa674640 1 -- 172.21.15.47:0/2928105767 shutdown_connections 2024-04-01T22:34:18.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.333+0000 7f64aa674640 1 --2- 172.21.15.47:0/2928105767 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f649006ba10 0x7f649006ded0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:18.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.333+0000 7f64aa674640 1 --2- 172.21.15.47:0/2928105767 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f64a4152210 0x7f64a40b0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:18.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.333+0000 7f64aa674640 1 --2- 172.21.15.47:0/2928105767 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64a40cac90 0x7f64a414fb10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:18.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.333+0000 7f64aa674640 1 --2- 172.21.15.47:0/2928105767 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f64a40c8ce0 0x7f64a406c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:18.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.333+0000 7f64aa674640 1 -- 172.21.15.47:0/2928105767 >> 172.21.15.47:0/2928105767 conn(0x7f64a4071310 msgr2=0x7f64a40ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:18.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.333+0000 7f64aa674640 1 -- 172.21.15.47:0/2928105767 shutdown_connections 2024-04-01T22:34:18.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.333+0000 7f64aa674640 1 -- 172.21.15.47:0/2928105767 wait complete. 2024-04-01T22:34:18.347 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T22:34:18.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.449+0000 7f2fd3365640 1 Processor -- start 2024-04-01T22:34:18.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.449+0000 7f2fd3365640 1 -- start start 2024-04-01T22:34:18.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.450+0000 7f2fd3365640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2fcc15aec0 0x7f2fcc06c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:18.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.450+0000 7f2fd3365640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fcc154b70 con 0x7f2fcc15bb20 2024-04-01T22:34:18.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.450+0000 7f2fd3365640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fcc0cdac0 con 0x7f2fcc06c250 2024-04-01T22:34:18.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.450+0000 7f2fd3365640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f2fcc0ce990 con 0x7f2fcc15aec0 2024-04-01T22:34:18.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.451+0000 7f2fd0900640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2fcc15aec0 0x7f2fcc06c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:18.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.451+0000 7f2fd1101640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f2fcc06c250 0x7f2fcc0ceb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.47:40392/0 (socket says 172.21.15.47:40392) 2024-04-01T22:34:18.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.451+0000 7f2fd1101640 1 -- 172.21.15.47:0/2392225207 learned_addr learned my addr 172.21.15.47:0/2392225207 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T22:34:18.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.453+0000 7f2fbffff640 1 -- 172.21.15.47:0/2392225207 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3424503570 0 0) 0x7f2fcc0cdac0 con 0x7f2fcc06c250 2024-04-01T22:34:18.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.453+0000 7f2fbffff640 1 -- 172.21.15.47:0/2392225207 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fb8003520 con 0x7f2fcc06c250 2024-04-01T22:34:18.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.454+0000 7f2fd0900640 1 -- 172.21.15.47:0/2392225207 >> v1:172.21.15.181:6789/0 conn(0x7f2fcc06c250 legacy=0x7f2fcc0ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:18.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.454+0000 7f2fd0900640 1 -- 172.21.15.47:0/2392225207 >> v1:172.21.15.47:6789/0 conn(0x7f2fcc15bb20 legacy=0x7f2fcc15bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:18.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.454+0000 7f2fd0900640 1 -- 172.21.15.47:0/2392225207 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fcc0cf2a0 con 0x7f2fcc15aec0 2024-04-01T22:34:18.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.459+0000 7f2fd0900640 1 --2- 172.21.15.47:0/2392225207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2fcc15aec0 0x7f2fcc06c630 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2fc80097a0 tx=0x7f2fc802b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8426befc86f0bd96 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:18.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.462+0000 7f2fbffff640 1 -- 172.21.15.47:0/2392225207 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc802f810 con 0x7f2fcc15aec0 2024-04-01T22:34:18.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.462+0000 7f2fbffff640 1 -- 172.21.15.47:0/2392225207 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fc802f9b0 con 0x7f2fcc15aec0 2024-04-01T22:34:18.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.462+0000 7f2fbffff640 1 -- 172.21.15.47:0/2392225207 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc802fd80 con 0x7f2fcc15aec0 2024-04-01T22:34:18.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.463+0000 7f2fd3365640 1 -- 172.21.15.47:0/2392225207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2fcc15aec0 msgr2=0x7f2fcc06c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:18.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.463+0000 7f2fd3365640 1 --2- 172.21.15.47:0/2392225207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2fcc15aec0 0x7f2fcc06c630 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2fc80097a0 tx=0x7f2fc802b9f0 comp rx=0 tx=0).stop 2024-04-01T22:34:18.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.463+0000 7f2fd3365640 1 -- 172.21.15.47:0/2392225207 shutdown_connections 2024-04-01T22:34:18.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.463+0000 7f2fd3365640 1 --2- 172.21.15.47:0/2392225207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2fcc15aec0 0x7f2fcc06c630 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:18.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.463+0000 7f2fd3365640 1 -- 172.21.15.47:0/2392225207 >> 172.21.15.47:0/2392225207 conn(0x7f2fcc0cfdb0 msgr2=0x7f2fcc0d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:18.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.463+0000 7f2fd3365640 1 -- 172.21.15.47:0/2392225207 shutdown_connections 2024-04-01T22:34:18.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.463+0000 7f2fd3365640 1 -- 172.21.15.47:0/2392225207 wait complete. 2024-04-01T22:34:18.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.464+0000 7f2fd3365640 1 Processor -- start 2024-04-01T22:34:18.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.464+0000 7f2fd3365640 1 -- start start 2024-04-01T22:34:18.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.465+0000 7f2fd3365640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2fcc06c250 0x7f2fcc14f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:18.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.465+0000 7f2fd3365640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2fcc15aec0 0x7f2fcc1f1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:18.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.465+0000 7f2fd3365640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2fcc15bb20 0x7f2fcc1f1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:18.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.465+0000 7f2fd3365640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2fcc0ce340 con 0x7f2fcc15bb20 2024-04-01T22:34:18.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.465+0000 7f2fd3365640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2fcc0ce060 con 0x7f2fcc06c250 2024-04-01T22:34:18.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.465+0000 7f2fd3365640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f2fcc0ce620 con 0x7f2fcc15aec0 2024-04-01T22:34:18.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.466+0000 7f2fd1902640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2fcc15bb20 0x7f2fcc1f1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:18.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.466+0000 7f2fd0900640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2fcc15aec0 0x7f2fcc1f1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:18.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.466+0000 7f2fd1902640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2fcc15bb20 0x7f2fcc1f1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34916/0 (socket says 172.21.15.47:34916) 2024-04-01T22:34:18.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.466+0000 7f2fd1902640 1 -- 172.21.15.47:0/735305576 learned_addr learned my addr 172.21.15.47:0/735305576 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:18.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.466+0000 7f2fd1101640 1 --2- 172.21.15.47:0/735305576 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2fcc06c250 0x7f2fcc14f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:18.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.469+0000 7f2fd1902640 1 -- 172.21.15.47:0/735305576 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2fcc15aec0 msgr2=0x7f2fcc1f1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:18.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.469+0000 7f2fd1902640 1 --2- 172.21.15.47:0/735305576 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2fcc15aec0 0x7f2fcc1f1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:18.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.469+0000 7f2fd1902640 1 -- 172.21.15.47:0/735305576 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2fcc06c250 msgr2=0x7f2fcc14f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:18.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.469+0000 7f2fd1902640 1 --2- 172.21.15.47:0/735305576 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2fcc06c250 0x7f2fcc14f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:18.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.469+0000 7f2fd1902640 1 -- 172.21.15.47:0/735305576 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fcc0b27c0 con 0x7f2fcc15bb20 2024-04-01T22:34:18.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.471+0000 7f2fd1902640 1 --2- 172.21.15.47:0/735305576 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2fcc15bb20 0x7f2fcc1f1d80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2fc400c6e0 tx=0x7f2fc400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:18.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.475+0000 7f2fbdffb640 1 -- 172.21.15.47:0/735305576 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc4003b70 con 0x7f2fcc15bb20 2024-04-01T22:34:18.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.475+0000 7f2fbdffb640 1 -- 172.21.15.47:0/735305576 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fc4003d30 con 0x7f2fcc15bb20 2024-04-01T22:34:18.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.475+0000 7f2fbdffb640 1 -- 172.21.15.47:0/735305576 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc4005310 con 0x7f2fcc15bb20 2024-04-01T22:34:18.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.475+0000 7f2fd3365640 1 -- 172.21.15.47:0/735305576 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fcc0b2a80 con 0x7f2fcc15bb20 2024-04-01T22:34:18.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.475+0000 7f2fd3365640 1 -- 172.21.15.47:0/735305576 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fcc0b3d80 con 0x7f2fcc15bb20 2024-04-01T22:34:18.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.476+0000 7f2fd3365640 1 -- 172.21.15.47:0/735305576 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fcc0b2fa0 con 0x7f2fcc15bb20 2024-04-01T22:34:18.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.496+0000 7f2fbdffb640 1 -- 172.21.15.47:0/735305576 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f2fc40054b0 con 0x7f2fcc15bb20 2024-04-01T22:34:18.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.496+0000 7f2fbdffb640 1 --2- 172.21.15.47:0/735305576 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f2fb006ba10 0x7f2fb006ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:18.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.497+0000 7f2fd1101640 1 --2- 172.21.15.47:0/735305576 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f2fb006ba10 0x7f2fb006ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:18.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.497+0000 7f2fd1101640 1 --2- 172.21.15.47:0/735305576 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f2fb006ba10 0x7f2fb006ded0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2fc00011e0 tx=0x7f2fc0007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:18.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.499+0000 7f2fbdffb640 1 -- 172.21.15.47:0/735305576 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f2fc40057a0 con 0x7f2fcc15bb20 2024-04-01T22:34:18.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.757+0000 7f2fbdffb640 1 -- 172.21.15.47:0/735305576 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f2fcc0b2fa0 con 0x7f2fcc15bb20 2024-04-01T22:34:18.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.982+0000 7f2fd3365640 1 -- 172.21.15.47:0/735305576 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2fcc0ca220 con 0x7f2fcc15bb20 2024-04-01T22:34:18.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.995+0000 7f2fbdffb640 1 -- 172.21.15.47:0/735305576 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6835 (secure 0 0 0) 0x7f2fcc0ca220 con 0x7f2fcc15bb20 2024-04-01T22:34:18.995 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:34:18.995 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4222,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/1297694239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1297694239},{"type":"v1","addr":"172.21.15.181:6835","nonce":1297694239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4225,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/2435310452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":2435310452},{"type":"v1","addr":"172.21.15.181:6837","nonce":2435310452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4228,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1974242436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1974242436},{"type":"v1","addr":"172.21.15.47:6839","nonce":1974242436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/4251771217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":4251771217},{"type":"v1","addr":"172.21.15.47:6837","nonce":4251771217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/1534194215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1534194215},{"type":"v1","addr":"172.21.15.181:6833","nonce":1534194215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-01T22:33:27.610692+0000","modified":"2024-04-01T22:34:00.874320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.47:6835/1610100855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":1610100855},{"type":"v1","addr":"172.21.15.47:6835","nonce":1610100855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4254,"qdb_cluster":[4254]},"id":1}]} 2024-04-01T22:34:18.995 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 9 2024-04-01T22:34:18.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.998+0000 7f2fd3365640 1 -- 172.21.15.47:0/735305576 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f2fb006ba10 msgr2=0x7f2fb006ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:18.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.998+0000 7f2fd3365640 1 --2- 172.21.15.47:0/735305576 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f2fb006ba10 0x7f2fb006ded0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2fc00011e0 tx=0x7f2fc0007d30 comp rx=0 tx=0).stop 2024-04-01T22:34:18.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.998+0000 7f2fd3365640 1 -- 172.21.15.47:0/735305576 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2fcc15bb20 msgr2=0x7f2fcc1f1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:18.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.998+0000 7f2fd3365640 1 --2- 172.21.15.47:0/735305576 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2fcc15bb20 0x7f2fcc1f1d80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2fc400c6e0 tx=0x7f2fc400cba0 comp rx=0 tx=0).stop 2024-04-01T22:34:18.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.998+0000 7f2fd3365640 1 -- 172.21.15.47:0/735305576 shutdown_connections 2024-04-01T22:34:18.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.998+0000 7f2fd3365640 1 --2- 172.21.15.47:0/735305576 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f2fb006ba10 0x7f2fb006ded0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:18.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.998+0000 7f2fd3365640 1 --2- 172.21.15.47:0/735305576 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2fcc15bb20 0x7f2fcc1f1d80 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:18.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.998+0000 7f2fd3365640 1 --2- 172.21.15.47:0/735305576 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2fcc15aec0 0x7f2fcc1f1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:18.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.998+0000 7f2fd3365640 1 --2- 172.21.15.47:0/735305576 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2fcc06c250 0x7f2fcc14f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:18.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.998+0000 7f2fd3365640 1 -- 172.21.15.47:0/735305576 >> 172.21.15.47:0/735305576 conn(0x7f2fcc0cfdb0 msgr2=0x7f2fcc158cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:18.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.998+0000 7f2fd3365640 1 -- 172.21.15.47:0/735305576 shutdown_connections 2024-04-01T22:34:18.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:18.998+0000 7f2fd3365640 1 -- 172.21.15.47:0/735305576 wait complete. 2024-04-01T22:34:19.009 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T22:34:19.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.112+0000 7fca93e55640 1 Processor -- start 2024-04-01T22:34:19.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.112+0000 7fca93e55640 1 -- start start 2024-04-01T22:34:19.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.112+0000 7fca93e55640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fca8c06c250 0x7fca8c15aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:19.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.113+0000 7fca93e55640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca8c154b70 con 0x7fca8c06c630 2024-04-01T22:34:19.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.113+0000 7fca93e55640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca8c0cdac0 con 0x7fca8c15bb20 2024-04-01T22:34:19.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.113+0000 7fca93e55640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fca8c0ce990 con 0x7fca8c06c250 2024-04-01T22:34:19.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.113+0000 7fca91bf1640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fca8c06c250 0x7fca8c15aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:19.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.113+0000 7fca913f0640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fca8c06c630 0x7fca8c0ceb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:51806/0 (socket says 172.21.15.47:51806) 2024-04-01T22:34:19.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.113+0000 7fca913f0640 1 -- 172.21.15.47:0/2140241716 learned_addr learned my addr 172.21.15.47:0/2140241716 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T22:34:19.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.116+0000 7fca90bef640 1 -- 172.21.15.47:0/2140241716 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1869436172 0 0) 0x7fca8c154b70 con 0x7fca8c06c630 2024-04-01T22:34:19.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.116+0000 7fca90bef640 1 -- 172.21.15.47:0/2140241716 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca78003520 con 0x7fca8c06c630 2024-04-01T22:34:19.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.118+0000 7fca91bf1640 1 -- 172.21.15.47:0/2140241716 >> v1:172.21.15.181:6789/0 conn(0x7fca8c15bb20 legacy=0x7fca8c15bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:19.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.118+0000 7fca91bf1640 1 -- 172.21.15.47:0/2140241716 >> v1:172.21.15.47:6789/0 conn(0x7fca8c06c630 legacy=0x7fca8c0ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:19.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.118+0000 7fca91bf1640 1 -- 172.21.15.47:0/2140241716 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca8c0cf2a0 con 0x7fca8c06c250 2024-04-01T22:34:19.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.122+0000 7fca91bf1640 1 --2- 172.21.15.47:0/2140241716 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fca8c06c250 0x7fca8c15aec0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fca880097a0 tx=0x7fca8802b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e49f124d7c5caf8c server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:19.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.128+0000 7fca90bef640 1 -- 172.21.15.47:0/2140241716 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8802f810 con 0x7fca8c06c250 2024-04-01T22:34:19.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.128+0000 7fca90bef640 1 -- 172.21.15.47:0/2140241716 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca8802f9b0 con 0x7fca8c06c250 2024-04-01T22:34:19.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.128+0000 7fca90bef640 1 -- 172.21.15.47:0/2140241716 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8802fd80 con 0x7fca8c06c250 2024-04-01T22:34:19.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.129+0000 7fca93e55640 1 -- 172.21.15.47:0/2140241716 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fca8c06c250 msgr2=0x7fca8c15aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:19.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.129+0000 7fca93e55640 1 --2- 172.21.15.47:0/2140241716 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fca8c06c250 0x7fca8c15aec0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fca880097a0 tx=0x7fca8802b9f0 comp rx=0 tx=0).stop 2024-04-01T22:34:19.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.129+0000 7fca93e55640 1 -- 172.21.15.47:0/2140241716 shutdown_connections 2024-04-01T22:34:19.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.129+0000 7fca93e55640 1 --2- 172.21.15.47:0/2140241716 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fca8c06c250 0x7fca8c15aec0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:19.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.129+0000 7fca93e55640 1 -- 172.21.15.47:0/2140241716 >> 172.21.15.47:0/2140241716 conn(0x7fca8c0cfdb0 msgr2=0x7fca8c0d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:19.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.129+0000 7fca93e55640 1 -- 172.21.15.47:0/2140241716 shutdown_connections 2024-04-01T22:34:19.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.129+0000 7fca93e55640 1 -- 172.21.15.47:0/2140241716 wait complete. 2024-04-01T22:34:19.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.130+0000 7fca93e55640 1 Processor -- start 2024-04-01T22:34:19.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.130+0000 7fca93e55640 1 -- start start 2024-04-01T22:34:19.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.131+0000 7fca93e55640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fca8c06c250 0x7fca8c1522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:19.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.131+0000 7fca93e55640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca8c06c630 0x7fca8c0b29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:19.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.131+0000 7fca93e55640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fca8c15bb20 0x7fca8c0b2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:19.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.131+0000 7fca93e55640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fca8c0ce340 con 0x7fca8c06c630 2024-04-01T22:34:19.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.131+0000 7fca93e55640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fca8c0ce060 con 0x7fca8c06c250 2024-04-01T22:34:19.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.131+0000 7fca93e55640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fca8c0ce620 con 0x7fca8c15bb20 2024-04-01T22:34:19.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.131+0000 7fca913f0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca8c06c630 0x7fca8c0b29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:19.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.131+0000 7fca91bf1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fca8c06c250 0x7fca8c1522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:19.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.131+0000 7fca923f2640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fca8c15bb20 0x7fca8c0b2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:19.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.131+0000 7fca913f0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca8c06c630 0x7fca8c0b29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34920/0 (socket says 172.21.15.47:34920) 2024-04-01T22:34:19.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.131+0000 7fca913f0640 1 -- 172.21.15.47:0/1894553369 learned_addr learned my addr 172.21.15.47:0/1894553369 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:19.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.135+0000 7fca913f0640 1 -- 172.21.15.47:0/1894553369 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fca8c15bb20 msgr2=0x7fca8c0b2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:19.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.135+0000 7fca913f0640 1 --2- 172.21.15.47:0/1894553369 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fca8c15bb20 0x7fca8c0b2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:19.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.135+0000 7fca913f0640 1 -- 172.21.15.47:0/1894553369 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fca8c06c250 msgr2=0x7fca8c1522a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:19.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.135+0000 7fca913f0640 1 --2- 172.21.15.47:0/1894553369 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fca8c06c250 0x7fca8c1522a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:19.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.135+0000 7fca913f0640 1 -- 172.21.15.47:0/1894553369 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca8c0b3610 con 0x7fca8c06c630 2024-04-01T22:34:19.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.137+0000 7fca913f0640 1 --2- 172.21.15.47:0/1894553369 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca8c06c630 0x7fca8c0b29d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fca7c00c460 tx=0x7fca7c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:19.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.141+0000 7fca827fc640 1 -- 172.21.15.47:0/1894553369 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca7c017070 con 0x7fca8c06c630 2024-04-01T22:34:19.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.141+0000 7fca827fc640 1 -- 172.21.15.47:0/1894553369 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca7c005ce0 con 0x7fca8c06c630 2024-04-01T22:34:19.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.141+0000 7fca827fc640 1 -- 172.21.15.47:0/1894553369 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca7c007290 con 0x7fca8c06c630 2024-04-01T22:34:19.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.141+0000 7fca93e55640 1 -- 172.21.15.47:0/1894553369 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca8c0b38d0 con 0x7fca8c06c630 2024-04-01T22:34:19.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.141+0000 7fca93e55640 1 -- 172.21.15.47:0/1894553369 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca8c0b3e90 con 0x7fca8c06c630 2024-04-01T22:34:19.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.142+0000 7fca93e55640 1 -- 172.21.15.47:0/1894553369 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca8c068210 con 0x7fca8c06c630 2024-04-01T22:34:19.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.161+0000 7fca827fc640 1 -- 172.21.15.47:0/1894553369 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7fca7c01a070 con 0x7fca8c06c630 2024-04-01T22:34:19.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.161+0000 7fca827fc640 1 --2- 172.21.15.47:0/1894553369 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fca7006b9e0 0x7fca7006dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:19.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.161+0000 7fca91bf1640 1 --2- 172.21.15.47:0/1894553369 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fca7006b9e0 0x7fca7006dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:19.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.162+0000 7fca91bf1640 1 --2- 172.21.15.47:0/1894553369 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fca7006b9e0 0x7fca7006dea0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fca88036000 tx=0x7fca88008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:19.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.164+0000 7fca827fc640 1 -- 172.21.15.47:0/1894553369 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fca7c056630 con 0x7fca8c06c630 2024-04-01T22:34:19.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.427+0000 7fca827fc640 1 -- 172.21.15.47:0/1894553369 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fca7c021020 con 0x7fca8c06c630 2024-04-01T22:34:19.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.614+0000 7fca93e55640 1 -- 172.21.15.47:0/1894553369 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fca8c0af310 con 0x7fca8c06c630 2024-04-01T22:34:19.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.659+0000 7fca827fc640 1 -- 172.21.15.47:0/1894553369 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18914 (secure 0 0 0) 0x7fca7c058590 con 0x7fca8c06c630 2024-04-01T22:34:19.659 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:34:19.659 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":27,"fsid":"a6998a48-38bc-4e42-b0d9-04f2fb5c3c87","created":"2024-04-01T22:32:57.112033+0000","modified":"2024-04-01T22:34:04.850029+0000","last_up_change":"2024-04-01T22:33:11.141073+0000","last_in_change":"2024-04-01T22:33:02.650459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T22:33:13.356568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T22:33:25.309421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T22:33:26.268050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-01T22:33:30.588103+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7bd3f25d-e3a5-4932-b381-53dcbb464dde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6811","nonce":3827395709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6813","nonce":3827395709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6817","nonce":3827395709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6815","nonce":3827395709}]},"public_addr":"172.21.15.47:6811/3827395709","cluster_addr":"172.21.15.47:6813/3827395709","heartbeat_back_addr":"172.21.15.47:6817/3827395709","heartbeat_front_addr":"172.21.15.47:6815/3827395709","state":["exists","up"]},{"osd":1,"uuid":"2aa60ba2-67ff-43c7-96c4-82ae2f3855ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6827","nonce":3152157503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6829","nonce":3152157503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6833","nonce":3152157503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6831","nonce":3152157503}]},"public_addr":"172.21.15.47:6827/3152157503","cluster_addr":"172.21.15.47:6829/3152157503","heartbeat_back_addr":"172.21.15.47:6833/3152157503","heartbeat_front_addr":"172.21.15.47:6831/3152157503","state":["exists","up"]},{"osd":2,"uuid":"d83f8a98-6db8-42b7-9ef6-5b16eb9a3492","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6803","nonce":1003968856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6805","nonce":1003968856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6809","nonce":1003968856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6807","nonce":1003968856}]},"public_addr":"172.21.15.47:6803/1003968856","cluster_addr":"172.21.15.47:6805/1003968856","heartbeat_back_addr":"172.21.15.47:6809/1003968856","heartbeat_front_addr":"172.21.15.47:6807/1003968856","state":["exists","up"]},{"osd":3,"uuid":"edc02ed5-d25c-4dc9-a0c3-7a26f20fae07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6819","nonce":2845699561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6821","nonce":2845699561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6825","nonce":2845699561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6823","nonce":2845699561}]},"public_addr":"172.21.15.47:6819/2845699561","cluster_addr":"172.21.15.47:6821/2845699561","heartbeat_back_addr":"172.21.15.47:6825/2845699561","heartbeat_front_addr":"172.21.15.47:6823/2845699561","state":["exists","up"]},{"osd":4,"uuid":"b3d67e74-f51e-4474-9c62-dd0daa60c728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6809","nonce":2961538461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6811","nonce":2961538461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6815","nonce":2961538461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6813","nonce":2961538461}]},"public_addr":"172.21.15.181:6809/2961538461","cluster_addr":"172.21.15.181:6811/2961538461","heartbeat_back_addr":"172.21.15.181:6815/2961538461","heartbeat_front_addr":"172.21.15.181:6813/2961538461","state":["exists","up"]},{"osd":5,"uuid":"d86e8f7a-99f4-4457-9949-cf2cb853e79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6817","nonce":2161566540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6819","nonce":2161566540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6823","nonce":2161566540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6821","nonce":2161566540}]},"public_addr":"172.21.15.181:6817/2161566540","cluster_addr":"172.21.15.181:6819/2161566540","heartbeat_back_addr":"172.21.15.181:6823/2161566540","heartbeat_front_addr":"172.21.15.181:6821/2161566540","state":["exists","up"]},{"osd":6,"uuid":"aa08266c-1719-4abd-afb9-e7e8ac593658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6801","nonce":3792144865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6803","nonce":3792144865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6807","nonce":3792144865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6805","nonce":3792144865}]},"public_addr":"172.21.15.181:6801/3792144865","cluster_addr":"172.21.15.181:6803/3792144865","heartbeat_back_addr":"172.21.15.181:6807/3792144865","heartbeat_front_addr":"172.21.15.181:6805/3792144865","state":["exists","up"]},{"osd":7,"uuid":"6e509762-24c8-46c3-93a1-4c50b11ebcf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6825","nonce":1760995885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6827","nonce":1760995885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6831","nonce":1760995885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6829","nonce":1760995885}]},"public_addr":"172.21.15.181:6825/1760995885","cluster_addr":"172.21.15.181:6827/1760995885","heartbeat_back_addr":"172.21.15.181:6831/1760995885","heartbeat_front_addr":"172.21.15.181:6829/1760995885","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.202426+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.255318+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.170288+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.290065+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.214871+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.176432+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.139940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.299546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.15","mappings":[{"from":7,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T22:34:19.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.662+0000 7fca93e55640 1 -- 172.21.15.47:0/1894553369 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fca7006b9e0 msgr2=0x7fca7006dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:19.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.662+0000 7fca93e55640 1 --2- 172.21.15.47:0/1894553369 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fca7006b9e0 0x7fca7006dea0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fca88036000 tx=0x7fca88008030 comp rx=0 tx=0).stop 2024-04-01T22:34:19.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.662+0000 7fca93e55640 1 -- 172.21.15.47:0/1894553369 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca8c06c630 msgr2=0x7fca8c0b29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:19.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.662+0000 7fca93e55640 1 --2- 172.21.15.47:0/1894553369 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca8c06c630 0x7fca8c0b29d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fca7c00c460 tx=0x7fca7c00c920 comp rx=0 tx=0).stop 2024-04-01T22:34:19.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.662+0000 7fca93e55640 1 -- 172.21.15.47:0/1894553369 shutdown_connections 2024-04-01T22:34:19.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.662+0000 7fca93e55640 1 --2- 172.21.15.47:0/1894553369 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fca7006b9e0 0x7fca7006dea0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:19.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.662+0000 7fca93e55640 1 --2- 172.21.15.47:0/1894553369 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fca8c15bb20 0x7fca8c0b2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:19.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.662+0000 7fca93e55640 1 --2- 172.21.15.47:0/1894553369 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca8c06c630 0x7fca8c0b29d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:19.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.662+0000 7fca93e55640 1 --2- 172.21.15.47:0/1894553369 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fca8c06c250 0x7fca8c1522a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:19.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.662+0000 7fca93e55640 1 -- 172.21.15.47:0/1894553369 >> 172.21.15.47:0/1894553369 conn(0x7fca8c0cfdb0 msgr2=0x7fca8c153f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:19.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.662+0000 7fca93e55640 1 -- 172.21.15.47:0/1894553369 shutdown_connections 2024-04-01T22:34:19.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.662+0000 7fca93e55640 1 -- 172.21.15.47:0/1894553369 wait complete. 2024-04-01T22:34:19.676 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T22:34:19.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.779+0000 7f89cd948640 1 Processor -- start 2024-04-01T22:34:19.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.779+0000 7f89cd948640 1 -- start start 2024-04-01T22:34:19.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.780+0000 7f89cd948640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f89c815a780 0x7f89c815ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:19.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.780+0000 7f89cd948640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89c815b150 con 0x7f89c80c3a60 2024-04-01T22:34:19.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.780+0000 7f89cd948640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89c815a280 con 0x7f89c81544a0 2024-04-01T22:34:19.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.780+0000 7f89cd948640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f89c80ca280 con 0x7f89c815a780 2024-04-01T22:34:19.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.780+0000 7f89c77fe640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f89c80c3a60 0x7f89c80c3e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:51518/0 (socket says 172.21.15.47:51518) 2024-04-01T22:34:19.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.780+0000 7f89c77fe640 1 -- 172.21.15.47:0/2933279318 learned_addr learned my addr 172.21.15.47:0/2933279318 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T22:34:19.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.780+0000 7f89c67fc640 1 --2- 172.21.15.47:0/2933279318 >> v2:172.21.15.181:3300/0 conn(0x7f89c815a780 0x7f89c815ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:19.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.782+0000 7f89c5ffb640 1 -- 172.21.15.47:0/2933279318 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 780314604 0 0) 0x7f89c815b150 con 0x7f89c80c3a60 2024-04-01T22:34:19.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.782+0000 7f89c5ffb640 1 -- 172.21.15.47:0/2933279318 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89b0003520 con 0x7f89c80c3a60 2024-04-01T22:34:19.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.784+0000 7f89c67fc640 1 -- 172.21.15.47:0/2933279318 >> v1:172.21.15.181:6789/0 conn(0x7f89c81544a0 legacy=0x7f89c80c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:19.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.784+0000 7f89c67fc640 1 -- 172.21.15.47:0/2933279318 >> v1:172.21.15.47:6789/0 conn(0x7f89c80c3a60 legacy=0x7f89c80c3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:19.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.784+0000 7f89c67fc640 1 -- 172.21.15.47:0/2933279318 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89c80ca560 con 0x7f89c815a780 2024-04-01T22:34:19.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.788+0000 7f89c67fc640 1 --2- 172.21.15.47:0/2933279318 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89c815a780 0x7f89c815ac10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f89b80097a0 tx=0x7f89b802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=114a6fd496be6450 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:19.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.794+0000 7f89c5ffb640 1 -- 172.21.15.47:0/2933279318 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b8034070 con 0x7f89c815a780 2024-04-01T22:34:19.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.794+0000 7f89c5ffb640 1 -- 172.21.15.47:0/2933279318 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89b8030610 con 0x7f89c815a780 2024-04-01T22:34:19.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.794+0000 7f89c5ffb640 1 -- 172.21.15.47:0/2933279318 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b80309e0 con 0x7f89c815a780 2024-04-01T22:34:19.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.795+0000 7f89cd948640 1 -- 172.21.15.47:0/2933279318 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89c815a780 msgr2=0x7f89c815ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:19.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.795+0000 7f89cd948640 1 --2- 172.21.15.47:0/2933279318 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89c815a780 0x7f89c815ac10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f89b80097a0 tx=0x7f89b802b960 comp rx=0 tx=0).stop 2024-04-01T22:34:19.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.795+0000 7f89cd948640 1 -- 172.21.15.47:0/2933279318 shutdown_connections 2024-04-01T22:34:19.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.795+0000 7f89cd948640 1 --2- 172.21.15.47:0/2933279318 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89c815a780 0x7f89c815ac10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:19.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.795+0000 7f89cd948640 1 -- 172.21.15.47:0/2933279318 >> 172.21.15.47:0/2933279318 conn(0x7f89c80715a0 msgr2=0x7f89c80719b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:19.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.795+0000 7f89cd948640 1 -- 172.21.15.47:0/2933279318 shutdown_connections 2024-04-01T22:34:19.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.795+0000 7f89cd948640 1 -- 172.21.15.47:0/2933279318 wait complete. 2024-04-01T22:34:19.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.796+0000 7f89cd948640 1 Processor -- start 2024-04-01T22:34:19.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.796+0000 7f89cd948640 1 -- start start 2024-04-01T22:34:19.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.797+0000 7f89cd948640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f89c80c3a60 0x7f89c80c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:19.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.797+0000 7f89cd948640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89c81544a0 0x7f89c81efe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:19.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.797+0000 7f89cd948640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89c815a780 0x7f89c81f0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:19.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.797+0000 7f89cd948640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f89c80cae00 con 0x7f89c81544a0 2024-04-01T22:34:19.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.797+0000 7f89cd948640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f89c80cab20 con 0x7f89c815a780 2024-04-01T22:34:19.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.797+0000 7f89cd948640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f89c80c4ac0 con 0x7f89c80c3a60 2024-04-01T22:34:19.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.797+0000 7f89c67fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89c81544a0 0x7f89c81efe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:19.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.798+0000 7f89c67fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89c81544a0 0x7f89c81efe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42800/0 (socket says 172.21.15.47:42800) 2024-04-01T22:34:19.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.798+0000 7f89c67fc640 1 -- 172.21.15.47:0/2310117252 learned_addr learned my addr 172.21.15.47:0/2310117252 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:19.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.798+0000 7f89c6ffd640 1 --2- 172.21.15.47:0/2310117252 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f89c80c3a60 0x7f89c80c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:19.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.799+0000 7f89c77fe640 1 --2- 172.21.15.47:0/2310117252 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89c815a780 0x7f89c81f0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:19.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.801+0000 7f89c67fc640 1 -- 172.21.15.47:0/2310117252 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f89c80c3a60 msgr2=0x7f89c80c8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:19.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.801+0000 7f89c67fc640 1 --2- 172.21.15.47:0/2310117252 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f89c80c3a60 0x7f89c80c8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:19.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.801+0000 7f89c67fc640 1 -- 172.21.15.47:0/2310117252 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89c815a780 msgr2=0x7f89c81f0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:19.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.801+0000 7f89c67fc640 1 --2- 172.21.15.47:0/2310117252 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89c815a780 0x7f89c81f0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:19.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.801+0000 7f89c67fc640 1 -- 172.21.15.47:0/2310117252 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89c8148460 con 0x7f89c81544a0 2024-04-01T22:34:19.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.804+0000 7f89c67fc640 1 --2- 172.21.15.47:0/2310117252 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89c81544a0 0x7f89c81efe50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f89b802bf70 tx=0x7f89b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:19.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.809+0000 7f89affff640 1 -- 172.21.15.47:0/2310117252 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b8034040 con 0x7f89c81544a0 2024-04-01T22:34:19.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.809+0000 7f89affff640 1 -- 172.21.15.47:0/2310117252 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89b803aaa0 con 0x7f89c81544a0 2024-04-01T22:34:19.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.809+0000 7f89affff640 1 -- 172.21.15.47:0/2310117252 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b80443f0 con 0x7f89c81544a0 2024-04-01T22:34:19.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.809+0000 7f89cd948640 1 -- 172.21.15.47:0/2310117252 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89c8147820 con 0x7f89c81544a0 2024-04-01T22:34:19.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.810+0000 7f89cd948640 1 -- 172.21.15.47:0/2310117252 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89c81489e0 con 0x7f89c81544a0 2024-04-01T22:34:19.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:19.810+0000 7f89cd948640 1 -- 172.21.15.47:0/2310117252 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89c8068210 con 0x7f89c81544a0 2024-04-01T22:34:20.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:20.133+0000 7f89affff640 1 -- 172.21.15.47:0/2310117252 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f89b804b060 con 0x7f89c81544a0 2024-04-01T22:34:20.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:20.133+0000 7f89affff640 1 --2- 172.21.15.47:0/2310117252 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f89b406b9c0 0x7f89b406de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:20.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:20.134+0000 7f89c6ffd640 1 --2- 172.21.15.47:0/2310117252 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f89b406b9c0 0x7f89b406de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:20.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:20.134+0000 7f89c6ffd640 1 --2- 172.21.15.47:0/2310117252 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f89b406b9c0 0x7f89b406de80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f89bc001780 tx=0x7f89bc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:20.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:20.148+0000 7f89affff640 1 -- 172.21.15.47:0/2310117252 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f89b8079060 con 0x7f89c81544a0 2024-04-01T22:34:20.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:20.149+0000 7f89affff640 1 -- 172.21.15.47:0/2310117252 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f89b803f070 con 0x7f89c81544a0 2024-04-01T22:34:20.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:20.372+0000 7f89cd948640 1 -- 172.21.15.47:0/2310117252 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f89c80c93a0 con 0x7f89c81544a0 2024-04-01T22:34:20.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:20.385+0000 7f89affff640 1 -- 172.21.15.47:0/2310117252 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6835 (secure 0 0 0) 0x7f89b807afc0 con 0x7f89c81544a0 2024-04-01T22:34:20.385 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T22:34:20.385 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4222,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/1297694239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1297694239},{"type":"v1","addr":"172.21.15.181:6835","nonce":1297694239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4225,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/2435310452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":2435310452},{"type":"v1","addr":"172.21.15.181:6837","nonce":2435310452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4228,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1974242436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1974242436},{"type":"v1","addr":"172.21.15.47:6839","nonce":1974242436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/4251771217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":4251771217},{"type":"v1","addr":"172.21.15.47:6837","nonce":4251771217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/1534194215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1534194215},{"type":"v1","addr":"172.21.15.181:6833","nonce":1534194215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-01T22:33:27.610692+0000","modified":"2024-04-01T22:34:00.874320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.47:6835/1610100855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":1610100855},{"type":"v1","addr":"172.21.15.47:6835","nonce":1610100855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4254,"qdb_cluster":[4254]},"id":1}]} 2024-04-01T22:34:20.386 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 9 2024-04-01T22:34:20.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:20.388+0000 7f89cd948640 1 -- 172.21.15.47:0/2310117252 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f89b406b9c0 msgr2=0x7f89b406de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:20.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:20.388+0000 7f89cd948640 1 --2- 172.21.15.47:0/2310117252 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f89b406b9c0 0x7f89b406de80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f89bc001780 tx=0x7f89bc009040 comp rx=0 tx=0).stop 2024-04-01T22:34:20.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:20.388+0000 7f89cd948640 1 -- 172.21.15.47:0/2310117252 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89c81544a0 msgr2=0x7f89c81efe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:20.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:20.388+0000 7f89cd948640 1 --2- 172.21.15.47:0/2310117252 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89c81544a0 0x7f89c81efe50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f89b802bf70 tx=0x7f89b80046c0 comp rx=0 tx=0).stop 2024-04-01T22:34:20.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:20.388+0000 7f89cd948640 1 -- 172.21.15.47:0/2310117252 shutdown_connections 2024-04-01T22:34:20.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:20.388+0000 7f89cd948640 1 --2- 172.21.15.47:0/2310117252 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f89b406b9c0 0x7f89b406de80 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:20.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:20.388+0000 7f89cd948640 1 --2- 172.21.15.47:0/2310117252 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89c815a780 0x7f89c81f0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:20.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:20.388+0000 7f89cd948640 1 --2- 172.21.15.47:0/2310117252 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89c81544a0 0x7f89c81efe50 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:20.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:20.388+0000 7f89cd948640 1 --2- 172.21.15.47:0/2310117252 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f89c80c3a60 0x7f89c80c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:20.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:20.388+0000 7f89cd948640 1 -- 172.21.15.47:0/2310117252 >> 172.21.15.47:0/2310117252 conn(0x7f89c80715a0 msgr2=0x7f89c80b3a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:20.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:20.388+0000 7f89cd948640 1 -- 172.21.15.47:0/2310117252 shutdown_connections 2024-04-01T22:34:20.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:20.388+0000 7f89cd948640 1 -- 172.21.15.47:0/2310117252 wait complete. 2024-04-01T22:34:21.002 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-01T22:33:27.610692+0000', 'modified': '2024-04-01T22:34:00.874320+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4254}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4254': {'gid': 4254, 'name': 'e', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.47:6835/1610100855', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6834', 'nonce': 1610100855}, {'type': 'v1', 'addr': '172.21.15.47:6835', 'nonce': 1610100855}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4254, 'qdb_cluster': [4254]} 2024-04-01T22:34:21.002 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-01T22:34:21.003 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-04-01T22:34:21.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.106+0000 7f786b49d640 1 Processor -- start 2024-04-01T22:34:21.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.106+0000 7f786b49d640 1 -- start start 2024-04-01T22:34:21.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.107+0000 7f786b49d640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f78640c93f0 0x7f78640cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:21.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.107+0000 7f786b49d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f78640cc0d0 0x7f78640cc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:21.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.107+0000 7f786b49d640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78640ccaa0 con 0x7f786415afc0 2024-04-01T22:34:21.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.107+0000 7f786b49d640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f78640cdae0 con 0x7f78640cc0d0 2024-04-01T22:34:21.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.107+0000 7f786b49d640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f78640c97d0 con 0x7f78640c93f0 2024-04-01T22:34:21.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.108+0000 7f7869a3a640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f78640cc0d0 0x7f78640cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:21.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.108+0000 7f7869239640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f78640c93f0 0x7f78640cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:21.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.108+0000 7f7869a3a640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f78640cc0d0 0x7f78640cc560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:37284/0 (socket says 172.21.15.47:37284) 2024-04-01T22:34:21.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.108+0000 7f7869a3a640 1 -- 172.21.15.47:0/2949772872 learned_addr learned my addr 172.21.15.47:0/2949772872 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:21.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.111+0000 7f7869239640 1 -- 172.21.15.47:0/2949772872 >> v2:172.21.15.181:3300/0 conn(0x7f78640cc0d0 msgr2=0x7f78640cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:21.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.111+0000 7f7869239640 1 --2- 172.21.15.47:0/2949772872 >> v2:172.21.15.181:3300/0 conn(0x7f78640cc0d0 0x7f78640cc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:21.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.111+0000 7f7869239640 1 -- 172.21.15.47:0/2949772872 >> v1:172.21.15.181:6789/0 conn(0x7f786415afc0 legacy=0x7f786406c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:21.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.111+0000 7f7869239640 1 -- 172.21.15.47:0/2949772872 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78640cdd80 con 0x7f78640c93f0 2024-04-01T22:34:21.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.114+0000 7f7869239640 1 --2- 172.21.15.47:0/2949772872 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f78640c93f0 0x7f78640cee30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f78600097a0 tx=0x7f786002b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34c4eb61855fa81c server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:21.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.118+0000 7f785bfff640 1 -- 172.21.15.47:0/2949772872 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7860038070 con 0x7f78640c93f0 2024-04-01T22:34:21.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.118+0000 7f785bfff640 1 -- 172.21.15.47:0/2949772872 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7860031700 con 0x7f78640c93f0 2024-04-01T22:34:21.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.118+0000 7f785bfff640 1 -- 172.21.15.47:0/2949772872 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7860031ad0 con 0x7f78640c93f0 2024-04-01T22:34:21.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.118+0000 7f786b49d640 1 -- 172.21.15.47:0/2949772872 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f78640c93f0 msgr2=0x7f78640cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:21.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.118+0000 7f786b49d640 1 --2- 172.21.15.47:0/2949772872 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f78640c93f0 0x7f78640cee30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f78600097a0 tx=0x7f786002b7a0 comp rx=0 tx=0).stop 2024-04-01T22:34:21.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.118+0000 7f786b49d640 1 -- 172.21.15.47:0/2949772872 shutdown_connections 2024-04-01T22:34:21.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.118+0000 7f786b49d640 1 --2- 172.21.15.47:0/2949772872 >> v2:172.21.15.181:3300/0 conn(0x7f78640cc0d0 0x7f78640cc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:21.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.118+0000 7f786b49d640 1 --2- 172.21.15.47:0/2949772872 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f78640c93f0 0x7f78640cee30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:21.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.118+0000 7f786b49d640 1 -- 172.21.15.47:0/2949772872 >> 172.21.15.47:0/2949772872 conn(0x7f78640cfdb0 msgr2=0x7f78640d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:21.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.119+0000 7f786b49d640 1 -- 172.21.15.47:0/2949772872 shutdown_connections 2024-04-01T22:34:21.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.119+0000 7f786b49d640 1 -- 172.21.15.47:0/2949772872 wait complete. 2024-04-01T22:34:21.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.120+0000 7f786b49d640 1 Processor -- start 2024-04-01T22:34:21.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.120+0000 7f786b49d640 1 -- start start 2024-04-01T22:34:21.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.120+0000 7f786b49d640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f78640c93f0 0x7f78640c3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:21.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.120+0000 7f786b49d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78640cc0d0 0x7f7864154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:21.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.120+0000 7f786b49d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f786415afc0 0x7f78641e2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:21.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.120+0000 7f786b49d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f78640ce620 con 0x7f78640cc0d0 2024-04-01T22:34:21.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.120+0000 7f786b49d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f78640ce340 con 0x7f786415afc0 2024-04-01T22:34:21.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.121+0000 7f786b49d640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f786415b400 con 0x7f78640c93f0 2024-04-01T22:34:21.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.121+0000 7f7868a38640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78640cc0d0 0x7f7864154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:21.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.121+0000 7f7869a3a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f786415afc0 0x7f78641e2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:21.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.121+0000 7f7869239640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f78640c93f0 0x7f78640c3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:21.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.121+0000 7f7868a38640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78640cc0d0 0x7f7864154250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42816/0 (socket says 172.21.15.47:42816) 2024-04-01T22:34:21.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.121+0000 7f7868a38640 1 -- 172.21.15.47:0/2705922499 learned_addr learned my addr 172.21.15.47:0/2705922499 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:21.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.125+0000 7f7868a38640 1 -- 172.21.15.47:0/2705922499 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f78640c93f0 msgr2=0x7f78640c3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:21.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.125+0000 7f7868a38640 1 --2- 172.21.15.47:0/2705922499 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f78640c93f0 0x7f78640c3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:21.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.125+0000 7f7868a38640 1 -- 172.21.15.47:0/2705922499 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f786415afc0 msgr2=0x7f78641e2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:21.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.125+0000 7f7868a38640 1 --2- 172.21.15.47:0/2705922499 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f786415afc0 0x7f78641e2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:21.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.125+0000 7f7868a38640 1 -- 172.21.15.47:0/2705922499 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78640b19a0 con 0x7f78640cc0d0 2024-04-01T22:34:21.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.127+0000 7f7868a38640 1 --2- 172.21.15.47:0/2705922499 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78640cc0d0 0x7f7864154250 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f785400b3f0 tx=0x7f785400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:21.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.131+0000 7f7859ffb640 1 -- 172.21.15.47:0/2705922499 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7854015020 con 0x7f78640cc0d0 2024-04-01T22:34:21.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.131+0000 7f7859ffb640 1 -- 172.21.15.47:0/2705922499 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7854011830 con 0x7f78640cc0d0 2024-04-01T22:34:21.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.131+0000 7f7859ffb640 1 -- 172.21.15.47:0/2705922499 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7854011c20 con 0x7f78640cc0d0 2024-04-01T22:34:21.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.131+0000 7f786b49d640 1 -- 172.21.15.47:0/2705922499 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78640b00b0 con 0x7f78640cc0d0 2024-04-01T22:34:21.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.131+0000 7f786b49d640 1 -- 172.21.15.47:0/2705922499 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78640b0650 con 0x7f78640cc0d0 2024-04-01T22:34:21.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.134+0000 7f786e084740 1 Processor -- start 2024-04-01T22:34:21.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.134+0000 7f786e084740 1 -- start start 2024-04-01T22:34:21.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.134+0000 7f786e084740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55748655da40 0x55748655e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:21.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.134+0000 7f786e084740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55748651aa00 0x557486566a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:21.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.134+0000 7f786e084740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55748655de20 0x557486566f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:21.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.134+0000 7f786e084740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557486480af0 con 0x55748651aa00 2024-04-01T22:34:21.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.134+0000 7f786e084740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5574864299d0 con 0x55748655da40 2024-04-01T22:34:21.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.134+0000 7f786e084740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55748647cb90 con 0x55748655de20 2024-04-01T22:34:21.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.135+0000 7f7868a38640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55748655de20 0x557486566f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:21.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.135+0000 7f7869a3a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55748655da40 0x55748655e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:21.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.136+0000 7f7868a38640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55748655de20 0x557486566f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:39476/0 (socket says 172.21.15.47:39476) 2024-04-01T22:34:21.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.136+0000 7f7868a38640 1 -- 172.21.15.47:0/1009181373 learned_addr learned my addr 172.21.15.47:0/1009181373 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:21.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.136+0000 7f7869a3a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55748655da40 0x55748655e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:37292/0 (socket says 172.21.15.47:37292) 2024-04-01T22:34:21.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.139+0000 7f7868a38640 1 -- 172.21.15.47:0/1009181373 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55748655da40 msgr2=0x55748655e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:21.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.139+0000 7f7868a38640 1 --2- 172.21.15.47:0/1009181373 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55748655da40 0x55748655e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:21.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.139+0000 7f7868a38640 1 -- 172.21.15.47:0/1009181373 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55748651aa00 msgr2=0x557486566a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:21.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.139+0000 7f7868a38640 1 --2- 172.21.15.47:0/1009181373 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55748651aa00 0x557486566a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:21.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.139+0000 7f7868a38640 1 -- 172.21.15.47:0/1009181373 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574861952d0 con 0x55748655de20 2024-04-01T22:34:21.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.141+0000 7f7868a38640 1 --2- 172.21.15.47:0/1009181373 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55748655de20 0x557486566f40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7854024660 tx=0x7f7854010000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32e1fd695a00f47d server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:21.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.145+0000 7f7846ffd640 1 -- 172.21.15.47:0/1009181373 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7854032070 con 0x55748655de20 2024-04-01T22:34:21.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.145+0000 7f7846ffd640 1 -- 172.21.15.47:0/1009181373 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7854024240 con 0x55748655de20 2024-04-01T22:34:21.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.146+0000 7f7846ffd640 1 -- 172.21.15.47:0/1009181373 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f785401a800 con 0x55748655de20 2024-04-01T22:34:21.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.146+0000 7f786e084740 1 -- 172.21.15.47:0/1009181373 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55748655de20 msgr2=0x557486566f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:21.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.146+0000 7f786e084740 1 --2- 172.21.15.47:0/1009181373 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55748655de20 0x557486566f40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7854024660 tx=0x7f7854010000 comp rx=0 tx=0).stop 2024-04-01T22:34:21.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.146+0000 7f786e084740 1 -- 172.21.15.47:0/1009181373 shutdown_connections 2024-04-01T22:34:21.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.146+0000 7f786e084740 1 --2- 172.21.15.47:0/1009181373 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55748655de20 0x557486566f40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:21.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.146+0000 7f786e084740 1 --2- 172.21.15.47:0/1009181373 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55748651aa00 0x557486566a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:21.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.146+0000 7f786e084740 1 --2- 172.21.15.47:0/1009181373 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55748655da40 0x55748655e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:21.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.146+0000 7f786e084740 1 -- 172.21.15.47:0/1009181373 >> 172.21.15.47:0/1009181373 conn(0x5574865196b0 msgr2=0x55748651bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:21.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.146+0000 7f786e084740 1 -- 172.21.15.47:0/1009181373 shutdown_connections 2024-04-01T22:34:21.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.146+0000 7f786e084740 1 -- 172.21.15.47:0/1009181373 wait complete. 2024-04-01T22:34:21.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.147+0000 7f786e084740 1 -- start start 2024-04-01T22:34:21.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.147+0000 7f786e084740 1 Processor -- start 2024-04-01T22:34:21.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.148+0000 7f786e084740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55748655da40 0x5574865617d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:21.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.148+0000 7f786e084740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55748655de20 0x55748655f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:21.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.148+0000 7f786e084740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x557486539df0 0x55748656df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:21.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.148+0000 7f786e084740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55748651ced0 con 0x55748655da40 2024-04-01T22:34:21.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.148+0000 7f786e084740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55748643cf70 con 0x55748655de20 2024-04-01T22:34:21.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.148+0000 7f786e084740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55748651d190 con 0x557486539df0 2024-04-01T22:34:21.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.148+0000 7f786e084740 10 client.0 _ll_register_callbacks cb 0x557486194ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T22:34:21.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.149+0000 7f7868a38640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x557486539df0 0x55748656df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:21.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.149+0000 7f7868a38640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x557486539df0 0x55748656df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:39480/0 (socket says 172.21.15.47:39480) 2024-04-01T22:34:21.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.149+0000 7f7868a38640 1 -- 172.21.15.47:0/3599229447 learned_addr learned my addr 172.21.15.47:0/3599229447 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:21.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.152+0000 7f7869239640 1 --2- 172.21.15.47:0/3599229447 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55748655de20 0x55748655f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:21.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.153+0000 7f7859ffb640 1 -- 172.21.15.47:0/2705922499 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f7854018020 con 0x7f78640cc0d0 2024-04-01T22:34:21.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.153+0000 7f7859ffb640 1 --2- 172.21.15.47:0/2705922499 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f784806b900 0x7f784806ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:21.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.153+0000 7f7869a3a640 1 --2- 172.21.15.47:0/2705922499 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f784806b900 0x7f784806ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:21.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.154+0000 7f7869a3a640 1 --2- 172.21.15.47:0/2705922499 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f784806b900 0x7f784806ddc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f785c009fd0 tx=0x7f785c009810 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:21.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.154+0000 7f7868a38640 1 -- 172.21.15.47:0/3599229447 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55748655de20 msgr2=0x55748655f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:21.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.154+0000 7f7868a38640 1 --2- 172.21.15.47:0/3599229447 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55748655de20 0x55748655f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:21.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.154+0000 7f7868a38640 1 -- 172.21.15.47:0/3599229447 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55748655da40 msgr2=0x5574865617d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:21.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.154+0000 7f7868a38640 1 --2- 172.21.15.47:0/3599229447 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55748655da40 0x5574865617d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:21.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.154+0000 7f7868a38640 1 -- 172.21.15.47:0/3599229447 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55748625f6b0 con 0x557486539df0 2024-04-01T22:34:21.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.157+0000 7f7859ffb640 1 -- 172.21.15.47:0/2705922499 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f785402a070 con 0x7f78640cc0d0 2024-04-01T22:34:21.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.157+0000 7f7868a38640 1 --2- 172.21.15.47:0/3599229447 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x557486539df0 0x55748656df30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7854091290 tx=0x7f78540610d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13fdd5332b790fe6 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:21.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.157+0000 7f783ffff640 10 client.0 ms_handle_connect on v2:172.21.15.181:3301/0 2024-04-01T22:34:21.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.161+0000 7f783ffff640 1 -- 172.21.15.47:0/3599229447 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f785405f440 con 0x557486539df0 2024-04-01T22:34:21.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.161+0000 7f783ffff640 1 -- 172.21.15.47:0/3599229447 <== mon.2 v2:172.21.15.181:3301/0 2 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f785405f600 con 0x557486539df0 2024-04-01T22:34:21.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.161+0000 7f786e084740 1 -- 172.21.15.47:0/3599229447 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7854024240 con 0x557486539df0 2024-04-01T22:34:21.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.163+0000 7f783ffff640 1 -- 172.21.15.47:0/3599229447 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f7854061300 con 0x557486539df0 2024-04-01T22:34:21.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.163+0000 7f786e084740 10 client.4592 fetch_fsmap learned FSMap version 9 2024-04-01T22:34:21.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.163+0000 7f786e084740 1 -- 172.21.15.47:0/3599229447 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55748653aac0 con 0x557486539df0 2024-04-01T22:34:21.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.167+0000 7f783ffff640 1 -- 172.21.15.47:0/3599229447 <== mon.2 v2:172.21.15.181:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7854024240 con 0x557486539df0 2024-04-01T22:34:21.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.167+0000 7f783ffff640 1 -- 172.21.15.47:0/3599229447 <== mon.2 v2:172.21.15.181:3301/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f785405d8e0 con 0x557486539df0 2024-04-01T22:34:21.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.167+0000 7f786e084740 10 client.4592 fetch_fsmap finished waiting for FSMap version 9 2024-04-01T22:34:21.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.167+0000 7f786e084740 10 client.4592 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-01T22:34:21.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.167+0000 7f786e084740 20 client.4592 populate_metadata read hostname 'smithi047' 2024-04-01T22:34:21.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.167+0000 7f786e084740 1 --2- 172.21.15.47:0/3599229447 >> [v2:172.21.15.47:6834/1610100855,v1:172.21.15.47:6835/1610100855] conn(0x557486537860 0x55748657c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:21.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.167+0000 7f786e084740 4 client.4592 mds_command: new command op to 4254 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T22:34:21.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.167+0000 7f786e084740 1 -- 172.21.15.47:0/3599229447 --> [v2:172.21.15.47:6834/1610100855,v1:172.21.15.47:6835/1610100855] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55748648e030 con 0x557486537860 2024-04-01T22:34:21.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.168+0000 7f7869239640 1 --2- 172.21.15.47:0/3599229447 >> [v2:172.21.15.47:6834/1610100855,v1:172.21.15.47:6835/1610100855] conn(0x557486537860 0x55748657c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:21.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.171+0000 7f7869239640 1 --2- 172.21.15.47:0/3599229447 >> [v2:172.21.15.47:6834/1610100855,v1:172.21.15.47:6835/1610100855] conn(0x557486537860 0x55748657c690 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebdf987d19adcf37 server_cookie=2ba65fbac1171a6 in_seq=0 out_seq=0 2024-04-01T22:34:21.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.171+0000 7f783ffff640 10 client.4592 ms_handle_connect on v2:172.21.15.47:6834/1610100855 2024-04-01T22:34:21.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.193+0000 7f783ffff640 1 -- 172.21.15.47:0/3599229447 <== mds.0 v2:172.21.15.47:6834/1610100855 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55748648e030 con 0x557486537860 2024-04-01T22:34:21.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.193+0000 7f783ffff640 10 client.4592 handle_command_reply: tid=0 2024-04-01T22:34:21.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.193+0000 7f786e084740 1 client.4592 shutdown 2024-04-01T22:34:21.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.194+0000 7f786e084740 1 -- 172.21.15.47:0/3599229447 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x557486539df0 msgr2=0x55748656df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:21.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.194+0000 7f786e084740 1 --2- 172.21.15.47:0/3599229447 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x557486539df0 0x55748656df30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7854091290 tx=0x7f78540610d0 comp rx=0 tx=0).stop 2024-04-01T22:34:21.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.194+0000 7f786e084740 1 -- 172.21.15.47:0/3599229447 shutdown_connections 2024-04-01T22:34:21.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.194+0000 7f786e084740 1 --2- 172.21.15.47:0/3599229447 >> [v2:172.21.15.47:6834/1610100855,v1:172.21.15.47:6835/1610100855] conn(0x557486537860 0x55748657c690 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:21.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.194+0000 7f786e084740 1 --2- 172.21.15.47:0/3599229447 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x557486539df0 0x55748656df30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:21.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.194+0000 7f786e084740 1 --2- 172.21.15.47:0/3599229447 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55748655de20 0x55748655f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:21.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.194+0000 7f783ffff640 0 client.4592 ms_handle_reset on v2:172.21.15.47:6834/1610100855 2024-04-01T22:34:21.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.194+0000 7f786e084740 1 --2- 172.21.15.47:0/3599229447 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55748655da40 0x5574865617d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:21.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.194+0000 7f786e084740 1 -- 172.21.15.47:0/3599229447 >> 172.21.15.47:0/3599229447 conn(0x55748651aa00 msgr2=0x55748651e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:21.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.194+0000 7f786e084740 1 -- 172.21.15.47:0/3599229447 shutdown_connections 2024-04-01T22:34:21.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.194+0000 7f786e084740 1 -- 172.21.15.47:0/3599229447 wait complete. 2024-04-01T22:34:21.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.194+0000 7f786e084740 20 client.4592 trim_cache size 0 max 16384 2024-04-01T22:34:21.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.213+0000 7f786e084740 1 Processor -- start 2024-04-01T22:34:21.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.213+0000 7f786e084740 1 -- start start 2024-04-01T22:34:21.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.213+0000 7f786e084740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557486539df0 0x5574865410b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:21.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.213+0000 7f786e084740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55748655da40 0x5574865415f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:21.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.213+0000 7f786e084740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55748655de20 0x5574865816c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:21.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.213+0000 7f786e084740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f78641fd050 con 0x557486539df0 2024-04-01T22:34:21.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.213+0000 7f786e084740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55748651ced0 con 0x55748655da40 2024-04-01T22:34:21.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.213+0000 7f786e084740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x55748651d190 con 0x55748655de20 2024-04-01T22:34:21.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.214+0000 7f7869a3a640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55748655de20 0x5574865816c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:21.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.214+0000 7f7868a38640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55748655da40 0x5574865415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:21.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.214+0000 7f7869a3a640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55748655de20 0x5574865816c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:39484/0 (socket says 172.21.15.47:39484) 2024-04-01T22:34:21.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.214+0000 7f7869a3a640 1 -- 172.21.15.47:0/951497671 learned_addr learned my addr 172.21.15.47:0/951497671 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:21.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.218+0000 7f7869a3a640 1 -- 172.21.15.47:0/951497671 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55748655da40 msgr2=0x5574865415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:21.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.218+0000 7f7869a3a640 1 --2- 172.21.15.47:0/951497671 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55748655da40 0x5574865415f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:21.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.218+0000 7f7869a3a640 1 -- 172.21.15.47:0/951497671 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557486539df0 msgr2=0x5574865410b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:21.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.218+0000 7f7869a3a640 1 --2- 172.21.15.47:0/951497671 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557486539df0 0x5574865410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:21.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.218+0000 7f7869a3a640 1 -- 172.21.15.47:0/951497671 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55748656e300 con 0x55748655de20 2024-04-01T22:34:21.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.218+0000 7f7868a38640 1 --2- 172.21.15.47:0/951497671 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55748655da40 0x5574865415f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T22:34:21.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.221+0000 7f7869a3a640 1 --2- 172.21.15.47:0/951497671 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55748655de20 0x5574865816c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f785c018650 tx=0x7f785c019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7318168498bb167 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:21.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.225+0000 7f78467fc640 1 -- 172.21.15.47:0/951497671 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f785c026030 con 0x55748655de20 2024-04-01T22:34:21.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.225+0000 7f78467fc640 1 -- 172.21.15.47:0/951497671 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f785c022630 con 0x55748655de20 2024-04-01T22:34:21.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.225+0000 7f78467fc640 1 -- 172.21.15.47:0/951497671 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f785c01c070 con 0x55748655de20 2024-04-01T22:34:21.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.225+0000 7f786e084740 1 -- 172.21.15.47:0/951497671 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55748655de20 msgr2=0x5574865816c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:21.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.225+0000 7f786e084740 1 --2- 172.21.15.47:0/951497671 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55748655de20 0x5574865816c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f785c018650 tx=0x7f785c019000 comp rx=0 tx=0).stop 2024-04-01T22:34:21.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.226+0000 7f786e084740 1 -- 172.21.15.47:0/951497671 shutdown_connections 2024-04-01T22:34:21.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.226+0000 7f786e084740 1 --2- 172.21.15.47:0/951497671 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55748655de20 0x5574865816c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:21.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.226+0000 7f786e084740 1 --2- 172.21.15.47:0/951497671 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55748655da40 0x5574865415f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:21.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.226+0000 7f786e084740 1 --2- 172.21.15.47:0/951497671 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557486539df0 0x5574865410b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:21.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.226+0000 7f786e084740 1 -- 172.21.15.47:0/951497671 >> 172.21.15.47:0/951497671 conn(0x55748651aa00 msgr2=0x5574865383c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:21.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.226+0000 7f786e084740 1 -- 172.21.15.47:0/951497671 shutdown_connections 2024-04-01T22:34:21.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.226+0000 7f786e084740 1 -- 172.21.15.47:0/951497671 wait complete. 2024-04-01T22:34:21.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.226+0000 7f786e084740 1 -- start start 2024-04-01T22:34:21.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.226+0000 7f786e084740 1 Processor -- start 2024-04-01T22:34:21.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.227+0000 7f786e084740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557486539df0 0x557486574040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:21.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.227+0000 7f786e084740 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55748655da40 0x5574865dc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:21.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.227+0000 7f786e084740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55748655de20 0x5574865d2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:21.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.227+0000 7f786e084740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557486537d30 con 0x557486539df0 2024-04-01T22:34:21.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.227+0000 7f786e084740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5574865376e0 con 0x55748655de20 2024-04-01T22:34:21.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.227+0000 7f786e084740 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x557486571050 con 0x55748655da40 2024-04-01T22:34:21.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.227+0000 7f786e084740 10 client.0 _ll_register_callbacks cb 0x7f7854030070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T22:34:21.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.228+0000 7f7868a38640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55748655da40 0x5574865dc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:21.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.228+0000 7f7869a3a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55748655de20 0x5574865d2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:21.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.228+0000 7f7869a3a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55748655de20 0x5574865d2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:37326/0 (socket says 172.21.15.47:37326) 2024-04-01T22:34:21.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.228+0000 7f7868a38640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55748655da40 0x5574865dc2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:39494/0 (socket says 172.21.15.47:39494) 2024-04-01T22:34:21.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.228+0000 7f7869a3a640 1 -- 172.21.15.47:0/1471679605 learned_addr learned my addr 172.21.15.47:0/1471679605 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:21.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.233+0000 7f7868a38640 1 -- 172.21.15.47:0/1471679605 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55748655de20 msgr2=0x5574865d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:21.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.233+0000 7f7868a38640 1 --2- 172.21.15.47:0/1471679605 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55748655de20 0x5574865d2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:21.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.233+0000 7f7868a38640 1 -- 172.21.15.47:0/1471679605 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557486539df0 msgr2=0x557486574040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T22:34:21.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.233+0000 7f7868a38640 1 --2- 172.21.15.47:0/1471679605 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557486539df0 0x557486574040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:21.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.233+0000 7f7868a38640 1 -- 172.21.15.47:0/1471679605 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55748656b380 con 0x55748655da40 2024-04-01T22:34:21.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.233+0000 7f7869a3a640 1 --2- 172.21.15.47:0/1471679605 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55748655de20 0x5574865d2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T22:34:21.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.236+0000 7f7868a38640 1 --2- 172.21.15.47:0/1471679605 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55748655da40 0x5574865dc2a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x55748653a1f0 tx=0x7f785407f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=500a477ae58df341 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:21.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.236+0000 7f783ffff640 10 client.0 ms_handle_connect on v2:172.21.15.181:3301/0 2024-04-01T22:34:21.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.242+0000 7f783ffff640 1 -- 172.21.15.47:0/1471679605 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78540914c0 con 0x55748655da40 2024-04-01T22:34:21.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.242+0000 7f786e084740 1 -- 172.21.15.47:0/1471679605 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f785c022630 con 0x55748655da40 2024-04-01T22:34:21.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.322+0000 7f783ffff640 1 -- 172.21.15.47:0/1471679605 <== mon.2 v2:172.21.15.181:3301/0 2 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f785407ec60 con 0x55748655da40 2024-04-01T22:34:21.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.393+0000 7f783ffff640 1 -- 172.21.15.47:0/1471679605 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f785405d510 con 0x55748655da40 2024-04-01T22:34:21.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.393+0000 7f786e084740 10 client.4598 fetch_fsmap learned FSMap version 9 2024-04-01T22:34:21.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.393+0000 7f786e084740 1 -- 172.21.15.47:0/1471679605 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55748656b380 con 0x55748655da40 2024-04-01T22:34:21.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.397+0000 7f783ffff640 1 -- 172.21.15.47:0/1471679605 <== mon.2 v2:172.21.15.181:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f785c022630 con 0x55748655da40 2024-04-01T22:34:21.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.397+0000 7f783ffff640 1 -- 172.21.15.47:0/1471679605 <== mon.2 v2:172.21.15.181:3301/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f7854061560 con 0x55748655da40 2024-04-01T22:34:21.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.397+0000 7f786e084740 10 client.4598 fetch_fsmap finished waiting for FSMap version 9 2024-04-01T22:34:21.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.397+0000 7f786e084740 10 client.4598 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-01T22:34:21.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.397+0000 7f786e084740 20 client.4598 populate_metadata read hostname 'smithi047' 2024-04-01T22:34:21.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.397+0000 7f786e084740 1 --2- 172.21.15.47:0/1471679605 >> [v2:172.21.15.47:6834/1610100855,v1:172.21.15.47:6835/1610100855] conn(0x5574865d9020 0x5574865d9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:21.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.397+0000 7f786e084740 4 client.4598 mds_command: new command op to 4254 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-01T22:34:21.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.397+0000 7f786e084740 1 -- 172.21.15.47:0/1471679605 --> [v2:172.21.15.47:6834/1610100855,v1:172.21.15.47:6835/1610100855] -- command(tid 0: {"prefix": "status"}) -- 0x557486488380 con 0x5574865d9020 2024-04-01T22:34:21.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.398+0000 7f7869239640 1 --2- 172.21.15.47:0/1471679605 >> [v2:172.21.15.47:6834/1610100855,v1:172.21.15.47:6835/1610100855] conn(0x5574865d9020 0x5574865d9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:21.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.401+0000 7f7869239640 1 --2- 172.21.15.47:0/1471679605 >> [v2:172.21.15.47:6834/1610100855,v1:172.21.15.47:6835/1610100855] conn(0x5574865d9020 0x5574865d9400 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39ebbb345ef201b server_cookie=75b9794270abd5b9 in_seq=0 out_seq=0 2024-04-01T22:34:21.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.401+0000 7f783ffff640 10 client.4598 ms_handle_connect on v2:172.21.15.47:6834/1610100855 2024-04-01T22:34:21.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.404+0000 7f783ffff640 1 -- 172.21.15.47:0/1471679605 <== mds.0 v2:172.21.15.47:6834/1610100855 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x557486488380 con 0x5574865d9020 2024-04-01T22:34:21.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.404+0000 7f783ffff640 10 client.4598 handle_command_reply: tid=0 2024-04-01T22:34:21.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.404+0000 7f786e084740 1 client.4598 shutdown 2024-04-01T22:34:21.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.405+0000 7f786e084740 1 -- 172.21.15.47:0/1471679605 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55748655da40 msgr2=0x5574865dc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:21.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.405+0000 7f786e084740 1 --2- 172.21.15.47:0/1471679605 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55748655da40 0x5574865dc2a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x55748653a1f0 tx=0x7f785407f000 comp rx=0 tx=0).stop 2024-04-01T22:34:21.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.405+0000 7f786e084740 1 -- 172.21.15.47:0/1471679605 shutdown_connections 2024-04-01T22:34:21.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.405+0000 7f786e084740 1 --2- 172.21.15.47:0/1471679605 >> [v2:172.21.15.47:6834/1610100855,v1:172.21.15.47:6835/1610100855] conn(0x5574865d9020 0x5574865d9400 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:21.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.405+0000 7f786e084740 1 --2- 172.21.15.47:0/1471679605 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55748655de20 0x5574865d2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:21.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.405+0000 7f786e084740 1 --2- 172.21.15.47:0/1471679605 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x55748655da40 0x5574865dc2a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:21.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.405+0000 7f783ffff640 0 client.4598 ms_handle_reset on v2:172.21.15.47:6834/1610100855 2024-04-01T22:34:21.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.405+0000 7f786e084740 1 --2- 172.21.15.47:0/1471679605 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557486539df0 0x557486574040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:21.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.405+0000 7f786e084740 1 -- 172.21.15.47:0/1471679605 >> 172.21.15.47:0/1471679605 conn(0x55748651aa00 msgr2=0x5574865422d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:21.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.405+0000 7f786e084740 1 -- 172.21.15.47:0/1471679605 shutdown_connections 2024-04-01T22:34:21.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.405+0000 7f786e084740 1 -- 172.21.15.47:0/1471679605 wait complete. 2024-04-01T22:34:21.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.405+0000 7f786e084740 20 client.4598 trim_cache size 0 max 16384 2024-04-01T22:34:21.406 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-01T22:34:21.406 INFO:teuthology.orchestra.run.smithi047.stdout: "cluster_fsid": "a6998a48-38bc-4e42-b0d9-04f2fb5c3c87", 2024-04-01T22:34:21.406 INFO:teuthology.orchestra.run.smithi047.stdout: "whoami": 0, 2024-04-01T22:34:21.406 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 4254, 2024-04-01T22:34:21.406 INFO:teuthology.orchestra.run.smithi047.stdout: "want_state": "up:active", 2024-04-01T22:34:21.406 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "up:active", 2024-04-01T22:34:21.406 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs", 2024-04-01T22:34:21.407 INFO:teuthology.orchestra.run.smithi047.stdout: "rank_uptime": 53.306325170999997, 2024-04-01T22:34:21.407 INFO:teuthology.orchestra.run.smithi047.stdout: "mdsmap_epoch": 9, 2024-04-01T22:34:21.407 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch": 27, 2024-04-01T22:34:21.407 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch_barrier": 25, 2024-04-01T22:34:21.407 INFO:teuthology.orchestra.run.smithi047.stdout: "uptime": 62.173644322000001 2024-04-01T22:34:21.407 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-01T22:34:21.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.405+0000 7f786b49d640 1 -- 172.21.15.47:0/2705922499 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f784806b900 msgr2=0x7f784806ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:21.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.405+0000 7f786b49d640 1 --2- 172.21.15.47:0/2705922499 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f784806b900 0x7f784806ddc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f785c009fd0 tx=0x7f785c009810 comp rx=0 tx=0).stop 2024-04-01T22:34:21.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.405+0000 7f786b49d640 1 -- 172.21.15.47:0/2705922499 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78640cc0d0 msgr2=0x7f7864154250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:21.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.405+0000 7f786b49d640 1 --2- 172.21.15.47:0/2705922499 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78640cc0d0 0x7f7864154250 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f785400b3f0 tx=0x7f785400b8b0 comp rx=0 tx=0).stop 2024-04-01T22:34:21.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.405+0000 7f786b49d640 1 -- 172.21.15.47:0/2705922499 shutdown_connections 2024-04-01T22:34:21.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.406+0000 7f786b49d640 1 --2- 172.21.15.47:0/2705922499 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f784806b900 0x7f784806ddc0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:21.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.406+0000 7f786b49d640 1 --2- 172.21.15.47:0/2705922499 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f786415afc0 0x7f78641e2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:21.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.406+0000 7f786b49d640 1 --2- 172.21.15.47:0/2705922499 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78640cc0d0 0x7f7864154250 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:21.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.406+0000 7f786b49d640 1 --2- 172.21.15.47:0/2705922499 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f78640c93f0 0x7f78640c3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:21.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.406+0000 7f786b49d640 1 -- 172.21.15.47:0/2705922499 >> 172.21.15.47:0/2705922499 conn(0x7f78640cfdb0 msgr2=0x7f78640d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:21.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.406+0000 7f786b49d640 1 -- 172.21.15.47:0/2705922499 shutdown_connections 2024-04-01T22:34:21.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.406+0000 7f786b49d640 1 -- 172.21.15.47:0/2705922499 wait complete. 2024-04-01T22:34:21.416 INFO:teuthology.run_tasks:Running task sequential... 2024-04-01T22:34:21.427 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-01T22:34:21.427 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-01T22:34:21.427 INFO:teuthology.task.print:Enabling mgr modules 2024-04-01T22:34:21.427 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-01T22:34:21.444 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-01T22:34:21.444 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-01T22:34:21.444 INFO:tasks.ceph_fuse:client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2024-04-01T22:34:21.444 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-01T22:34:21.444 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-01T22:34:21.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T22:34:21.445 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-04-01T22:34:21.459 INFO:teuthology.orchestra.run.smithi047.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-01T22:34:21.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T22:34:21.459 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-01T22:34:21.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T22:34:21.526 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link delete ceph-brx 2024-04-01T22:34:21.618 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-01T22:34:21.618 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-01T22:34:21.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.743+0000 7ff83e0f4640 1 Processor -- start 2024-04-01T22:34:21.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.743+0000 7ff83e0f4640 1 -- start start 2024-04-01T22:34:21.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.744+0000 7ff83e0f4640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff8380c8820 0x7ff8380c7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:21.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.744+0000 7ff83e0f4640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8380c39b0 con 0x7ff83815a420 2024-04-01T22:34:21.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.744+0000 7ff83e0f4640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8380c5ba0 con 0x7ff8380c8440 2024-04-01T22:34:21.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.744+0000 7ff83e0f4640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7ff8380c33f0 con 0x7ff8380c8820 2024-04-01T22:34:21.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.745+0000 7ff836ffd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff8380c8820 0x7ff8380c7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:21.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.745+0000 7ff837fff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7ff83815a420 0x7ff838150b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:51534/0 (socket says 172.21.15.47:51534) 2024-04-01T22:34:21.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.745+0000 7ff837fff640 1 -- 172.21.15.47:0/12581443 learned_addr learned my addr 172.21.15.47:0/12581443 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T22:34:21.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.747+0000 7ff8367fc640 1 -- 172.21.15.47:0/12581443 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 589632094 0 0) 0x7ff8380c5ba0 con 0x7ff8380c8440 2024-04-01T22:34:21.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.747+0000 7ff8367fc640 1 -- 172.21.15.47:0/12581443 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff820003520 con 0x7ff8380c8440 2024-04-01T22:34:21.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.747+0000 7ff8367fc640 1 -- 172.21.15.47:0/12581443 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4178098762 0 0) 0x7ff8380c39b0 con 0x7ff83815a420 2024-04-01T22:34:21.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.747+0000 7ff8367fc640 1 -- 172.21.15.47:0/12581443 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8380c5ba0 con 0x7ff83815a420 2024-04-01T22:34:21.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.747+0000 7ff836ffd640 1 -- 172.21.15.47:0/12581443 >> v1:172.21.15.181:6789/0 conn(0x7ff8380c8440 legacy=0x7ff8380c2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:21.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.747+0000 7ff836ffd640 1 -- 172.21.15.47:0/12581443 >> v1:172.21.15.47:6789/0 conn(0x7ff83815a420 legacy=0x7ff838150b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:21.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.747+0000 7ff836ffd640 1 -- 172.21.15.47:0/12581443 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8380c36d0 con 0x7ff8380c8820 2024-04-01T22:34:21.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.749+0000 7ff836ffd640 1 --2- 172.21.15.47:0/12581443 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff8380c8820 0x7ff8380c7950 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff8280097d0 tx=0x7ff82802b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26e36d429ea747e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:21.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.753+0000 7ff8367fc640 1 -- 172.21.15.47:0/12581443 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff828034070 con 0x7ff8380c8820 2024-04-01T22:34:21.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.753+0000 7ff8367fc640 1 -- 172.21.15.47:0/12581443 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff828030880 con 0x7ff8380c8820 2024-04-01T22:34:21.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.753+0000 7ff8367fc640 1 -- 172.21.15.47:0/12581443 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff828030c50 con 0x7ff8380c8820 2024-04-01T22:34:21.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.754+0000 7ff83e0f4640 1 -- 172.21.15.47:0/12581443 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff8380c8820 msgr2=0x7ff8380c7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:21.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.754+0000 7ff83e0f4640 1 --2- 172.21.15.47:0/12581443 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff8380c8820 0x7ff8380c7950 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff8280097d0 tx=0x7ff82802b9c0 comp rx=0 tx=0).stop 2024-04-01T22:34:21.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.754+0000 7ff83e0f4640 1 -- 172.21.15.47:0/12581443 shutdown_connections 2024-04-01T22:34:21.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.754+0000 7ff83e0f4640 1 --2- 172.21.15.47:0/12581443 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff8380c8820 0x7ff8380c7950 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:21.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.754+0000 7ff83e0f4640 1 -- 172.21.15.47:0/12581443 >> 172.21.15.47:0/12581443 conn(0x7ff8380cb740 msgr2=0x7ff8380cbb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:21.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.754+0000 7ff83e0f4640 1 -- 172.21.15.47:0/12581443 shutdown_connections 2024-04-01T22:34:21.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.754+0000 7ff83e0f4640 1 -- 172.21.15.47:0/12581443 wait complete. 2024-04-01T22:34:21.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.755+0000 7ff83e0f4640 1 Processor -- start 2024-04-01T22:34:21.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.756+0000 7ff83e0f4640 1 -- start start 2024-04-01T22:34:21.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.757+0000 7ff83e0f4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff8380c8440 0x7ff8380ca800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:21.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.757+0000 7ff83e0f4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8380c8820 0x7ff8381ec010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:21.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.757+0000 7ff83e0f4640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff83815a420 0x7ff83814d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:21.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.757+0000 7ff83e0f4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff8380c5680 con 0x7ff8380c8440 2024-04-01T22:34:21.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.757+0000 7ff83e0f4640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff8380c53a0 con 0x7ff8380c8820 2024-04-01T22:34:21.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.757+0000 7ff83e0f4640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7ff8380c7e90 con 0x7ff83815a420 2024-04-01T22:34:21.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.757+0000 7ff8377fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff8380c8440 0x7ff8380ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:21.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.757+0000 7ff837fff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff83815a420 0x7ff83814d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:21.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.757+0000 7ff836ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8380c8820 0x7ff8381ec010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:21.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.758+0000 7ff8377fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff8380c8440 0x7ff8380ca800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42858/0 (socket says 172.21.15.47:42858) 2024-04-01T22:34:21.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.758+0000 7ff8377fe640 1 -- 172.21.15.47:0/1531626004 learned_addr learned my addr 172.21.15.47:0/1531626004 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T22:34:21.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.761+0000 7ff836ffd640 1 -- 172.21.15.47:0/1531626004 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff83815a420 msgr2=0x7ff83814d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:21.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.761+0000 7ff836ffd640 1 --2- 172.21.15.47:0/1531626004 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff83815a420 0x7ff83814d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:21.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.761+0000 7ff836ffd640 1 -- 172.21.15.47:0/1531626004 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff8380c8440 msgr2=0x7ff8380ca800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:21.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.761+0000 7ff836ffd640 1 --2- 172.21.15.47:0/1531626004 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff8380c8440 0x7ff8380ca800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:21.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.761+0000 7ff836ffd640 1 -- 172.21.15.47:0/1531626004 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8380c2540 con 0x7ff8380c8820 2024-04-01T22:34:21.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.764+0000 7ff836ffd640 1 --2- 172.21.15.47:0/1531626004 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8380c8820 0x7ff8381ec010 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff8380c8dc0 tx=0x7ff8280046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:21.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.767+0000 7ff81ffff640 1 -- 172.21.15.47:0/1531626004 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff828048070 con 0x7ff8380c8820 2024-04-01T22:34:21.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.767+0000 7ff81ffff640 1 -- 172.21.15.47:0/1531626004 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff828030680 con 0x7ff8380c8820 2024-04-01T22:34:21.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.767+0000 7ff81ffff640 1 -- 172.21.15.47:0/1531626004 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff828034040 con 0x7ff8380c8820 2024-04-01T22:34:21.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.767+0000 7ff83e0f4640 1 -- 172.21.15.47:0/1531626004 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8381eb850 con 0x7ff8380c8820 2024-04-01T22:34:21.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.768+0000 7ff83e0f4640 1 -- 172.21.15.47:0/1531626004 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff838145230 con 0x7ff8380c8820 2024-04-01T22:34:21.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.768+0000 7ff83e0f4640 1 -- 172.21.15.47:0/1531626004 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff838068210 con 0x7ff8380c8820 2024-04-01T22:34:21.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.787+0000 7ff81ffff640 1 -- 172.21.15.47:0/1531626004 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7ff828037070 con 0x7ff8380c8820 2024-04-01T22:34:21.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.787+0000 7ff81ffff640 1 --2- 172.21.15.47:0/1531626004 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff82406ba10 0x7ff82406ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T22:34:21.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.788+0000 7ff8377fe640 1 --2- 172.21.15.47:0/1531626004 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff82406ba10 0x7ff82406ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T22:34:21.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.788+0000 7ff8377fe640 1 --2- 172.21.15.47:0/1531626004 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff82406ba10 0x7ff82406ded0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff82c001870 tx=0x7ff82c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T22:34:21.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:21.790+0000 7ff81ffff640 1 -- 172.21.15.47:0/1531626004 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7ff828030830 con 0x7ff8380c8820 2024-04-01T22:34:22.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:22.023+0000 7ff81ffff640 1 -- 172.21.15.47:0/1531626004 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7ff828051020 con 0x7ff8380c8820 2024-04-01T22:34:22.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:22.242+0000 7ff83e0f4640 1 -- 172.21.15.47:0/1531626004 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff8380cbcc0 con 0x7ff8380c8820 2024-04-01T22:34:22.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:22.247+0000 7ff81ffff640 1 -- 172.21.15.47:0/1531626004 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7ff82807aa80 con 0x7ff8380c8820 2024-04-01T22:34:22.246 INFO:teuthology.orchestra.run.smithi047.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-01T22:34:22.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:22.250+0000 7ff83e0f4640 1 -- 172.21.15.47:0/1531626004 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff82406ba10 msgr2=0x7ff82406ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:22.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:22.250+0000 7ff83e0f4640 1 --2- 172.21.15.47:0/1531626004 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff82406ba10 0x7ff82406ded0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff82c001870 tx=0x7ff82c009040 comp rx=0 tx=0).stop 2024-04-01T22:34:22.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:22.250+0000 7ff83e0f4640 1 -- 172.21.15.47:0/1531626004 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8380c8820 msgr2=0x7ff8381ec010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T22:34:22.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:22.250+0000 7ff83e0f4640 1 --2- 172.21.15.47:0/1531626004 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8380c8820 0x7ff8381ec010 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff8380c8dc0 tx=0x7ff8280046c0 comp rx=0 tx=0).stop 2024-04-01T22:34:22.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:22.250+0000 7ff83e0f4640 1 -- 172.21.15.47:0/1531626004 shutdown_connections 2024-04-01T22:34:22.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:22.250+0000 7ff83e0f4640 1 --2- 172.21.15.47:0/1531626004 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff82406ba10 0x7ff82406ded0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:22.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:22.250+0000 7ff83e0f4640 1 --2- 172.21.15.47:0/1531626004 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff83815a420 0x7ff83814d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:22.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:22.250+0000 7ff83e0f4640 1 --2- 172.21.15.47:0/1531626004 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8380c8820 0x7ff8381ec010 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:22.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:22.250+0000 7ff83e0f4640 1 --2- 172.21.15.47:0/1531626004 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff8380c8440 0x7ff8380ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T22:34:22.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:22.250+0000 7ff83e0f4640 1 -- 172.21.15.47:0/1531626004 >> 172.21.15.47:0/1531626004 conn(0x7ff8380cb740 msgr2=0x7ff838072ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T22:34:22.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:22.250+0000 7ff83e0f4640 1 -- 172.21.15.47:0/1531626004 shutdown_connections 2024-04-01T22:34:22.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:22.250+0000 7ff83e0f4640 1 -- 172.21.15.47:0/1531626004 wait complete. 2024-04-01T22:34:22.264 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-01T22:34:22.264 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-01T22:34:22.264 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi047.front.sepia.ceph.com 2024-04-01T22:34:22.264 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-01T22:34:22.264 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-01T22:34:22.264 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-01T22:34:22.264 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-01T22:34:22.264 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-01T22:34:22.264 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-01T22:34:22.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T22:34:22.265 DEBUG:teuthology.orchestra.run.smithi047:> ip addr 2024-04-01T22:34:22.279 INFO:teuthology.orchestra.run.smithi047.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-01T22:34:22.280 INFO:teuthology.orchestra.run.smithi047.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-01T22:34:22.280 INFO:teuthology.orchestra.run.smithi047.stdout: inet 127.0.0.1/8 scope host lo 2024-04-01T22:34:22.280 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-01T22:34:22.280 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 ::1/128 scope host 2024-04-01T22:34:22.280 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-01T22:34:22.280 INFO:teuthology.orchestra.run.smithi047.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-01T22:34:22.280 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:78 brd ff:ff:ff:ff:ff:ff 2024-04-01T22:34:22.280 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f0 2024-04-01T22:34:22.280 INFO:teuthology.orchestra.run.smithi047.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-01T22:34:22.280 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:79 brd ff:ff:ff:ff:ff:ff 2024-04-01T22:34:22.280 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f1 2024-04-01T22:34:22.280 INFO:teuthology.orchestra.run.smithi047.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-01T22:34:22.280 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8e brd ff:ff:ff:ff:ff:ff 2024-04-01T22:34:22.280 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f0 2024-04-01T22:34:22.281 INFO:teuthology.orchestra.run.smithi047.stdout: inet 172.21.15.47/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-01T22:34:22.281 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft 42201sec preferred_lft 42201sec 2024-04-01T22:34:22.281 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::ec4:7aff:febd:148e/64 scope link noprefixroute 2024-04-01T22:34:22.281 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-01T22:34:22.281 INFO:teuthology.orchestra.run.smithi047.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-01T22:34:22.281 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8f brd ff:ff:ff:ff:ff:ff 2024-04-01T22:34:22.281 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f1 2024-04-01T22:34:22.281 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-01T22:34:22.281 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-01T22:34:22.281 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-04-01T22:34:22.282 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link add name ceph-brx type bridge 2024-04-01T22:34:22.282 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip addr flush dev ceph-brx 2024-04-01T22:34:22.282 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set ceph-brx up 2024-04-01T22:34:22.282 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-01T22:34:22.282 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-04-01T22:34:22.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-01T22:34:22.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-01T22:34:22.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T22:34:22.434 DEBUG:teuthology.orchestra.run.smithi047:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-01T22:34:22.460 INFO:teuthology.orchestra.run.smithi047.stdout:1 2024-04-01T22:34:22.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T22:34:22.461 DEBUG:teuthology.orchestra.run.smithi047:> route 2024-04-01T22:34:22.516 INFO:teuthology.orchestra.run.smithi047.stdout:Kernel IP routing table 2024-04-01T22:34:22.516 INFO:teuthology.orchestra.run.smithi047.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-01T22:34:22.516 INFO:teuthology.orchestra.run.smithi047.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-01T22:34:22.516 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-01T22:34:22.517 INFO:teuthology.orchestra.run.smithi047.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-01T22:34:22.517 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-01T22:34:22.517 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-04-01T22:34:22.517 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-01T22:34:22.517 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-01T22:34:22.517 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-01T22:34:22.517 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-04-01T22:34:22.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-01T22:34:22.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-01T22:34:22.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T22:34:22.652 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-04-01T22:34:22.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T22:34:22.668 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list-id 2024-04-01T22:34:22.722 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-01T22:34:22.723 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-04-01T22:34:22.723 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T22:34:22.723 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-01T22:34:22.723 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-04-01T22:34:22.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-01T22:34:22.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-01T22:34:22.844 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-01T22:34:22.844 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-01T22:34:22.844 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-04-01T22:34:22.844 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-01T22:34:22.845 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-01T22:34:22.845 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-01T22:34:22.845 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-01T22:34:22.845 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-01T22:34:22.845 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-04-01T22:34:22.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-01T22:34:22.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-01T22:34:22.972 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-01T22:34:22.973 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-04-01T22:34:22.973 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set brx.0 up 2024-04-01T22:34:22.973 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set dev brx.0 master ceph-brx 2024-04-01T22:34:22.973 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-04-01T22:34:23.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-01T22:34:23.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-01T22:34:23.055 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2024-04-01T22:34:23.055 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-01T22:34:23.055 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-01T22:34:23.069 INFO:teuthology.orchestra.run.smithi047.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-01T22:34:23.069 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-01T22:34:23.069 DEBUG:teuthology.orchestra.run.smithi047:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-01T22:34:23.123 DEBUG:tasks.ceph_manager:running client.0 under valgrind with args ['sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/client.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-04-01T22:34:23.124 DEBUG:teuthology.orchestra.run.smithi047:> sudo modprobe fuse 2024-04-01T22:34:23.191 DEBUG:teuthology.orchestra.run.smithi047:> cat /proc/self/mounts | awk '{print $2}' 2024-04-01T22:34:23.246 INFO:teuthology.orchestra.run.smithi047.stdout:/proc 2024-04-01T22:34:23.247 INFO:teuthology.orchestra.run.smithi047.stdout:/sys 2024-04-01T22:34:23.247 INFO:teuthology.orchestra.run.smithi047.stdout:/dev 2024-04-01T22:34:23.247 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/security 2024-04-01T22:34:23.247 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/shm 2024-04-01T22:34:23.247 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/pts 2024-04-01T22:34:23.247 INFO:teuthology.orchestra.run.smithi047.stdout:/run 2024-04-01T22:34:23.247 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/cgroup 2024-04-01T22:34:23.247 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/pstore 2024-04-01T22:34:23.247 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/bpf 2024-04-01T22:34:23.247 INFO:teuthology.orchestra.run.smithi047.stdout:/ 2024-04-01T22:34:23.247 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/selinux 2024-04-01T22:34:23.248 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/sys/fs/binfmt_misc 2024-04-01T22:34:23.248 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/hugepages 2024-04-01T22:34:23.248 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/mqueue 2024-04-01T22:34:23.248 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/debug 2024-04-01T22:34:23.248 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/tracing 2024-04-01T22:34:23.248 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-01T22:34:23.248 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/fuse/connections 2024-04-01T22:34:23.248 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/config 2024-04-01T22:34:23.248 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-sysctl.service 2024-04-01T22:34:23.248 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-01T22:34:23.248 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/nfs/rpc_pipefs 2024-04-01T22:34:23.248 INFO:teuthology.orchestra.run.smithi047.stdout:/run/user/1000 2024-04-01T22:34:23.248 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph 2024-04-01T22:34:23.248 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-0 2024-04-01T22:34:23.249 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-1 2024-04-01T22:34:23.249 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-2 2024-04-01T22:34:23.249 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-3 2024-04-01T22:34:23.249 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns 2024-04-01T22:34:23.249 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T22:34:23.249 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T22:34:23.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T22:34:23.249 DEBUG:teuthology.orchestra.run.smithi047:> ls /sys/fs/fuse/connections 2024-04-01T22:34:23.301 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-01T22:34:23.301 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/client.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-01T22:34:23.344 DEBUG:teuthology.orchestra.run.smithi047:> sudo modprobe fuse 2024-04-01T22:34:23.372 DEBUG:teuthology.orchestra.run.smithi047:> cat /proc/self/mounts | awk '{print $2}' 2024-04-01T22:34:23.428 INFO:teuthology.orchestra.run.smithi047.stdout:/proc 2024-04-01T22:34:23.429 INFO:teuthology.orchestra.run.smithi047.stdout:/sys 2024-04-01T22:34:23.429 INFO:teuthology.orchestra.run.smithi047.stdout:/dev 2024-04-01T22:34:23.429 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/security 2024-04-01T22:34:23.429 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/shm 2024-04-01T22:34:23.429 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/pts 2024-04-01T22:34:23.429 INFO:teuthology.orchestra.run.smithi047.stdout:/run 2024-04-01T22:34:23.429 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/cgroup 2024-04-01T22:34:23.429 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/pstore 2024-04-01T22:34:23.429 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/bpf 2024-04-01T22:34:23.429 INFO:teuthology.orchestra.run.smithi047.stdout:/ 2024-04-01T22:34:23.429 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/selinux 2024-04-01T22:34:23.429 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/sys/fs/binfmt_misc 2024-04-01T22:34:23.429 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/hugepages 2024-04-01T22:34:23.429 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/mqueue 2024-04-01T22:34:23.430 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/debug 2024-04-01T22:34:23.430 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/tracing 2024-04-01T22:34:23.430 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-01T22:34:23.430 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/fuse/connections 2024-04-01T22:34:23.430 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/config 2024-04-01T22:34:23.430 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-sysctl.service 2024-04-01T22:34:23.430 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-01T22:34:23.430 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/nfs/rpc_pipefs 2024-04-01T22:34:23.430 INFO:teuthology.orchestra.run.smithi047.stdout:/run/user/1000 2024-04-01T22:34:23.430 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph 2024-04-01T22:34:23.430 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-0 2024-04-01T22:34:23.430 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-1 2024-04-01T22:34:23.430 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-2 2024-04-01T22:34:23.430 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-3 2024-04-01T22:34:23.431 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns 2024-04-01T22:34:23.431 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T22:34:23.431 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T22:34:23.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T22:34:23.431 DEBUG:teuthology.orchestra.run.smithi047:> ls /sys/fs/fuse/connections 2024-04-01T22:34:24.584 DEBUG:teuthology.orchestra.run.smithi047:> sudo modprobe fuse 2024-04-01T22:34:24.612 DEBUG:teuthology.orchestra.run.smithi047:> cat /proc/self/mounts | awk '{print $2}' 2024-04-01T22:34:24.668 INFO:teuthology.orchestra.run.smithi047.stdout:/proc 2024-04-01T22:34:24.668 INFO:teuthology.orchestra.run.smithi047.stdout:/sys 2024-04-01T22:34:24.668 INFO:teuthology.orchestra.run.smithi047.stdout:/dev 2024-04-01T22:34:24.668 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/security 2024-04-01T22:34:24.668 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/shm 2024-04-01T22:34:24.668 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/pts 2024-04-01T22:34:24.668 INFO:teuthology.orchestra.run.smithi047.stdout:/run 2024-04-01T22:34:24.668 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/cgroup 2024-04-01T22:34:24.669 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/pstore 2024-04-01T22:34:24.669 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/bpf 2024-04-01T22:34:24.669 INFO:teuthology.orchestra.run.smithi047.stdout:/ 2024-04-01T22:34:24.669 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/selinux 2024-04-01T22:34:24.669 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/sys/fs/binfmt_misc 2024-04-01T22:34:24.669 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/hugepages 2024-04-01T22:34:24.669 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/mqueue 2024-04-01T22:34:24.669 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/debug 2024-04-01T22:34:24.669 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/tracing 2024-04-01T22:34:24.669 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-01T22:34:24.669 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/fuse/connections 2024-04-01T22:34:24.669 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/config 2024-04-01T22:34:24.669 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-sysctl.service 2024-04-01T22:34:24.669 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-01T22:34:24.670 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/nfs/rpc_pipefs 2024-04-01T22:34:24.670 INFO:teuthology.orchestra.run.smithi047.stdout:/run/user/1000 2024-04-01T22:34:24.670 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph 2024-04-01T22:34:24.670 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-0 2024-04-01T22:34:24.670 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-1 2024-04-01T22:34:24.670 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-2 2024-04-01T22:34:24.670 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-3 2024-04-01T22:34:24.670 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns 2024-04-01T22:34:24.670 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T22:34:24.670 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T22:34:24.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T22:34:24.670 DEBUG:teuthology.orchestra.run.smithi047:> ls /sys/fs/fuse/connections 2024-04-01T22:34:25.824 DEBUG:teuthology.orchestra.run.smithi047:> sudo modprobe fuse 2024-04-01T22:34:25.851 DEBUG:teuthology.orchestra.run.smithi047:> cat /proc/self/mounts | awk '{print $2}' 2024-04-01T22:34:25.906 INFO:teuthology.orchestra.run.smithi047.stdout:/proc 2024-04-01T22:34:25.907 INFO:teuthology.orchestra.run.smithi047.stdout:/sys 2024-04-01T22:34:25.907 INFO:teuthology.orchestra.run.smithi047.stdout:/dev 2024-04-01T22:34:25.907 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/security 2024-04-01T22:34:25.907 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/shm 2024-04-01T22:34:25.907 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/pts 2024-04-01T22:34:25.907 INFO:teuthology.orchestra.run.smithi047.stdout:/run 2024-04-01T22:34:25.907 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/cgroup 2024-04-01T22:34:25.907 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/pstore 2024-04-01T22:34:25.907 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/bpf 2024-04-01T22:34:25.907 INFO:teuthology.orchestra.run.smithi047.stdout:/ 2024-04-01T22:34:25.907 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/selinux 2024-04-01T22:34:25.907 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/sys/fs/binfmt_misc 2024-04-01T22:34:25.907 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/hugepages 2024-04-01T22:34:25.908 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/mqueue 2024-04-01T22:34:25.908 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/debug 2024-04-01T22:34:25.908 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/tracing 2024-04-01T22:34:25.908 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-01T22:34:25.908 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/fuse/connections 2024-04-01T22:34:25.908 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/config 2024-04-01T22:34:25.908 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-sysctl.service 2024-04-01T22:34:25.908 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-01T22:34:25.908 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/nfs/rpc_pipefs 2024-04-01T22:34:25.908 INFO:teuthology.orchestra.run.smithi047.stdout:/run/user/1000 2024-04-01T22:34:25.908 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph 2024-04-01T22:34:25.908 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-0 2024-04-01T22:34:25.908 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-1 2024-04-01T22:34:25.908 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-2 2024-04-01T22:34:25.908 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-3 2024-04-01T22:34:25.908 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns 2024-04-01T22:34:25.908 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T22:34:25.909 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T22:34:25.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T22:34:25.909 DEBUG:teuthology.orchestra.run.smithi047:> ls /sys/fs/fuse/connections 2024-04-01T22:34:27.066 DEBUG:teuthology.orchestra.run.smithi047:> sudo modprobe fuse 2024-04-01T22:34:27.094 DEBUG:teuthology.orchestra.run.smithi047:> cat /proc/self/mounts | awk '{print $2}' 2024-04-01T22:34:27.149 INFO:teuthology.orchestra.run.smithi047.stdout:/proc 2024-04-01T22:34:27.149 INFO:teuthology.orchestra.run.smithi047.stdout:/sys 2024-04-01T22:34:27.149 INFO:teuthology.orchestra.run.smithi047.stdout:/dev 2024-04-01T22:34:27.149 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/security 2024-04-01T22:34:27.149 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/shm 2024-04-01T22:34:27.149 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/pts 2024-04-01T22:34:27.149 INFO:teuthology.orchestra.run.smithi047.stdout:/run 2024-04-01T22:34:27.149 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/cgroup 2024-04-01T22:34:27.149 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/pstore 2024-04-01T22:34:27.149 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/bpf 2024-04-01T22:34:27.150 INFO:teuthology.orchestra.run.smithi047.stdout:/ 2024-04-01T22:34:27.150 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/selinux 2024-04-01T22:34:27.150 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/sys/fs/binfmt_misc 2024-04-01T22:34:27.150 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/hugepages 2024-04-01T22:34:27.150 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/mqueue 2024-04-01T22:34:27.150 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/debug 2024-04-01T22:34:27.150 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/tracing 2024-04-01T22:34:27.150 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-01T22:34:27.150 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/fuse/connections 2024-04-01T22:34:27.150 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/config 2024-04-01T22:34:27.150 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-sysctl.service 2024-04-01T22:34:27.150 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-01T22:34:27.150 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/nfs/rpc_pipefs 2024-04-01T22:34:27.150 INFO:teuthology.orchestra.run.smithi047.stdout:/run/user/1000 2024-04-01T22:34:27.151 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph 2024-04-01T22:34:27.151 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-0 2024-04-01T22:34:27.151 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-1 2024-04-01T22:34:27.151 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-2 2024-04-01T22:34:27.151 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-3 2024-04-01T22:34:27.151 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns 2024-04-01T22:34:27.151 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T22:34:27.151 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T22:34:27.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T22:34:27.152 DEBUG:teuthology.orchestra.run.smithi047:> ls /sys/fs/fuse/connections 2024-04-01T22:34:28.309 DEBUG:teuthology.orchestra.run.smithi047:> sudo modprobe fuse 2024-04-01T22:34:28.336 DEBUG:teuthology.orchestra.run.smithi047:> cat /proc/self/mounts | awk '{print $2}' 2024-04-01T22:34:28.391 INFO:teuthology.orchestra.run.smithi047.stdout:/proc 2024-04-01T22:34:28.392 INFO:teuthology.orchestra.run.smithi047.stdout:/sys 2024-04-01T22:34:28.392 INFO:teuthology.orchestra.run.smithi047.stdout:/dev 2024-04-01T22:34:28.392 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/security 2024-04-01T22:34:28.392 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/shm 2024-04-01T22:34:28.392 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/pts 2024-04-01T22:34:28.392 INFO:teuthology.orchestra.run.smithi047.stdout:/run 2024-04-01T22:34:28.392 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/cgroup 2024-04-01T22:34:28.392 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/pstore 2024-04-01T22:34:28.392 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/bpf 2024-04-01T22:34:28.392 INFO:teuthology.orchestra.run.smithi047.stdout:/ 2024-04-01T22:34:28.392 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/selinux 2024-04-01T22:34:28.392 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/sys/fs/binfmt_misc 2024-04-01T22:34:28.392 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/hugepages 2024-04-01T22:34:28.392 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/mqueue 2024-04-01T22:34:28.393 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/debug 2024-04-01T22:34:28.393 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/tracing 2024-04-01T22:34:28.393 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-01T22:34:28.393 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/fuse/connections 2024-04-01T22:34:28.393 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/config 2024-04-01T22:34:28.393 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-sysctl.service 2024-04-01T22:34:28.393 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-01T22:34:28.393 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/nfs/rpc_pipefs 2024-04-01T22:34:28.393 INFO:teuthology.orchestra.run.smithi047.stdout:/run/user/1000 2024-04-01T22:34:28.393 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph 2024-04-01T22:34:28.393 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-0 2024-04-01T22:34:28.393 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-1 2024-04-01T22:34:28.393 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-2 2024-04-01T22:34:28.393 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-3 2024-04-01T22:34:28.393 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns 2024-04-01T22:34:28.393 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T22:34:28.394 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T22:34:28.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T22:34:28.394 DEBUG:teuthology.orchestra.run.smithi047:> ls /sys/fs/fuse/connections 2024-04-01T22:34:29.468 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi047.stderr:2024-04-01T22:34:29.358+0000 6511100 -1 init, newargv = 0x7a23fe0 newargc=15 2024-04-01T22:34:29.476 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi047.stderr:ceph-fuse[45984]: starting ceph client 2024-04-01T22:34:29.546 DEBUG:teuthology.orchestra.run.smithi047:> sudo modprobe fuse 2024-04-01T22:34:29.574 DEBUG:teuthology.orchestra.run.smithi047:> cat /proc/self/mounts | awk '{print $2}' 2024-04-01T22:34:29.629 INFO:teuthology.orchestra.run.smithi047.stdout:/proc 2024-04-01T22:34:29.629 INFO:teuthology.orchestra.run.smithi047.stdout:/sys 2024-04-01T22:34:29.630 INFO:teuthology.orchestra.run.smithi047.stdout:/dev 2024-04-01T22:34:29.630 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/security 2024-04-01T22:34:29.630 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/shm 2024-04-01T22:34:29.630 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/pts 2024-04-01T22:34:29.630 INFO:teuthology.orchestra.run.smithi047.stdout:/run 2024-04-01T22:34:29.630 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/cgroup 2024-04-01T22:34:29.630 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/pstore 2024-04-01T22:34:29.630 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/bpf 2024-04-01T22:34:29.630 INFO:teuthology.orchestra.run.smithi047.stdout:/ 2024-04-01T22:34:29.630 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/selinux 2024-04-01T22:34:29.630 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/sys/fs/binfmt_misc 2024-04-01T22:34:29.630 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/hugepages 2024-04-01T22:34:29.630 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/mqueue 2024-04-01T22:34:29.631 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/debug 2024-04-01T22:34:29.631 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/tracing 2024-04-01T22:34:29.631 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-01T22:34:29.631 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/fuse/connections 2024-04-01T22:34:29.631 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/config 2024-04-01T22:34:29.631 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-sysctl.service 2024-04-01T22:34:29.631 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-01T22:34:29.631 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/nfs/rpc_pipefs 2024-04-01T22:34:29.633 INFO:teuthology.orchestra.run.smithi047.stdout:/run/user/1000 2024-04-01T22:34:29.634 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph 2024-04-01T22:34:29.634 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-0 2024-04-01T22:34:29.634 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-1 2024-04-01T22:34:29.634 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-2 2024-04-01T22:34:29.634 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-3 2024-04-01T22:34:29.634 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns 2024-04-01T22:34:29.634 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T22:34:29.634 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T22:34:29.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T22:34:29.634 DEBUG:teuthology.orchestra.run.smithi047:> ls /sys/fs/fuse/connections 2024-04-01T22:34:30.185 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi047.stderr:ceph-fuse[45984]: starting fuse 2024-04-01T22:34:30.786 DEBUG:teuthology.orchestra.run.smithi047:> sudo modprobe fuse 2024-04-01T22:34:30.814 DEBUG:teuthology.orchestra.run.smithi047:> cat /proc/self/mounts | awk '{print $2}' 2024-04-01T22:34:30.870 INFO:teuthology.orchestra.run.smithi047.stdout:/proc 2024-04-01T22:34:30.870 INFO:teuthology.orchestra.run.smithi047.stdout:/sys 2024-04-01T22:34:30.870 INFO:teuthology.orchestra.run.smithi047.stdout:/dev 2024-04-01T22:34:30.870 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/security 2024-04-01T22:34:30.870 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/shm 2024-04-01T22:34:30.870 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/pts 2024-04-01T22:34:30.870 INFO:teuthology.orchestra.run.smithi047.stdout:/run 2024-04-01T22:34:30.870 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/cgroup 2024-04-01T22:34:30.870 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/pstore 2024-04-01T22:34:30.870 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/bpf 2024-04-01T22:34:30.870 INFO:teuthology.orchestra.run.smithi047.stdout:/ 2024-04-01T22:34:30.870 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/selinux 2024-04-01T22:34:30.871 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/sys/fs/binfmt_misc 2024-04-01T22:34:30.871 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/hugepages 2024-04-01T22:34:30.871 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/mqueue 2024-04-01T22:34:30.871 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/debug 2024-04-01T22:34:30.871 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/tracing 2024-04-01T22:34:30.871 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-01T22:34:30.871 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/fuse/connections 2024-04-01T22:34:30.871 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/config 2024-04-01T22:34:30.871 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-sysctl.service 2024-04-01T22:34:30.871 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-01T22:34:30.871 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/nfs/rpc_pipefs 2024-04-01T22:34:30.871 INFO:teuthology.orchestra.run.smithi047.stdout:/run/user/1000 2024-04-01T22:34:30.871 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph 2024-04-01T22:34:30.871 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-0 2024-04-01T22:34:30.872 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-1 2024-04-01T22:34:30.872 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-2 2024-04-01T22:34:30.872 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-3 2024-04-01T22:34:30.872 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns 2024-04-01T22:34:30.872 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T22:34:30.872 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T22:34:30.872 INFO:teuthology.orchestra.run.smithi047.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-01T22:34:30.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T22:34:30.872 DEBUG:teuthology.orchestra.run.smithi047:> ls /sys/fs/fuse/connections 2024-04-01T22:34:30.925 INFO:teuthology.orchestra.run.smithi047.stdout:43 2024-04-01T22:34:30.925 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-04-01T22:34:30.925 DEBUG:teuthology.orchestra.run.smithi047:> sudo stdin-killer -- python3 -c ' 2024-04-01T22:34:30.925 DEBUG:teuthology.orchestra.run.smithi047:> import glob 2024-04-01T22:34:30.925 DEBUG:teuthology.orchestra.run.smithi047:> import re 2024-04-01T22:34:30.925 DEBUG:teuthology.orchestra.run.smithi047:> import os 2024-04-01T22:34:30.925 DEBUG:teuthology.orchestra.run.smithi047:> import subprocess 2024-04-01T22:34:30.925 DEBUG:teuthology.orchestra.run.smithi047:> 2024-04-01T22:34:30.925 DEBUG:teuthology.orchestra.run.smithi047:> def _find_admin_socket(client_name): 2024-04-01T22:34:30.925 DEBUG:teuthology.orchestra.run.smithi047:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-01T22:34:30.926 DEBUG:teuthology.orchestra.run.smithi047:> files = glob.glob(asok_path) 2024-04-01T22:34:30.926 DEBUG:teuthology.orchestra.run.smithi047:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-01T22:34:30.926 DEBUG:teuthology.orchestra.run.smithi047:> 2024-04-01T22:34:30.926 DEBUG:teuthology.orchestra.run.smithi047:> # Given a non-glob path, it better be there 2024-04-01T22:34:30.926 DEBUG:teuthology.orchestra.run.smithi047:> if "*" not in asok_path: 2024-04-01T22:34:30.926 DEBUG:teuthology.orchestra.run.smithi047:> assert(len(files) == 1) 2024-04-01T22:34:30.926 DEBUG:teuthology.orchestra.run.smithi047:> return files[0] 2024-04-01T22:34:30.926 DEBUG:teuthology.orchestra.run.smithi047:> 2024-04-01T22:34:30.926 DEBUG:teuthology.orchestra.run.smithi047:> for f in files: 2024-04-01T22:34:30.926 DEBUG:teuthology.orchestra.run.smithi047:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-01T22:34:30.926 DEBUG:teuthology.orchestra.run.smithi047:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-01T22:34:30.926 DEBUG:teuthology.orchestra.run.smithi047:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-01T22:34:30.926 DEBUG:teuthology.orchestra.run.smithi047:> contents = proc_f.read() 2024-04-01T22:34:30.926 DEBUG:teuthology.orchestra.run.smithi047:> if mountpoint in contents: 2024-04-01T22:34:30.926 DEBUG:teuthology.orchestra.run.smithi047:> return f 2024-04-01T22:34:30.927 DEBUG:teuthology.orchestra.run.smithi047:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-01T22:34:30.927 DEBUG:teuthology.orchestra.run.smithi047:> 2024-04-01T22:34:30.927 DEBUG:teuthology.orchestra.run.smithi047:> print(_find_admin_socket("client.0")) 2024-04-01T22:34:30.927 DEBUG:teuthology.orchestra.run.smithi047:> ' 2024-04-01T22:34:31.048 INFO:teuthology.orchestra.run.smithi047.stdout:/var/run/ceph/ceph-client.0.45984.asok 2024-04-01T22:34:31.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T22:34:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-01T22:34:31.058 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.45984.asok 2024-04-01T22:34:31.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T22:34:31.059 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.45984.asok status 2024-04-01T22:34:31.332 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-01T22:34:31.332 INFO:teuthology.orchestra.run.smithi047.stdout: "metadata": { 2024-04-01T22:34:31.332 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_sha1": "1f941761d08add4455f209f0f2e36f8151f834a0", 2024-04-01T22:34:31.333 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_version": "ceph version 19.0.0-1992-g1f941761 (1f941761d08add4455f209f0f2e36f8151f834a0) squid (dev)", 2024-04-01T22:34:31.333 INFO:teuthology.orchestra.run.smithi047.stdout: "entity_id": "0", 2024-04-01T22:34:31.333 INFO:teuthology.orchestra.run.smithi047.stdout: "hostname": "smithi047", 2024-04-01T22:34:31.333 INFO:teuthology.orchestra.run.smithi047.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-01T22:34:31.333 INFO:teuthology.orchestra.run.smithi047.stdout: "pid": "45984", 2024-04-01T22:34:31.333 INFO:teuthology.orchestra.run.smithi047.stdout: "root": "/" 2024-04-01T22:34:31.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-01T22:34:31.333 INFO:teuthology.orchestra.run.smithi047.stdout: "dentry_count": 0, 2024-04-01T22:34:31.333 INFO:teuthology.orchestra.run.smithi047.stdout: "dentry_pinned_count": 0, 2024-04-01T22:34:31.333 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 4693, 2024-04-01T22:34:31.333 INFO:teuthology.orchestra.run.smithi047.stdout: "inst": { 2024-04-01T22:34:31.333 INFO:teuthology.orchestra.run.smithi047.stdout: "name": { 2024-04-01T22:34:31.333 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "client", 2024-04-01T22:34:31.333 INFO:teuthology.orchestra.run.smithi047.stdout: "num": 4693 2024-04-01T22:34:31.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-01T22:34:31.334 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": { 2024-04-01T22:34:31.334 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v1", 2024-04-01T22:34:31.334 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "172.21.15.47:0", 2024-04-01T22:34:31.334 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 3845062374 2024-04-01T22:34:31.334 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-01T22:34:31.334 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-01T22:34:31.334 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": { 2024-04-01T22:34:31.334 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v1", 2024-04-01T22:34:31.334 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "172.21.15.47:0", 2024-04-01T22:34:31.334 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 3845062374 2024-04-01T22:34:31.334 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-01T22:34:31.334 INFO:teuthology.orchestra.run.smithi047.stdout: "inst_str": "client.4693 172.21.15.47:0/3845062374", 2024-04-01T22:34:31.334 INFO:teuthology.orchestra.run.smithi047.stdout: "addr_str": "172.21.15.47:0/3845062374", 2024-04-01T22:34:31.335 INFO:teuthology.orchestra.run.smithi047.stdout: "inode_count": 1, 2024-04-01T22:34:31.335 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_epoch": 9, 2024-04-01T22:34:31.335 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_epoch": 27, 2024-04-01T22:34:31.335 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_epoch_barrier": 0, 2024-04-01T22:34:31.335 INFO:teuthology.orchestra.run.smithi047.stdout: "blocklisted": false, 2024-04-01T22:34:31.335 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs" 2024-04-01T22:34:31.335 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-01T22:34:31.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T22:34:31.341 DEBUG:teuthology.orchestra.run.smithi047:> stat --file-system '--printf=%T 2024-04-01T22:34:31.341 DEBUG:teuthology.orchestra.run.smithi047:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-01T22:34:31.402 INFO:teuthology.orchestra.run.smithi047.stdout:fuseblk 2024-04-01T22:34:31.403 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-01T22:34:31.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T22:34:31.403 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-01T22:34:31.454 INFO:teuthology.run_tasks:Running task workunit... 2024-04-01T22:34:31.468 INFO:tasks.workunit:Pulling workunits from ref 1f941761d08add4455f209f0f2e36f8151f834a0 2024-04-01T22:34:31.468 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-01T22:34:31.468 INFO:tasks.workunit:timeout=3h 2024-04-01T22:34:31.468 INFO:tasks.workunit:cleanup=True 2024-04-01T22:34:31.469 DEBUG:teuthology.orchestra.run.smithi047:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-01T22:34:31.483 INFO:teuthology.orchestra.run.smithi047.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-01T22:34:31.483 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-01T22:34:31.483 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 2bh/43d Inode: 1 Links: 2 2024-04-01T22:34:31.484 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T22:34:31.484 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-01T22:34:31.484 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-01T22:34:31.484 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-04-01 22:33:28.435241453 +0000 2024-04-01T22:34:31.484 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-04-01 22:33:42.481080120 +0000 2024-04-01T22:34:31.484 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: - 2024-04-01T22:34:31.484 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-01T22:34:31.484 DEBUG:teuthology.orchestra.run.smithi047:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-01T22:34:31.933 DEBUG:teuthology.orchestra.run.smithi047:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1f941761d08add4455f209f0f2e36f8151f834a0 2024-04-01T22:34:31.948 INFO:tasks.workunit.client.0.smithi047.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-01T22:34:41.818 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:34:41.821 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:35:11.964 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:35:11.968 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:35:23.163 INFO:tasks.workunit.client.0.smithi047.stderr:Updating files: 97% (11742/12088) Updating files: 98% (11847/12088) Updating files: 99% (11968/12088) Updating files: 100% (12088/12088) Updating files: 100% (12088/12088), done. 2024-04-01T22:35:23.645 INFO:tasks.workunit.client.0.smithi047.stderr:Note: switching to '1f941761d08add4455f209f0f2e36f8151f834a0'. 2024-04-01T22:35:23.645 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-04-01T22:35:23.645 INFO:tasks.workunit.client.0.smithi047.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-01T22:35:23.645 INFO:tasks.workunit.client.0.smithi047.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-01T22:35:23.645 INFO:tasks.workunit.client.0.smithi047.stderr:state without impacting any branches by switching back to a branch. 2024-04-01T22:35:23.645 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-04-01T22:35:23.646 INFO:tasks.workunit.client.0.smithi047.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-01T22:35:23.646 INFO:tasks.workunit.client.0.smithi047.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-01T22:35:23.646 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-04-01T22:35:23.646 INFO:tasks.workunit.client.0.smithi047.stderr: git switch -c 2024-04-01T22:35:23.646 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-04-01T22:35:23.646 INFO:tasks.workunit.client.0.smithi047.stderr:Or undo this operation with: 2024-04-01T22:35:23.646 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-04-01T22:35:23.646 INFO:tasks.workunit.client.0.smithi047.stderr: git switch - 2024-04-01T22:35:23.646 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-04-01T22:35:23.646 INFO:tasks.workunit.client.0.smithi047.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-01T22:35:23.646 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-04-01T22:35:23.647 INFO:tasks.workunit.client.0.smithi047.stderr:HEAD is now at 1f941761d08 Merge branch 'squid-release-notes' of https://github.com/batrick/ceph into wip-yuri3-testing-2024-04-01-0837-squid 2024-04-01T22:35:23.651 DEBUG:teuthology.orchestra.run.smithi047:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-01T22:35:23.671 INFO:tasks.workunit.client.0.smithi047.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-01T22:35:23.673 INFO:tasks.workunit.client.0.smithi047.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-01T22:35:23.673 INFO:tasks.workunit.client.0.smithi047.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-01T22:35:24.310 INFO:tasks.workunit.client.0.smithi047.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-01T22:35:24.371 INFO:tasks.workunit.client.0.smithi047.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-01T22:35:24.410 INFO:tasks.workunit.client.0.smithi047.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-01T22:35:24.411 INFO:tasks.workunit.client.0.smithi047.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-01T22:35:24.412 INFO:tasks.workunit.client.0.smithi047.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-01T22:35:24.451 INFO:tasks.workunit.client.0.smithi047.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-01T22:35:24.455 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-01T22:35:24.455 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-01T22:35:24.509 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2024-04-01T22:35:24.510 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2024-04-01T22:35:24.511 DEBUG:teuthology.orchestra.run.smithi047:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1f941761d08add4455f209f0f2e36f8151f834a0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2024-04-01T22:35:24.739 INFO:tasks.workunit.client.0.smithi047.stderr:+ dbench 1 2024-04-01T22:35:24.750 INFO:tasks.workunit.client.0.smithi047.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-04-01T22:35:24.750 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-04-01T22:35:24.750 INFO:tasks.workunit.client.0.smithi047.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-04-01T22:35:24.757 INFO:tasks.workunit.client.0.smithi047.stdout:0 of 1 processes prepared for launch 0 sec 2024-04-01T22:35:24.857 INFO:tasks.workunit.client.0.smithi047.stdout:1 of 1 processes prepared for launch 0 sec 2024-04-01T22:35:24.857 INFO:tasks.workunit.client.0.smithi047.stdout:releasing clients 2024-04-01T22:35:25.857 INFO:tasks.workunit.client.0.smithi047.stdout: 1 19 0.33 MB/sec warmup 1 sec latency 14.969 ms 2024-04-01T22:35:26.857 INFO:tasks.workunit.client.0.smithi047.stdout: 1 91 2.10 MB/sec warmup 2 sec latency 248.796 ms 2024-04-01T22:35:27.857 INFO:tasks.workunit.client.0.smithi047.stdout: 1 143 2.03 MB/sec warmup 3 sec latency 189.227 ms 2024-04-01T22:35:28.857 INFO:tasks.workunit.client.0.smithi047.stdout: 1 181 1.83 MB/sec warmup 4 sec latency 201.670 ms 2024-04-01T22:35:29.857 INFO:tasks.workunit.client.0.smithi047.stdout: 1 221 1.71 MB/sec warmup 5 sec latency 206.082 ms 2024-04-01T22:35:30.857 INFO:tasks.workunit.client.0.smithi047.stdout: 1 263 1.65 MB/sec warmup 6 sec latency 188.523 ms 2024-04-01T22:35:31.857 INFO:tasks.workunit.client.0.smithi047.stdout: 1 297 1.57 MB/sec warmup 7 sec latency 195.381 ms 2024-04-01T22:35:32.857 INFO:tasks.workunit.client.0.smithi047.stdout: 1 331 1.50 MB/sec warmup 8 sec latency 233.009 ms 2024-04-01T22:35:33.857 INFO:tasks.workunit.client.0.smithi047.stdout: 1 373 1.48 MB/sec warmup 9 sec latency 235.031 ms 2024-04-01T22:35:34.857 INFO:tasks.workunit.client.0.smithi047.stdout: 1 397 1.41 MB/sec warmup 10 sec latency 316.980 ms 2024-04-01T22:35:35.857 INFO:tasks.workunit.client.0.smithi047.stdout: 1 434 1.39 MB/sec warmup 11 sec latency 350.561 ms 2024-04-01T22:35:36.857 INFO:tasks.workunit.client.0.smithi047.stdout: 1 461 1.35 MB/sec warmup 12 sec latency 348.010 ms 2024-04-01T22:35:37.857 INFO:tasks.workunit.client.0.smithi047.stdout: 1 494 1.32 MB/sec warmup 13 sec latency 299.072 ms 2024-04-01T22:35:38.857 INFO:tasks.workunit.client.0.smithi047.stdout: 1 542 1.36 MB/sec warmup 14 sec latency 294.316 ms 2024-04-01T22:35:39.857 INFO:tasks.workunit.client.0.smithi047.stdout: 1 609 1.40 MB/sec warmup 15 sec latency 267.205 ms 2024-04-01T22:35:40.857 INFO:tasks.workunit.client.0.smithi047.stdout: 1 644 1.32 MB/sec warmup 16 sec latency 398.484 ms 2024-04-01T22:35:41.857 INFO:tasks.workunit.client.0.smithi047.stdout: 1 653 1.24 MB/sec warmup 17 sec latency 503.961 ms 2024-04-01T22:35:42.095 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:35:42.097 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:35:42.857 INFO:tasks.workunit.client.0.smithi047.stdout: 1 670 1.18 MB/sec warmup 18 sec latency 468.609 ms 2024-04-01T22:35:43.857 INFO:tasks.workunit.client.0.smithi047.stdout: 1 682 1.11 MB/sec warmup 19 sec latency 479.913 ms 2024-04-01T22:35:44.857 INFO:tasks.workunit.client.0.smithi047.stdout: 1 711 1.06 MB/sec warmup 20 sec latency 413.732 ms 2024-04-01T22:35:45.858 INFO:tasks.workunit.client.0.smithi047.stdout: 1 744 1.02 MB/sec warmup 21 sec latency 300.675 ms 2024-04-01T22:35:46.858 INFO:tasks.workunit.client.0.smithi047.stdout: 1 774 0.97 MB/sec warmup 22 sec latency 334.126 ms 2024-04-01T22:35:47.858 INFO:tasks.workunit.client.0.smithi047.stdout: 1 810 0.93 MB/sec warmup 23 sec latency 250.460 ms 2024-04-01T22:35:48.858 INFO:tasks.workunit.client.0.smithi047.stdout: 1 818 0.90 MB/sec warmup 24 sec latency 344.264 ms 2024-04-01T22:35:49.858 INFO:tasks.workunit.client.0.smithi047.stdout: 1 853 0.86 MB/sec warmup 25 sec latency 389.306 ms 2024-04-01T22:35:50.858 INFO:tasks.workunit.client.0.smithi047.stdout: 1 862 0.83 MB/sec warmup 26 sec latency 430.935 ms 2024-04-01T22:35:51.858 INFO:tasks.workunit.client.0.smithi047.stdout: 1 880 0.80 MB/sec warmup 27 sec latency 385.154 ms 2024-04-01T22:35:52.858 INFO:tasks.workunit.client.0.smithi047.stdout: 1 904 0.77 MB/sec warmup 28 sec latency 356.179 ms 2024-04-01T22:35:53.858 INFO:tasks.workunit.client.0.smithi047.stdout: 1 928 0.75 MB/sec warmup 29 sec latency 325.403 ms 2024-04-01T22:35:54.858 INFO:tasks.workunit.client.0.smithi047.stdout: 1 931 0.73 MB/sec warmup 30 sec latency 507.933 ms 2024-04-01T22:35:55.858 INFO:tasks.workunit.client.0.smithi047.stdout: 1 949 0.70 MB/sec warmup 31 sec latency 534.892 ms 2024-04-01T22:35:56.858 INFO:tasks.workunit.client.0.smithi047.stdout: 1 981 0.68 MB/sec warmup 32 sec latency 290.212 ms 2024-04-01T22:35:57.859 INFO:tasks.workunit.client.0.smithi047.stdout: 1 1027 0.69 MB/sec warmup 33 sec latency 353.235 ms 2024-04-01T22:35:58.858 INFO:tasks.workunit.client.0.smithi047.stdout: 1 1041 0.67 MB/sec warmup 34 sec latency 364.214 ms 2024-04-01T22:35:59.858 INFO:tasks.workunit.client.0.smithi047.stdout: 1 1048 0.65 MB/sec warmup 35 sec latency 355.334 ms 2024-04-01T22:36:00.858 INFO:tasks.workunit.client.0.smithi047.stdout: 1 1073 0.64 MB/sec warmup 36 sec latency 358.085 ms 2024-04-01T22:36:01.858 INFO:tasks.workunit.client.0.smithi047.stdout: 1 1099 0.62 MB/sec warmup 37 sec latency 396.564 ms 2024-04-01T22:36:02.858 INFO:tasks.workunit.client.0.smithi047.stdout: 1 1116 0.60 MB/sec warmup 38 sec latency 364.244 ms 2024-04-01T22:36:03.858 INFO:tasks.workunit.client.0.smithi047.stdout: 1 1149 0.59 MB/sec warmup 39 sec latency 226.465 ms 2024-04-01T22:36:04.858 INFO:tasks.workunit.client.0.smithi047.stdout: 1 1168 0.58 MB/sec warmup 40 sec latency 363.529 ms 2024-04-01T22:36:05.858 INFO:tasks.workunit.client.0.smithi047.stdout: 1 1170 0.56 MB/sec warmup 41 sec latency 484.715 ms 2024-04-01T22:36:06.858 INFO:tasks.workunit.client.0.smithi047.stdout: 1 1194 0.55 MB/sec warmup 42 sec latency 357.857 ms 2024-04-01T22:36:07.858 INFO:tasks.workunit.client.0.smithi047.stdout: 1 1215 0.54 MB/sec warmup 43 sec latency 333.536 ms 2024-04-01T22:36:08.858 INFO:tasks.workunit.client.0.smithi047.stdout: 1 1248 0.52 MB/sec warmup 44 sec latency 245.967 ms 2024-04-01T22:36:09.858 INFO:tasks.workunit.client.0.smithi047.stdout: 1 1277 0.51 MB/sec warmup 45 sec latency 374.592 ms 2024-04-01T22:36:10.858 INFO:tasks.workunit.client.0.smithi047.stdout: 1 1281 0.50 MB/sec warmup 46 sec latency 358.162 ms 2024-04-01T22:36:11.858 INFO:tasks.workunit.client.0.smithi047.stdout: 1 1376 0.55 MB/sec warmup 47 sec latency 343.485 ms 2024-04-01T22:36:12.167 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:36:12.170 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:36:12.859 INFO:tasks.workunit.client.0.smithi047.stdout: 1 1381 0.54 MB/sec warmup 48 sec latency 376.758 ms 2024-04-01T22:36:13.859 INFO:tasks.workunit.client.0.smithi047.stdout: 1 1397 0.53 MB/sec warmup 49 sec latency 345.433 ms 2024-04-01T22:36:14.859 INFO:tasks.workunit.client.0.smithi047.stdout: 1 1417 0.52 MB/sec warmup 50 sec latency 398.218 ms 2024-04-01T22:36:15.859 INFO:tasks.workunit.client.0.smithi047.stdout: 1 1446 0.51 MB/sec warmup 51 sec latency 434.750 ms 2024-04-01T22:36:16.859 INFO:tasks.workunit.client.0.smithi047.stdout: 1 1466 0.50 MB/sec warmup 52 sec latency 342.778 ms 2024-04-01T22:36:17.859 INFO:tasks.workunit.client.0.smithi047.stdout: 1 1486 0.49 MB/sec warmup 53 sec latency 364.792 ms 2024-04-01T22:36:18.859 INFO:tasks.workunit.client.0.smithi047.stdout: 1 1501 0.48 MB/sec warmup 54 sec latency 370.430 ms 2024-04-01T22:36:19.859 INFO:tasks.workunit.client.0.smithi047.stdout: 1 1526 0.47 MB/sec warmup 55 sec latency 206.385 ms 2024-04-01T22:36:20.859 INFO:tasks.workunit.client.0.smithi047.stdout: 1 1553 0.47 MB/sec warmup 56 sec latency 371.708 ms 2024-04-01T22:36:21.859 INFO:tasks.workunit.client.0.smithi047.stdout: 1 1574 0.46 MB/sec warmup 57 sec latency 370.365 ms 2024-04-01T22:36:22.859 INFO:tasks.workunit.client.0.smithi047.stdout: 1 1600 0.45 MB/sec warmup 58 sec latency 325.806 ms 2024-04-01T22:36:23.859 INFO:tasks.workunit.client.0.smithi047.stdout: 1 1610 0.44 MB/sec warmup 59 sec latency 363.998 ms 2024-04-01T22:36:24.859 INFO:tasks.workunit.client.0.smithi047.stdout: 1 1632 0.44 MB/sec warmup 60 sec latency 360.460 ms 2024-04-01T22:36:25.859 INFO:tasks.workunit.client.0.smithi047.stdout: 1 1644 0.43 MB/sec warmup 61 sec latency 367.961 ms 2024-04-01T22:36:26.859 INFO:tasks.workunit.client.0.smithi047.stdout: 1 1686 0.42 MB/sec warmup 62 sec latency 352.197 ms 2024-04-01T22:36:27.859 INFO:tasks.workunit.client.0.smithi047.stdout: 1 1701 0.42 MB/sec warmup 63 sec latency 334.065 ms 2024-04-01T22:36:28.860 INFO:tasks.workunit.client.0.smithi047.stdout: 1 1758 0.41 MB/sec warmup 64 sec latency 349.240 ms 2024-04-01T22:36:29.859 INFO:tasks.workunit.client.0.smithi047.stdout: 1 1783 0.40 MB/sec warmup 65 sec latency 355.673 ms 2024-04-01T22:36:30.859 INFO:tasks.workunit.client.0.smithi047.stdout: 1 1817 0.40 MB/sec warmup 66 sec latency 367.717 ms 2024-04-01T22:36:31.859 INFO:tasks.workunit.client.0.smithi047.stdout: 1 1826 0.39 MB/sec warmup 67 sec latency 388.279 ms 2024-04-01T22:36:32.859 INFO:tasks.workunit.client.0.smithi047.stdout: 1 1841 0.39 MB/sec warmup 68 sec latency 353.304 ms 2024-04-01T22:36:33.859 INFO:tasks.workunit.client.0.smithi047.stdout: 1 1862 0.38 MB/sec warmup 69 sec latency 351.719 ms 2024-04-01T22:36:34.859 INFO:tasks.workunit.client.0.smithi047.stdout: 1 1869 0.38 MB/sec warmup 70 sec latency 530.683 ms 2024-04-01T22:36:35.859 INFO:tasks.workunit.client.0.smithi047.stdout: 1 1903 0.37 MB/sec warmup 71 sec latency 579.258 ms 2024-04-01T22:36:36.859 INFO:tasks.workunit.client.0.smithi047.stdout: 1 1920 0.37 MB/sec warmup 72 sec latency 366.367 ms 2024-04-01T22:36:37.859 INFO:tasks.workunit.client.0.smithi047.stdout: 1 1973 0.36 MB/sec warmup 73 sec latency 364.723 ms 2024-04-01T22:36:38.860 INFO:tasks.workunit.client.0.smithi047.stdout: 1 1997 0.36 MB/sec warmup 74 sec latency 340.380 ms 2024-04-01T22:36:39.860 INFO:tasks.workunit.client.0.smithi047.stdout: 1 2034 0.35 MB/sec warmup 75 sec latency 362.570 ms 2024-04-01T22:36:40.860 INFO:tasks.workunit.client.0.smithi047.stdout: 1 2051 0.35 MB/sec warmup 76 sec latency 375.943 ms 2024-04-01T22:36:41.860 INFO:tasks.workunit.client.0.smithi047.stdout: 1 2061 0.35 MB/sec warmup 77 sec latency 358.547 ms 2024-04-01T22:36:42.247 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:36:42.249 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:36:42.860 INFO:tasks.workunit.client.0.smithi047.stdout: 1 2081 0.34 MB/sec warmup 78 sec latency 392.012 ms 2024-04-01T22:36:43.860 INFO:tasks.workunit.client.0.smithi047.stdout: 1 2096 0.34 MB/sec warmup 79 sec latency 421.661 ms 2024-04-01T22:36:44.860 INFO:tasks.workunit.client.0.smithi047.stdout: 1 2138 0.33 MB/sec warmup 80 sec latency 428.212 ms 2024-04-01T22:36:45.860 INFO:tasks.workunit.client.0.smithi047.stdout: 1 2148 0.33 MB/sec warmup 81 sec latency 386.420 ms 2024-04-01T22:36:46.860 INFO:tasks.workunit.client.0.smithi047.stdout: 1 2175 0.33 MB/sec warmup 82 sec latency 358.464 ms 2024-04-01T22:36:47.860 INFO:tasks.workunit.client.0.smithi047.stdout: 1 2198 0.32 MB/sec warmup 83 sec latency 370.470 ms 2024-04-01T22:36:48.860 INFO:tasks.workunit.client.0.smithi047.stdout: 1 2221 0.32 MB/sec warmup 84 sec latency 337.301 ms 2024-04-01T22:36:49.860 INFO:tasks.workunit.client.0.smithi047.stdout: 1 2292 0.33 MB/sec warmup 85 sec latency 373.036 ms 2024-04-01T22:36:50.860 INFO:tasks.workunit.client.0.smithi047.stdout: 1 2303 0.32 MB/sec warmup 86 sec latency 376.930 ms 2024-04-01T22:36:51.860 INFO:tasks.workunit.client.0.smithi047.stdout: 1 2321 0.32 MB/sec warmup 87 sec latency 370.424 ms 2024-04-01T22:36:52.860 INFO:tasks.workunit.client.0.smithi047.stdout: 1 2334 0.32 MB/sec warmup 88 sec latency 370.397 ms 2024-04-01T22:36:53.860 INFO:tasks.workunit.client.0.smithi047.stdout: 1 2345 0.31 MB/sec warmup 89 sec latency 339.723 ms 2024-04-01T22:36:54.860 INFO:tasks.workunit.client.0.smithi047.stdout: 1 2362 0.31 MB/sec warmup 90 sec latency 335.406 ms 2024-04-01T22:36:55.860 INFO:tasks.workunit.client.0.smithi047.stdout: 1 2366 0.31 MB/sec warmup 91 sec latency 882.847 ms 2024-04-01T22:36:56.860 INFO:tasks.workunit.client.0.smithi047.stdout: 1 2376 0.30 MB/sec warmup 92 sec latency 368.051 ms 2024-04-01T22:36:57.860 INFO:tasks.workunit.client.0.smithi047.stdout: 1 2394 0.30 MB/sec warmup 93 sec latency 347.118 ms 2024-04-01T22:36:58.860 INFO:tasks.workunit.client.0.smithi047.stdout: 1 2410 0.30 MB/sec warmup 94 sec latency 241.879 ms 2024-04-01T22:36:59.861 INFO:tasks.workunit.client.0.smithi047.stdout: 1 2431 0.30 MB/sec warmup 95 sec latency 357.530 ms 2024-04-01T22:37:00.860 INFO:tasks.workunit.client.0.smithi047.stdout: 1 2441 0.29 MB/sec warmup 96 sec latency 392.908 ms 2024-04-01T22:37:01.860 INFO:tasks.workunit.client.0.smithi047.stdout: 1 2470 0.30 MB/sec warmup 97 sec latency 148.347 ms 2024-04-01T22:37:02.860 INFO:tasks.workunit.client.0.smithi047.stdout: 1 2492 0.29 MB/sec warmup 98 sec latency 339.369 ms 2024-04-01T22:37:03.860 INFO:tasks.workunit.client.0.smithi047.stdout: 1 2502 0.29 MB/sec warmup 99 sec latency 378.217 ms 2024-04-01T22:37:04.861 INFO:tasks.workunit.client.0.smithi047.stdout: 1 2551 0.29 MB/sec warmup 100 sec latency 372.850 ms 2024-04-01T22:37:05.860 INFO:tasks.workunit.client.0.smithi047.stdout: 1 2560 0.29 MB/sec warmup 101 sec latency 448.640 ms 2024-04-01T22:37:06.860 INFO:tasks.workunit.client.0.smithi047.stdout: 1 2580 0.28 MB/sec warmup 102 sec latency 357.205 ms 2024-04-01T22:37:07.861 INFO:tasks.workunit.client.0.smithi047.stdout: 1 2596 0.28 MB/sec warmup 103 sec latency 412.966 ms 2024-04-01T22:37:08.861 INFO:tasks.workunit.client.0.smithi047.stdout: 1 2607 0.28 MB/sec warmup 104 sec latency 328.583 ms 2024-04-01T22:37:09.861 INFO:tasks.workunit.client.0.smithi047.stdout: 1 2617 0.28 MB/sec warmup 105 sec latency 351.352 ms 2024-04-01T22:37:10.861 INFO:tasks.workunit.client.0.smithi047.stdout: 1 2717 0.30 MB/sec warmup 106 sec latency 359.645 ms 2024-04-01T22:37:11.861 INFO:tasks.workunit.client.0.smithi047.stdout: 1 2750 0.30 MB/sec warmup 107 sec latency 371.057 ms 2024-04-01T22:37:12.361 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:37:12.363 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:37:12.861 INFO:tasks.workunit.client.0.smithi047.stdout: 1 2764 0.30 MB/sec warmup 108 sec latency 372.717 ms 2024-04-01T22:37:13.861 INFO:tasks.workunit.client.0.smithi047.stdout: 1 2784 0.29 MB/sec warmup 109 sec latency 345.571 ms 2024-04-01T22:37:14.861 INFO:tasks.workunit.client.0.smithi047.stdout: 1 2880 0.29 MB/sec warmup 110 sec latency 350.292 ms 2024-04-01T22:37:15.861 INFO:tasks.workunit.client.0.smithi047.stdout: 1 2917 0.30 MB/sec warmup 111 sec latency 239.472 ms 2024-04-01T22:37:16.861 INFO:tasks.workunit.client.0.smithi047.stdout: 1 2938 0.30 MB/sec warmup 112 sec latency 212.277 ms 2024-04-01T22:37:17.861 INFO:tasks.workunit.client.0.smithi047.stdout: 1 2974 0.30 MB/sec warmup 113 sec latency 347.401 ms 2024-04-01T22:37:18.861 INFO:tasks.workunit.client.0.smithi047.stdout: 1 2984 0.29 MB/sec warmup 114 sec latency 453.630 ms 2024-04-01T22:37:19.861 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3000 0.29 MB/sec warmup 115 sec latency 346.481 ms 2024-04-01T22:37:20.861 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3024 0.29 MB/sec warmup 116 sec latency 233.228 ms 2024-04-01T22:37:21.861 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3169 0.29 MB/sec warmup 117 sec latency 358.524 ms 2024-04-01T22:37:22.861 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3188 0.29 MB/sec warmup 118 sec latency 311.104 ms 2024-04-01T22:37:23.861 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3232 0.29 MB/sec warmup 119 sec latency 326.671 ms 2024-04-01T22:37:25.861 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3281 0.02 MB/sec execute 1 sec latency 361.292 ms 2024-04-01T22:37:26.861 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3285 0.01 MB/sec execute 2 sec latency 352.612 ms 2024-04-01T22:37:27.861 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3290 0.01 MB/sec execute 3 sec latency 388.641 ms 2024-04-01T22:37:28.861 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3292 0.00 MB/sec execute 4 sec latency 445.048 ms 2024-04-01T22:37:29.861 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3295 0.00 MB/sec execute 5 sec latency 416.449 ms 2024-04-01T22:37:30.861 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3299 0.00 MB/sec execute 6 sec latency 573.958 ms 2024-04-01T22:37:31.861 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3307 0.01 MB/sec execute 7 sec latency 402.417 ms 2024-04-01T22:37:32.862 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3309 0.00 MB/sec execute 8 sec latency 368.381 ms 2024-04-01T22:37:33.862 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3312 0.00 MB/sec execute 9 sec latency 364.027 ms 2024-04-01T22:37:34.862 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3316 0.00 MB/sec execute 10 sec latency 375.776 ms 2024-04-01T22:37:35.862 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3319 0.00 MB/sec execute 11 sec latency 506.054 ms 2024-04-01T22:37:36.862 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3322 0.00 MB/sec execute 12 sec latency 367.413 ms 2024-04-01T22:37:37.862 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3325 0.00 MB/sec execute 13 sec latency 356.407 ms 2024-04-01T22:37:38.862 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3330 0.00 MB/sec execute 14 sec latency 352.341 ms 2024-04-01T22:37:39.862 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3333 0.00 MB/sec execute 15 sec latency 357.085 ms 2024-04-01T22:37:40.862 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3336 0.00 MB/sec execute 16 sec latency 361.469 ms 2024-04-01T22:37:41.862 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3343 0.00 MB/sec execute 17 sec latency 365.659 ms 2024-04-01T22:37:42.600 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:37:42.603 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:37:42.862 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3366 0.01 MB/sec execute 18 sec latency 174.420 ms 2024-04-01T22:37:43.862 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3391 0.01 MB/sec execute 19 sec latency 140.973 ms 2024-04-01T22:37:44.862 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3395 0.01 MB/sec execute 20 sec latency 380.897 ms 2024-04-01T22:37:45.862 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3504 0.14 MB/sec execute 21 sec latency 468.792 ms 2024-04-01T22:37:46.862 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3531 0.14 MB/sec execute 22 sec latency 290.741 ms 2024-04-01T22:37:47.862 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3557 0.13 MB/sec execute 23 sec latency 348.845 ms 2024-04-01T22:37:48.862 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3572 0.13 MB/sec execute 24 sec latency 407.617 ms 2024-04-01T22:37:49.862 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3588 0.12 MB/sec execute 25 sec latency 409.759 ms 2024-04-01T22:37:50.862 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3634 0.13 MB/sec execute 26 sec latency 416.878 ms 2024-04-01T22:37:51.862 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3650 0.12 MB/sec execute 27 sec latency 397.512 ms 2024-04-01T22:37:52.862 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3672 0.12 MB/sec execute 28 sec latency 356.226 ms 2024-04-01T22:37:53.862 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3688 0.12 MB/sec execute 29 sec latency 373.815 ms 2024-04-01T22:37:54.862 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3708 0.12 MB/sec execute 30 sec latency 153.585 ms 2024-04-01T22:37:55.862 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3758 0.14 MB/sec execute 31 sec latency 215.890 ms 2024-04-01T22:37:56.862 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3774 0.14 MB/sec execute 32 sec latency 429.790 ms 2024-04-01T22:37:57.862 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3789 0.13 MB/sec execute 33 sec latency 211.372 ms 2024-04-01T22:37:58.862 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3796 0.13 MB/sec execute 34 sec latency 213.397 ms 2024-04-01T22:37:59.862 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3811 0.13 MB/sec execute 35 sec latency 216.501 ms 2024-04-01T22:38:00.862 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3822 0.12 MB/sec execute 36 sec latency 328.280 ms 2024-04-01T22:38:01.863 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3836 0.12 MB/sec execute 37 sec latency 160.232 ms 2024-04-01T22:38:02.863 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3851 0.12 MB/sec execute 38 sec latency 185.916 ms 2024-04-01T22:38:03.862 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3864 0.11 MB/sec execute 39 sec latency 195.055 ms 2024-04-01T22:38:04.863 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3876 0.11 MB/sec execute 40 sec latency 349.126 ms 2024-04-01T22:38:05.863 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3896 0.12 MB/sec execute 41 sec latency 396.302 ms 2024-04-01T22:38:06.863 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3903 0.11 MB/sec execute 42 sec latency 343.646 ms 2024-04-01T22:38:07.863 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3922 0.11 MB/sec execute 43 sec latency 362.372 ms 2024-04-01T22:38:08.863 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3936 0.11 MB/sec execute 44 sec latency 183.172 ms 2024-04-01T22:38:09.863 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3944 0.11 MB/sec execute 45 sec latency 216.814 ms 2024-04-01T22:38:10.863 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3956 0.10 MB/sec execute 46 sec latency 315.862 ms 2024-04-01T22:38:11.863 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3971 0.10 MB/sec execute 47 sec latency 166.715 ms 2024-04-01T22:38:12.658 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:38:12.661 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:38:12.863 INFO:tasks.workunit.client.0.smithi047.stdout: 1 3987 0.10 MB/sec execute 48 sec latency 178.605 ms 2024-04-01T22:38:13.863 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4001 0.10 MB/sec execute 49 sec latency 204.746 ms 2024-04-01T22:38:14.863 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4016 0.09 MB/sec execute 50 sec latency 171.479 ms 2024-04-01T22:38:15.863 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4027 0.09 MB/sec execute 51 sec latency 337.748 ms 2024-04-01T22:38:16.863 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4035 0.09 MB/sec execute 52 sec latency 367.938 ms 2024-04-01T22:38:17.863 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4047 0.09 MB/sec execute 53 sec latency 385.600 ms 2024-04-01T22:38:18.863 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4062 0.09 MB/sec execute 54 sec latency 360.812 ms 2024-04-01T22:38:19.863 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4082 0.09 MB/sec execute 55 sec latency 356.614 ms 2024-04-01T22:38:20.863 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4096 0.09 MB/sec execute 56 sec latency 560.391 ms 2024-04-01T22:38:21.863 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4118 0.08 MB/sec execute 57 sec latency 165.607 ms 2024-04-01T22:38:22.863 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4147 0.08 MB/sec execute 58 sec latency 89.285 ms 2024-04-01T22:38:23.863 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4165 0.08 MB/sec execute 59 sec latency 185.375 ms 2024-04-01T22:38:24.863 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4176 0.08 MB/sec execute 60 sec latency 376.075 ms 2024-04-01T22:38:25.864 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4180 0.08 MB/sec execute 61 sec latency 840.183 ms 2024-04-01T22:38:26.864 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4216 0.08 MB/sec execute 62 sec latency 417.064 ms 2024-04-01T22:38:27.864 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4225 0.08 MB/sec execute 63 sec latency 380.024 ms 2024-04-01T22:38:28.863 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4236 0.08 MB/sec execute 64 sec latency 539.125 ms 2024-04-01T22:38:29.863 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4257 0.08 MB/sec execute 65 sec latency 356.977 ms 2024-04-01T22:38:30.864 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4283 0.08 MB/sec execute 66 sec latency 298.173 ms 2024-04-01T22:38:31.864 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4317 0.08 MB/sec execute 67 sec latency 348.181 ms 2024-04-01T22:38:32.864 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4350 0.08 MB/sec execute 68 sec latency 323.891 ms 2024-04-01T22:38:33.864 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4383 0.08 MB/sec execute 69 sec latency 270.213 ms 2024-04-01T22:38:34.864 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4391 0.08 MB/sec execute 70 sec latency 358.199 ms 2024-04-01T22:38:35.864 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4424 0.08 MB/sec execute 71 sec latency 379.684 ms 2024-04-01T22:38:36.864 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4433 0.07 MB/sec execute 72 sec latency 375.816 ms 2024-04-01T22:38:37.864 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4462 0.07 MB/sec execute 73 sec latency 346.658 ms 2024-04-01T22:38:38.864 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4496 0.08 MB/sec execute 74 sec latency 277.438 ms 2024-04-01T22:38:39.864 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4500 0.07 MB/sec execute 75 sec latency 348.933 ms 2024-04-01T22:38:40.864 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4506 0.07 MB/sec execute 76 sec latency 559.547 ms 2024-04-01T22:38:41.864 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4538 0.07 MB/sec execute 77 sec latency 360.390 ms 2024-04-01T22:38:42.786 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:38:42.788 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:38:42.864 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4563 0.07 MB/sec execute 78 sec latency 249.567 ms 2024-04-01T22:38:43.864 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4598 0.08 MB/sec execute 79 sec latency 360.748 ms 2024-04-01T22:38:44.864 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4614 0.08 MB/sec execute 80 sec latency 362.719 ms 2024-04-01T22:38:45.864 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4619 0.08 MB/sec execute 81 sec latency 377.028 ms 2024-04-01T22:38:46.864 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4656 0.08 MB/sec execute 82 sec latency 152.171 ms 2024-04-01T22:38:47.864 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4670 0.08 MB/sec execute 83 sec latency 352.158 ms 2024-04-01T22:38:48.864 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4701 0.08 MB/sec execute 84 sec latency 356.179 ms 2024-04-01T22:38:49.864 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4724 0.08 MB/sec execute 85 sec latency 293.616 ms 2024-04-01T22:38:50.864 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4735 0.08 MB/sec execute 86 sec latency 345.400 ms 2024-04-01T22:38:51.865 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4743 0.08 MB/sec execute 87 sec latency 357.383 ms 2024-04-01T22:38:52.864 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4770 0.08 MB/sec execute 88 sec latency 287.328 ms 2024-04-01T22:38:53.864 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4799 0.08 MB/sec execute 89 sec latency 359.916 ms 2024-04-01T22:38:54.864 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4818 0.08 MB/sec execute 90 sec latency 362.311 ms 2024-04-01T22:38:55.865 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4846 0.08 MB/sec execute 91 sec latency 323.244 ms 2024-04-01T22:38:56.865 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4862 0.08 MB/sec execute 92 sec latency 339.788 ms 2024-04-01T22:38:57.865 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4946 0.11 MB/sec execute 93 sec latency 361.954 ms 2024-04-01T22:38:58.865 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4959 0.10 MB/sec execute 94 sec latency 369.806 ms 2024-04-01T22:38:59.865 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4982 0.10 MB/sec execute 95 sec latency 367.747 ms 2024-04-01T22:39:00.865 INFO:tasks.workunit.client.0.smithi047.stdout: 1 4994 0.10 MB/sec execute 96 sec latency 616.134 ms 2024-04-01T22:39:01.865 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5015 0.10 MB/sec execute 97 sec latency 357.596 ms 2024-04-01T22:39:02.865 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5047 0.10 MB/sec execute 98 sec latency 362.845 ms 2024-04-01T22:39:03.865 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5056 0.10 MB/sec execute 99 sec latency 359.564 ms 2024-04-01T22:39:04.865 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5082 0.10 MB/sec execute 100 sec latency 356.680 ms 2024-04-01T22:39:05.865 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5096 0.10 MB/sec execute 101 sec latency 373.998 ms 2024-04-01T22:39:06.865 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5120 0.10 MB/sec execute 102 sec latency 344.857 ms 2024-04-01T22:39:07.865 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5151 0.10 MB/sec execute 103 sec latency 391.782 ms 2024-04-01T22:39:08.865 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5171 0.10 MB/sec execute 104 sec latency 331.676 ms 2024-04-01T22:39:09.865 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5182 0.09 MB/sec execute 105 sec latency 360.314 ms 2024-04-01T22:39:10.865 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5206 0.09 MB/sec execute 106 sec latency 531.270 ms 2024-04-01T22:39:11.865 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5218 0.09 MB/sec execute 107 sec latency 494.537 ms 2024-04-01T22:39:12.865 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5254 0.09 MB/sec execute 108 sec latency 281.891 ms 2024-04-01T22:39:12.925 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:39:12.928 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:39:13.866 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5272 0.09 MB/sec execute 109 sec latency 347.227 ms 2024-04-01T22:39:14.865 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5335 0.09 MB/sec execute 110 sec latency 355.647 ms 2024-04-01T22:39:15.865 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5367 0.09 MB/sec execute 111 sec latency 358.607 ms 2024-04-01T22:39:16.865 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5387 0.09 MB/sec execute 112 sec latency 355.295 ms 2024-04-01T22:39:17.865 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5399 0.09 MB/sec execute 113 sec latency 364.277 ms 2024-04-01T22:39:18.865 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5422 0.09 MB/sec execute 114 sec latency 322.741 ms 2024-04-01T22:39:19.865 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5430 0.09 MB/sec execute 115 sec latency 443.082 ms 2024-04-01T22:39:20.865 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5463 0.09 MB/sec execute 116 sec latency 321.526 ms 2024-04-01T22:39:21.865 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5476 0.09 MB/sec execute 117 sec latency 365.707 ms 2024-04-01T22:39:22.865 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5501 0.09 MB/sec execute 118 sec latency 368.950 ms 2024-04-01T22:39:23.865 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5540 0.09 MB/sec execute 119 sec latency 270.624 ms 2024-04-01T22:39:24.865 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5577 0.09 MB/sec execute 120 sec latency 347.137 ms 2024-04-01T22:39:25.865 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5605 0.09 MB/sec execute 121 sec latency 345.856 ms 2024-04-01T22:39:26.866 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5615 0.09 MB/sec execute 122 sec latency 364.588 ms 2024-04-01T22:39:27.866 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5641 0.08 MB/sec execute 123 sec latency 360.424 ms 2024-04-01T22:39:28.866 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5654 0.08 MB/sec execute 124 sec latency 357.596 ms 2024-04-01T22:39:29.866 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5668 0.08 MB/sec execute 125 sec latency 443.623 ms 2024-04-01T22:39:30.866 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5708 0.08 MB/sec execute 126 sec latency 367.718 ms 2024-04-01T22:39:31.866 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5735 0.08 MB/sec execute 127 sec latency 414.886 ms 2024-04-01T22:39:32.866 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5743 0.08 MB/sec execute 128 sec latency 393.445 ms 2024-04-01T22:39:33.866 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5763 0.08 MB/sec execute 129 sec latency 371.951 ms 2024-04-01T22:39:34.866 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5823 0.08 MB/sec execute 130 sec latency 367.421 ms 2024-04-01T22:39:35.866 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5857 0.09 MB/sec execute 131 sec latency 357.855 ms 2024-04-01T22:39:36.866 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5866 0.09 MB/sec execute 132 sec latency 413.465 ms 2024-04-01T22:39:37.866 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5884 0.09 MB/sec execute 133 sec latency 373.074 ms 2024-04-01T22:39:38.866 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5897 0.09 MB/sec execute 134 sec latency 355.016 ms 2024-04-01T22:39:39.866 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5918 0.09 MB/sec execute 135 sec latency 329.715 ms 2024-04-01T22:39:40.866 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5922 0.09 MB/sec execute 136 sec latency 581.267 ms 2024-04-01T22:39:41.866 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5928 0.09 MB/sec execute 137 sec latency 361.714 ms 2024-04-01T22:39:42.866 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5949 0.09 MB/sec execute 138 sec latency 371.069 ms 2024-04-01T22:39:42.988 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:39:42.990 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:39:43.866 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5961 0.08 MB/sec execute 139 sec latency 348.070 ms 2024-04-01T22:39:44.866 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5988 0.08 MB/sec execute 140 sec latency 334.277 ms 2024-04-01T22:39:45.866 INFO:tasks.workunit.client.0.smithi047.stdout: 1 5995 0.08 MB/sec execute 141 sec latency 356.730 ms 2024-04-01T22:39:46.866 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6013 0.08 MB/sec execute 142 sec latency 177.085 ms 2024-04-01T22:39:47.866 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6044 0.09 MB/sec execute 143 sec latency 315.003 ms 2024-04-01T22:39:48.866 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6054 0.09 MB/sec execute 144 sec latency 355.191 ms 2024-04-01T22:39:49.867 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6107 0.09 MB/sec execute 145 sec latency 372.400 ms 2024-04-01T22:39:50.870 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6116 0.09 MB/sec execute 146 sec latency 498.755 ms 2024-04-01T22:39:51.866 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6132 0.09 MB/sec execute 147 sec latency 367.239 ms 2024-04-01T22:39:52.866 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6140 0.09 MB/sec execute 148 sec latency 379.714 ms 2024-04-01T22:39:53.866 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6158 0.09 MB/sec execute 149 sec latency 275.666 ms 2024-04-01T22:39:54.867 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6173 0.09 MB/sec execute 150 sec latency 334.778 ms 2024-04-01T22:39:55.867 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6179 0.09 MB/sec execute 151 sec latency 385.344 ms 2024-04-01T22:39:56.867 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6302 0.10 MB/sec execute 152 sec latency 344.547 ms 2024-04-01T22:39:57.867 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6316 0.10 MB/sec execute 153 sec latency 371.358 ms 2024-04-01T22:39:58.867 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6335 0.10 MB/sec execute 154 sec latency 386.932 ms 2024-04-01T22:39:59.867 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6427 0.10 MB/sec execute 155 sec latency 367.687 ms 2024-04-01T22:40:00.867 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6453 0.11 MB/sec execute 156 sec latency 396.821 ms 2024-04-01T22:40:01.867 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6486 0.11 MB/sec execute 157 sec latency 149.826 ms 2024-04-01T22:40:02.867 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6521 0.11 MB/sec execute 158 sec latency 353.315 ms 2024-04-01T22:40:03.867 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6530 0.11 MB/sec execute 159 sec latency 442.622 ms 2024-04-01T22:40:04.867 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6549 0.11 MB/sec execute 160 sec latency 204.317 ms 2024-04-01T22:40:05.867 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6570 0.11 MB/sec execute 161 sec latency 364.946 ms 2024-04-01T22:40:06.867 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6586 0.11 MB/sec execute 162 sec latency 239.008 ms 2024-04-01T22:40:07.867 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6730 0.11 MB/sec execute 163 sec latency 395.427 ms 2024-04-01T22:40:08.867 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6755 0.11 MB/sec execute 164 sec latency 320.286 ms 2024-04-01T22:40:09.867 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6820 0.12 MB/sec execute 165 sec latency 247.779 ms 2024-04-01T22:40:10.867 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6834 0.12 MB/sec execute 166 sec latency 459.802 ms 2024-04-01T22:40:11.867 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6836 0.11 MB/sec execute 167 sec latency 353.845 ms 2024-04-01T22:40:12.867 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6840 0.11 MB/sec execute 168 sec latency 395.285 ms 2024-04-01T22:40:13.063 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:40:13.065 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:40:13.867 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6845 0.11 MB/sec execute 169 sec latency 375.730 ms 2024-04-01T22:40:14.867 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6847 0.11 MB/sec execute 170 sec latency 511.203 ms 2024-04-01T22:40:15.867 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6849 0.11 MB/sec execute 171 sec latency 568.771 ms 2024-04-01T22:40:16.867 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6858 0.11 MB/sec execute 172 sec latency 381.403 ms 2024-04-01T22:40:17.867 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6862 0.11 MB/sec execute 173 sec latency 359.401 ms 2024-04-01T22:40:18.867 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6865 0.11 MB/sec execute 174 sec latency 359.089 ms 2024-04-01T22:40:19.868 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6868 0.11 MB/sec execute 175 sec latency 339.727 ms 2024-04-01T22:40:20.868 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6872 0.11 MB/sec execute 176 sec latency 455.578 ms 2024-04-01T22:40:21.868 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6875 0.11 MB/sec execute 177 sec latency 363.899 ms 2024-04-01T22:40:22.868 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6879 0.11 MB/sec execute 178 sec latency 354.393 ms 2024-04-01T22:40:23.868 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6881 0.11 MB/sec execute 179 sec latency 368.373 ms 2024-04-01T22:40:24.868 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6886 0.11 MB/sec execute 180 sec latency 352.841 ms 2024-04-01T22:40:25.868 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6889 0.11 MB/sec execute 181 sec latency 360.155 ms 2024-04-01T22:40:26.868 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6892 0.11 MB/sec execute 182 sec latency 372.889 ms 2024-04-01T22:40:27.868 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6909 0.10 MB/sec execute 183 sec latency 357.332 ms 2024-04-01T22:40:28.868 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6932 0.10 MB/sec execute 184 sec latency 157.809 ms 2024-04-01T22:40:29.868 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6948 0.10 MB/sec execute 185 sec latency 369.179 ms 2024-04-01T22:40:30.868 INFO:tasks.workunit.client.0.smithi047.stdout: 1 6953 0.10 MB/sec execute 186 sec latency 436.839 ms 2024-04-01T22:40:31.868 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7077 0.12 MB/sec execute 187 sec latency 134.420 ms 2024-04-01T22:40:32.868 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7099 0.12 MB/sec execute 188 sec latency 357.481 ms 2024-04-01T22:40:33.868 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7112 0.12 MB/sec execute 189 sec latency 334.543 ms 2024-04-01T22:40:34.868 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7134 0.12 MB/sec execute 190 sec latency 356.511 ms 2024-04-01T22:40:35.870 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7174 0.12 MB/sec execute 191 sec latency 479.657 ms 2024-04-01T22:40:36.868 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7190 0.12 MB/sec execute 192 sec latency 376.467 ms 2024-04-01T22:40:37.868 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7218 0.12 MB/sec execute 193 sec latency 236.365 ms 2024-04-01T22:40:38.868 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7231 0.12 MB/sec execute 194 sec latency 350.237 ms 2024-04-01T22:40:39.868 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7247 0.12 MB/sec execute 195 sec latency 378.052 ms 2024-04-01T22:40:40.868 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7280 0.12 MB/sec execute 196 sec latency 159.194 ms 2024-04-01T22:40:41.868 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7312 0.12 MB/sec execute 197 sec latency 443.969 ms 2024-04-01T22:40:42.868 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7329 0.12 MB/sec execute 198 sec latency 253.531 ms 2024-04-01T22:40:43.132 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:40:43.135 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:40:43.868 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7336 0.12 MB/sec execute 199 sec latency 226.451 ms 2024-04-01T22:40:44.868 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7349 0.12 MB/sec execute 200 sec latency 228.542 ms 2024-04-01T22:40:45.868 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7363 0.12 MB/sec execute 201 sec latency 195.092 ms 2024-04-01T22:40:46.868 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7376 0.12 MB/sec execute 202 sec latency 190.233 ms 2024-04-01T22:40:47.868 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7389 0.12 MB/sec execute 203 sec latency 267.458 ms 2024-04-01T22:40:48.868 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7404 0.12 MB/sec execute 204 sec latency 171.911 ms 2024-04-01T22:40:49.868 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7415 0.11 MB/sec execute 205 sec latency 361.948 ms 2024-04-01T22:40:50.868 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7428 0.11 MB/sec execute 206 sec latency 408.035 ms 2024-04-01T22:40:51.868 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7442 0.12 MB/sec execute 207 sec latency 330.289 ms 2024-04-01T22:40:52.869 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7461 0.11 MB/sec execute 208 sec latency 356.158 ms 2024-04-01T22:40:53.869 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7476 0.11 MB/sec execute 209 sec latency 173.821 ms 2024-04-01T22:40:54.869 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7486 0.11 MB/sec execute 210 sec latency 205.019 ms 2024-04-01T22:40:55.869 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7496 0.11 MB/sec execute 211 sec latency 360.029 ms 2024-04-01T22:40:56.869 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7511 0.11 MB/sec execute 212 sec latency 162.334 ms 2024-04-01T22:40:57.869 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7526 0.11 MB/sec execute 213 sec latency 180.932 ms 2024-04-01T22:40:58.869 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7539 0.11 MB/sec execute 214 sec latency 176.871 ms 2024-04-01T22:40:59.869 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7554 0.11 MB/sec execute 215 sec latency 165.092 ms 2024-04-01T22:41:00.869 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7570 0.11 MB/sec execute 216 sec latency 170.695 ms 2024-04-01T22:41:01.869 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7576 0.11 MB/sec execute 217 sec latency 350.068 ms 2024-04-01T22:41:02.869 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7587 0.11 MB/sec execute 218 sec latency 398.847 ms 2024-04-01T22:41:03.869 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7603 0.11 MB/sec execute 219 sec latency 361.481 ms 2024-04-01T22:41:04.869 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7615 0.11 MB/sec execute 220 sec latency 233.680 ms 2024-04-01T22:41:05.869 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7637 0.11 MB/sec execute 221 sec latency 399.307 ms 2024-04-01T22:41:06.869 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7659 0.11 MB/sec execute 222 sec latency 144.434 ms 2024-04-01T22:41:07.869 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7684 0.11 MB/sec execute 223 sec latency 164.781 ms 2024-04-01T22:41:08.869 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7704 0.11 MB/sec execute 224 sec latency 193.596 ms 2024-04-01T22:41:09.869 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7718 0.11 MB/sec execute 225 sec latency 378.692 ms 2024-04-01T22:41:10.869 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7718 0.11 MB/sec execute 226 sec latency 1068.764 ms 2024-04-01T22:41:11.869 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7728 0.11 MB/sec execute 227 sec latency 1098.117 ms 2024-04-01T22:41:12.869 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7759 0.11 MB/sec execute 228 sec latency 431.657 ms 2024-04-01T22:41:13.213 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:41:13.215 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:41:13.869 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7768 0.10 MB/sec execute 229 sec latency 550.548 ms 2024-04-01T22:41:14.869 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7796 0.10 MB/sec execute 230 sec latency 340.862 ms 2024-04-01T22:41:15.870 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7823 0.10 MB/sec execute 231 sec latency 395.053 ms 2024-04-01T22:41:16.869 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7857 0.10 MB/sec execute 232 sec latency 237.468 ms 2024-04-01T22:41:17.870 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7891 0.10 MB/sec execute 233 sec latency 345.710 ms 2024-04-01T22:41:18.870 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7924 0.10 MB/sec execute 234 sec latency 254.802 ms 2024-04-01T22:41:19.870 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7930 0.10 MB/sec execute 235 sec latency 331.540 ms 2024-04-01T22:41:20.870 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7965 0.10 MB/sec execute 236 sec latency 364.194 ms 2024-04-01T22:41:21.870 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7974 0.10 MB/sec execute 237 sec latency 441.491 ms 2024-04-01T22:41:22.870 INFO:tasks.workunit.client.0.smithi047.stdout: 1 7992 0.10 MB/sec execute 238 sec latency 368.032 ms 2024-04-01T22:41:23.870 INFO:tasks.workunit.client.0.smithi047.stdout: 1 8022 0.10 MB/sec execute 239 sec latency 356.172 ms 2024-04-01T22:41:24.870 INFO:tasks.workunit.client.0.smithi047.stdout: 1 8040 0.10 MB/sec execute 240 sec latency 330.204 ms 2024-04-01T22:41:25.870 INFO:tasks.workunit.client.0.smithi047.stdout: 1 8045 0.10 MB/sec execute 241 sec latency 384.160 ms 2024-04-01T22:41:26.870 INFO:tasks.workunit.client.0.smithi047.stdout: 1 8070 0.10 MB/sec execute 242 sec latency 350.318 ms 2024-04-01T22:41:27.870 INFO:tasks.workunit.client.0.smithi047.stdout: 1 8101 0.10 MB/sec execute 243 sec latency 261.402 ms 2024-04-01T22:41:28.870 INFO:tasks.workunit.client.0.smithi047.stdout: 1 8138 0.11 MB/sec execute 244 sec latency 399.754 ms 2024-04-01T22:41:29.870 INFO:tasks.workunit.client.0.smithi047.stdout: 1 8156 0.11 MB/sec execute 245 sec latency 337.352 ms 2024-04-01T22:41:30.870 INFO:tasks.workunit.client.0.smithi047.stdout: 1 8158 0.10 MB/sec execute 246 sec latency 373.882 ms 2024-04-01T22:41:31.870 INFO:tasks.workunit.client.0.smithi047.stdout: 1 8194 0.10 MB/sec execute 247 sec latency 361.082 ms 2024-04-01T22:41:32.870 INFO:tasks.workunit.client.0.smithi047.stdout: 1 8210 0.10 MB/sec execute 248 sec latency 388.751 ms 2024-04-01T22:41:33.870 INFO:tasks.workunit.client.0.smithi047.stdout: 1 8227 0.10 MB/sec execute 249 sec latency 366.006 ms 2024-04-01T22:41:34.870 INFO:tasks.workunit.client.0.smithi047.stdout: 1 8266 0.10 MB/sec execute 250 sec latency 215.480 ms 2024-04-01T22:41:35.870 INFO:tasks.workunit.client.0.smithi047.stdout: 1 8276 0.10 MB/sec execute 251 sec latency 530.782 ms 2024-04-01T22:41:36.870 INFO:tasks.workunit.client.0.smithi047.stdout: 1 8280 0.10 MB/sec execute 252 sec latency 432.851 ms 2024-04-01T22:41:37.870 INFO:tasks.workunit.client.0.smithi047.stdout: 1 8310 0.10 MB/sec execute 253 sec latency 175.667 ms 2024-04-01T22:41:38.870 INFO:tasks.workunit.client.0.smithi047.stdout: 1 8333 0.10 MB/sec execute 254 sec latency 339.479 ms 2024-04-01T22:41:39.870 INFO:tasks.workunit.client.0.smithi047.stdout: 1 8356 0.10 MB/sec execute 255 sec latency 289.421 ms 2024-04-01T22:41:40.870 INFO:tasks.workunit.client.0.smithi047.stdout: 1 8386 0.10 MB/sec execute 256 sec latency 323.703 ms 2024-04-01T22:41:40.927 INFO:tasks.ceph.mon.a.smithi047.stderr:==00:00:08:55.540 37051== Warning: unimplemented fcntl command: 1036 2024-04-01T22:41:40.986 INFO:tasks.ceph.mon.a.smithi047.stderr:==00:00:08:55.599 37051== Warning: unimplemented fcntl command: 1036 2024-04-01T22:41:41.027 INFO:tasks.ceph.mon.b.smithi181.stderr:==00:00:08:55.582 37187== Warning: unimplemented fcntl command: 1036 2024-04-01T22:41:41.028 INFO:tasks.ceph.mon.c.smithi181.stderr:==00:00:08:55.583 37188== Warning: unimplemented fcntl command: 1036 2024-04-01T22:41:41.084 INFO:tasks.ceph.mon.c.smithi181.stderr:==00:00:08:55.639 37188== Warning: unimplemented fcntl command: 1036 2024-04-01T22:41:41.088 INFO:tasks.ceph.mon.b.smithi181.stderr:==00:00:08:55.643 37187== Warning: unimplemented fcntl command: 1036 2024-04-01T22:41:41.416 INFO:tasks.ceph.mon.a.smithi047.stderr:==00:00:08:56.029 37051== Warning: unimplemented fcntl command: 1036 2024-04-01T22:41:41.441 INFO:tasks.ceph.mon.b.smithi181.stderr:==00:00:08:55.997 37187== Warning: unimplemented fcntl command: 1036 2024-04-01T22:41:41.465 INFO:tasks.ceph.mon.c.smithi181.stderr:==00:00:08:56.020 37188== Warning: unimplemented fcntl command: 1036 2024-04-01T22:41:41.870 INFO:tasks.workunit.client.0.smithi047.stdout: 1 8393 0.10 MB/sec execute 257 sec latency 378.224 ms 2024-04-01T22:41:42.871 INFO:tasks.workunit.client.0.smithi047.stdout: 1 8485 0.11 MB/sec execute 258 sec latency 391.926 ms 2024-04-01T22:41:43.336 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:41:43.338 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:41:43.871 INFO:tasks.workunit.client.0.smithi047.stdout: 1 8490 0.11 MB/sec execute 259 sec latency 367.440 ms 2024-04-01T22:41:44.871 INFO:tasks.workunit.client.0.smithi047.stdout: 1 8506 0.11 MB/sec execute 260 sec latency 349.195 ms 2024-04-01T22:41:45.871 INFO:tasks.workunit.client.0.smithi047.stdout: 1 8526 0.11 MB/sec execute 261 sec latency 476.972 ms 2024-04-01T22:41:46.871 INFO:tasks.workunit.client.0.smithi047.stdout: 1 8555 0.11 MB/sec execute 262 sec latency 320.384 ms 2024-04-01T22:41:47.871 INFO:tasks.workunit.client.0.smithi047.stdout: 1 8575 0.11 MB/sec execute 263 sec latency 361.257 ms 2024-04-01T22:41:48.871 INFO:tasks.workunit.client.0.smithi047.stdout: 1 8595 0.11 MB/sec execute 264 sec latency 366.449 ms 2024-04-01T22:41:49.871 INFO:tasks.workunit.client.0.smithi047.stdout: 1 8610 0.11 MB/sec execute 265 sec latency 362.368 ms 2024-04-01T22:41:50.871 INFO:tasks.workunit.client.0.smithi047.stdout: 1 8635 0.11 MB/sec execute 266 sec latency 182.706 ms 2024-04-01T22:41:51.871 INFO:tasks.workunit.client.0.smithi047.stdout: 1 8661 0.11 MB/sec execute 267 sec latency 351.262 ms 2024-04-01T22:41:52.871 INFO:tasks.workunit.client.0.smithi047.stdout: 1 8682 0.11 MB/sec execute 268 sec latency 366.741 ms 2024-04-01T22:41:53.871 INFO:tasks.workunit.client.0.smithi047.stdout: 1 8705 0.11 MB/sec execute 269 sec latency 330.021 ms 2024-04-01T22:41:54.871 INFO:tasks.workunit.client.0.smithi047.stdout: 1 8718 0.11 MB/sec execute 270 sec latency 373.673 ms 2024-04-01T22:41:55.871 INFO:tasks.workunit.client.0.smithi047.stdout: 1 8742 0.11 MB/sec execute 271 sec latency 345.900 ms 2024-04-01T22:41:56.871 INFO:tasks.workunit.client.0.smithi047.stdout: 1 8752 0.11 MB/sec execute 272 sec latency 377.915 ms 2024-04-01T22:41:57.871 INFO:tasks.workunit.client.0.smithi047.stdout: 1 8794 0.11 MB/sec execute 273 sec latency 378.343 ms 2024-04-01T22:41:58.871 INFO:tasks.workunit.client.0.smithi047.stdout: 1 8809 0.11 MB/sec execute 274 sec latency 342.554 ms 2024-04-01T22:41:59.871 INFO:tasks.workunit.client.0.smithi047.stdout: 1 8866 0.11 MB/sec execute 275 sec latency 356.151 ms 2024-04-01T22:42:00.871 INFO:tasks.workunit.client.0.smithi047.stdout: 1 8889 0.11 MB/sec execute 276 sec latency 361.222 ms 2024-04-01T22:42:01.871 INFO:tasks.workunit.client.0.smithi047.stdout: 1 8916 0.11 MB/sec execute 277 sec latency 361.828 ms 2024-04-01T22:42:02.871 INFO:tasks.workunit.client.0.smithi047.stdout: 1 8934 0.11 MB/sec execute 278 sec latency 383.559 ms 2024-04-01T22:42:03.871 INFO:tasks.workunit.client.0.smithi047.stdout: 1 8949 0.10 MB/sec execute 279 sec latency 352.694 ms 2024-04-01T22:42:04.871 INFO:tasks.workunit.client.0.smithi047.stdout: 1 8971 0.10 MB/sec execute 280 sec latency 365.460 ms 2024-04-01T22:42:05.872 INFO:tasks.workunit.client.0.smithi047.stdout: 1 8978 0.10 MB/sec execute 281 sec latency 356.938 ms 2024-04-01T22:42:06.871 INFO:tasks.workunit.client.0.smithi047.stdout: 1 9012 0.10 MB/sec execute 282 sec latency 350.968 ms 2024-04-01T22:42:07.871 INFO:tasks.workunit.client.0.smithi047.stdout: 1 9029 0.10 MB/sec execute 283 sec latency 376.709 ms 2024-04-01T22:42:08.871 INFO:tasks.workunit.client.0.smithi047.stdout: 1 9082 0.10 MB/sec execute 284 sec latency 361.050 ms 2024-04-01T22:42:09.872 INFO:tasks.workunit.client.0.smithi047.stdout: 1 9106 0.10 MB/sec execute 285 sec latency 368.552 ms 2024-04-01T22:42:10.872 INFO:tasks.workunit.client.0.smithi047.stdout: 1 9141 0.10 MB/sec execute 286 sec latency 353.160 ms 2024-04-01T22:42:11.872 INFO:tasks.workunit.client.0.smithi047.stdout: 1 9157 0.10 MB/sec execute 287 sec latency 368.077 ms 2024-04-01T22:42:12.872 INFO:tasks.workunit.client.0.smithi047.stdout: 1 9167 0.10 MB/sec execute 288 sec latency 355.680 ms 2024-04-01T22:42:13.457 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:42:13.459 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:42:13.872 INFO:tasks.workunit.client.0.smithi047.stdout: 1 9187 0.10 MB/sec execute 289 sec latency 369.341 ms 2024-04-01T22:42:14.872 INFO:tasks.workunit.client.0.smithi047.stdout: 1 9202 0.10 MB/sec execute 290 sec latency 405.772 ms 2024-04-01T22:42:15.872 INFO:tasks.workunit.client.0.smithi047.stdout: 1 9244 0.10 MB/sec execute 291 sec latency 574.320 ms 2024-04-01T22:42:16.872 INFO:tasks.workunit.client.0.smithi047.stdout: 1 9252 0.10 MB/sec execute 292 sec latency 393.221 ms 2024-04-01T22:42:17.872 INFO:tasks.workunit.client.0.smithi047.stdout: 1 9281 0.10 MB/sec execute 293 sec latency 423.551 ms 2024-04-01T22:42:18.872 INFO:tasks.workunit.client.0.smithi047.stdout: 1 9288 0.10 MB/sec execute 294 sec latency 404.108 ms 2024-04-01T22:42:19.872 INFO:tasks.workunit.client.0.smithi047.stdout: 1 9326 0.10 MB/sec execute 295 sec latency 370.168 ms 2024-04-01T22:42:20.872 INFO:tasks.workunit.client.0.smithi047.stdout: 1 9397 0.10 MB/sec execute 296 sec latency 354.052 ms 2024-04-01T22:42:21.872 INFO:tasks.workunit.client.0.smithi047.stdout: 1 9407 0.10 MB/sec execute 297 sec latency 341.030 ms 2024-04-01T22:42:22.872 INFO:tasks.workunit.client.0.smithi047.stdout: 1 9411 0.10 MB/sec execute 298 sec latency 481.827 ms 2024-04-01T22:42:23.872 INFO:tasks.workunit.client.0.smithi047.stdout: 1 9435 0.10 MB/sec execute 299 sec latency 360.678 ms 2024-04-01T22:42:24.872 INFO:tasks.workunit.client.0.smithi047.stdout: 1 9444 0.10 MB/sec execute 300 sec latency 359.454 ms 2024-04-01T22:42:25.872 INFO:tasks.workunit.client.0.smithi047.stdout: 1 9465 0.10 MB/sec execute 301 sec latency 327.226 ms 2024-04-01T22:42:26.872 INFO:tasks.workunit.client.0.smithi047.stdout: 1 9470 0.10 MB/sec execute 302 sec latency 584.415 ms 2024-04-01T22:42:27.872 INFO:tasks.workunit.client.0.smithi047.stdout: 1 9475 0.10 MB/sec execute 303 sec latency 348.135 ms 2024-04-01T22:42:28.872 INFO:tasks.workunit.client.0.smithi047.stdout: 1 9498 0.10 MB/sec execute 304 sec latency 352.707 ms 2024-04-01T22:42:29.872 INFO:tasks.workunit.client.0.smithi047.stdout: 1 9514 0.10 MB/sec execute 305 sec latency 183.060 ms 2024-04-01T22:42:30.872 INFO:tasks.workunit.client.0.smithi047.stdout: 1 9535 0.10 MB/sec execute 306 sec latency 388.585 ms 2024-04-01T22:42:31.872 INFO:tasks.workunit.client.0.smithi047.stdout: 1 9544 0.10 MB/sec execute 307 sec latency 356.137 ms 2024-04-01T22:42:32.872 INFO:tasks.workunit.client.0.smithi047.stdout: 1 9570 0.10 MB/sec execute 308 sec latency 171.637 ms 2024-04-01T22:42:33.872 INFO:tasks.workunit.client.0.smithi047.stdout: 1 9593 0.10 MB/sec execute 309 sec latency 334.411 ms 2024-04-01T22:42:34.872 INFO:tasks.workunit.client.0.smithi047.stdout: 1 9601 0.10 MB/sec execute 310 sec latency 371.920 ms 2024-04-01T22:42:35.872 INFO:tasks.workunit.client.0.smithi047.stdout: 1 9651 0.10 MB/sec execute 311 sec latency 420.785 ms 2024-04-01T22:42:36.872 INFO:tasks.workunit.client.0.smithi047.stdout: 1 9662 0.10 MB/sec execute 312 sec latency 353.750 ms 2024-04-01T22:42:37.873 INFO:tasks.workunit.client.0.smithi047.stdout: 1 9682 0.10 MB/sec execute 313 sec latency 376.311 ms 2024-04-01T22:42:38.873 INFO:tasks.workunit.client.0.smithi047.stdout: 1 9693 0.10 MB/sec execute 314 sec latency 379.494 ms 2024-04-01T22:42:39.873 INFO:tasks.workunit.client.0.smithi047.stdout: 1 9706 0.10 MB/sec execute 315 sec latency 331.426 ms 2024-04-01T22:42:40.873 INFO:tasks.workunit.client.0.smithi047.stdout: 1 9719 0.10 MB/sec execute 316 sec latency 339.197 ms 2024-04-01T22:42:41.873 INFO:tasks.workunit.client.0.smithi047.stdout: 1 9757 0.10 MB/sec execute 317 sec latency 339.650 ms 2024-04-01T22:42:42.873 INFO:tasks.workunit.client.0.smithi047.stdout: 1 9851 0.11 MB/sec execute 318 sec latency 361.741 ms 2024-04-01T22:42:43.512 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:42:43.515 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:42:43.873 INFO:tasks.workunit.client.0.smithi047.stdout: 1 9864 0.11 MB/sec execute 319 sec latency 365.142 ms 2024-04-01T22:42:44.873 INFO:tasks.workunit.client.0.smithi047.stdout: 1 9883 0.11 MB/sec execute 320 sec latency 362.409 ms 2024-04-01T22:42:45.873 INFO:tasks.workunit.client.0.smithi047.stdout: 1 9979 0.11 MB/sec execute 321 sec latency 456.469 ms 2024-04-01T22:42:46.873 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10016 0.11 MB/sec execute 322 sec latency 177.638 ms 2024-04-01T22:42:47.873 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10037 0.11 MB/sec execute 323 sec latency 224.317 ms 2024-04-01T22:42:48.873 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10073 0.11 MB/sec execute 324 sec latency 352.964 ms 2024-04-01T22:42:49.873 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10083 0.11 MB/sec execute 325 sec latency 465.465 ms 2024-04-01T22:42:50.873 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10105 0.11 MB/sec execute 326 sec latency 338.902 ms 2024-04-01T22:42:51.873 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10124 0.11 MB/sec execute 327 sec latency 232.083 ms 2024-04-01T22:42:52.873 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10268 0.11 MB/sec execute 328 sec latency 368.133 ms 2024-04-01T22:42:53.873 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10288 0.11 MB/sec execute 329 sec latency 319.961 ms 2024-04-01T22:42:54.873 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10336 0.11 MB/sec execute 330 sec latency 230.514 ms 2024-04-01T22:42:55.873 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10370 0.12 MB/sec execute 331 sec latency 461.348 ms 2024-04-01T22:42:56.873 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10381 0.12 MB/sec execute 332 sec latency 338.778 ms 2024-04-01T22:42:57.873 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10385 0.11 MB/sec execute 333 sec latency 344.584 ms 2024-04-01T22:42:58.874 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10389 0.11 MB/sec execute 334 sec latency 414.259 ms 2024-04-01T22:42:59.873 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10392 0.11 MB/sec execute 335 sec latency 429.226 ms 2024-04-01T22:43:00.873 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10394 0.11 MB/sec execute 336 sec latency 443.793 ms 2024-04-01T22:43:01.873 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10402 0.11 MB/sec execute 337 sec latency 437.791 ms 2024-04-01T22:43:02.874 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10406 0.11 MB/sec execute 338 sec latency 440.883 ms 2024-04-01T22:43:03.874 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10409 0.11 MB/sec execute 339 sec latency 358.906 ms 2024-04-01T22:43:04.874 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10412 0.11 MB/sec execute 340 sec latency 355.381 ms 2024-04-01T22:43:05.874 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10415 0.11 MB/sec execute 341 sec latency 460.616 ms 2024-04-01T22:43:06.874 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10418 0.11 MB/sec execute 342 sec latency 363.655 ms 2024-04-01T22:43:07.874 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10422 0.11 MB/sec execute 343 sec latency 375.267 ms 2024-04-01T22:43:08.874 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10425 0.11 MB/sec execute 344 sec latency 362.577 ms 2024-04-01T22:43:09.874 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10429 0.11 MB/sec execute 345 sec latency 364.202 ms 2024-04-01T22:43:10.874 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10432 0.11 MB/sec execute 346 sec latency 354.439 ms 2024-04-01T22:43:11.874 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10435 0.11 MB/sec execute 347 sec latency 352.254 ms 2024-04-01T22:43:12.874 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10451 0.11 MB/sec execute 348 sec latency 338.657 ms 2024-04-01T22:43:13.635 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:43:13.637 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:43:13.874 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10471 0.11 MB/sec execute 349 sec latency 161.727 ms 2024-04-01T22:43:14.874 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10490 0.11 MB/sec execute 350 sec latency 233.927 ms 2024-04-01T22:43:15.874 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10496 0.11 MB/sec execute 351 sec latency 470.657 ms 2024-04-01T22:43:16.874 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10611 0.12 MB/sec execute 352 sec latency 351.832 ms 2024-04-01T22:43:17.874 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10630 0.12 MB/sec execute 353 sec latency 341.441 ms 2024-04-01T22:43:18.874 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10653 0.12 MB/sec execute 354 sec latency 261.241 ms 2024-04-01T22:43:19.874 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10668 0.12 MB/sec execute 355 sec latency 337.628 ms 2024-04-01T22:43:20.874 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10709 0.12 MB/sec execute 356 sec latency 427.806 ms 2024-04-01T22:43:21.874 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10733 0.12 MB/sec execute 357 sec latency 153.422 ms 2024-04-01T22:43:22.874 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10756 0.12 MB/sec execute 358 sec latency 426.573 ms 2024-04-01T22:43:23.874 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10768 0.12 MB/sec execute 359 sec latency 340.310 ms 2024-04-01T22:43:24.874 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10786 0.12 MB/sec execute 360 sec latency 364.296 ms 2024-04-01T22:43:25.874 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10810 0.12 MB/sec execute 361 sec latency 191.088 ms 2024-04-01T22:43:26.874 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10851 0.12 MB/sec execute 362 sec latency 344.918 ms 2024-04-01T22:43:27.874 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10869 0.12 MB/sec execute 363 sec latency 250.579 ms 2024-04-01T22:43:28.874 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10880 0.12 MB/sec execute 364 sec latency 208.080 ms 2024-04-01T22:43:29.875 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10887 0.12 MB/sec execute 365 sec latency 230.108 ms 2024-04-01T22:43:30.875 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10901 0.12 MB/sec execute 366 sec latency 257.770 ms 2024-04-01T22:43:31.875 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10914 0.12 MB/sec execute 367 sec latency 176.941 ms 2024-04-01T22:43:32.875 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10929 0.12 MB/sec execute 368 sec latency 188.179 ms 2024-04-01T22:43:33.875 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10943 0.12 MB/sec execute 369 sec latency 170.649 ms 2024-04-01T22:43:34.875 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10958 0.12 MB/sec execute 370 sec latency 166.727 ms 2024-04-01T22:43:35.875 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10968 0.12 MB/sec execute 371 sec latency 371.533 ms 2024-04-01T22:43:36.875 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10986 0.12 MB/sec execute 372 sec latency 266.695 ms 2024-04-01T22:43:37.875 INFO:tasks.workunit.client.0.smithi047.stdout: 1 10997 0.12 MB/sec execute 373 sec latency 379.977 ms 2024-04-01T22:43:38.875 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11016 0.11 MB/sec execute 374 sec latency 350.983 ms 2024-04-01T22:43:39.875 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11027 0.11 MB/sec execute 375 sec latency 193.504 ms 2024-04-01T22:43:40.875 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11034 0.11 MB/sec execute 376 sec latency 284.809 ms 2024-04-01T22:43:41.875 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11049 0.11 MB/sec execute 377 sec latency 205.612 ms 2024-04-01T22:43:42.875 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11065 0.11 MB/sec execute 378 sec latency 160.381 ms 2024-04-01T22:43:43.791 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:43:43.793 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:43:43.875 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11080 0.11 MB/sec execute 379 sec latency 176.003 ms 2024-04-01T22:43:44.876 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11092 0.11 MB/sec execute 380 sec latency 187.095 ms 2024-04-01T22:43:45.875 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11108 0.11 MB/sec execute 381 sec latency 171.821 ms 2024-04-01T22:43:46.875 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11118 0.11 MB/sec execute 382 sec latency 347.096 ms 2024-04-01T22:43:47.875 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11125 0.11 MB/sec execute 383 sec latency 373.620 ms 2024-04-01T22:43:48.875 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11137 0.11 MB/sec execute 384 sec latency 350.301 ms 2024-04-01T22:43:49.875 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11154 0.11 MB/sec execute 385 sec latency 382.154 ms 2024-04-01T22:43:50.875 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11172 0.11 MB/sec execute 386 sec latency 456.783 ms 2024-04-01T22:43:51.875 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11193 0.11 MB/sec execute 387 sec latency 358.750 ms 2024-04-01T22:43:52.875 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11216 0.11 MB/sec execute 388 sec latency 156.360 ms 2024-04-01T22:43:53.875 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11239 0.11 MB/sec execute 389 sec latency 114.587 ms 2024-04-01T22:43:54.875 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11260 0.11 MB/sec execute 390 sec latency 216.242 ms 2024-04-01T22:43:55.875 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11262 0.11 MB/sec execute 391 sec latency 842.525 ms 2024-04-01T22:43:56.875 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11270 0.11 MB/sec execute 392 sec latency 1102.253 ms 2024-04-01T22:43:57.875 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11305 0.11 MB/sec execute 393 sec latency 398.080 ms 2024-04-01T22:43:58.876 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11314 0.11 MB/sec execute 394 sec latency 520.646 ms 2024-04-01T22:43:59.876 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11341 0.11 MB/sec execute 395 sec latency 369.324 ms 2024-04-01T22:44:00.876 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11355 0.11 MB/sec execute 396 sec latency 478.442 ms 2024-04-01T22:44:01.878 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11386 0.11 MB/sec execute 397 sec latency 236.169 ms 2024-04-01T22:44:02.876 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11406 0.11 MB/sec execute 398 sec latency 354.923 ms 2024-04-01T22:44:03.876 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11446 0.11 MB/sec execute 399 sec latency 327.763 ms 2024-04-01T22:44:04.876 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11473 0.11 MB/sec execute 400 sec latency 327.082 ms 2024-04-01T22:44:05.876 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11482 0.11 MB/sec execute 401 sec latency 360.724 ms 2024-04-01T22:44:06.876 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11513 0.11 MB/sec execute 402 sec latency 456.230 ms 2024-04-01T22:44:07.876 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11522 0.11 MB/sec execute 403 sec latency 418.798 ms 2024-04-01T22:44:08.876 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11551 0.11 MB/sec execute 404 sec latency 371.604 ms 2024-04-01T22:44:09.876 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11585 0.11 MB/sec execute 405 sec latency 259.579 ms 2024-04-01T22:44:10.876 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11588 0.11 MB/sec execute 406 sec latency 554.280 ms 2024-04-01T22:44:11.876 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11595 0.11 MB/sec execute 407 sec latency 344.071 ms 2024-04-01T22:44:12.876 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11624 0.11 MB/sec execute 408 sec latency 380.184 ms 2024-04-01T22:44:13.854 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:44:13.856 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:44:13.876 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11652 0.11 MB/sec execute 409 sec latency 273.146 ms 2024-04-01T22:44:14.876 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11686 0.11 MB/sec execute 410 sec latency 354.200 ms 2024-04-01T22:44:15.876 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11703 0.11 MB/sec execute 411 sec latency 366.882 ms 2024-04-01T22:44:16.876 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11710 0.11 MB/sec execute 412 sec latency 347.424 ms 2024-04-01T22:44:17.876 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11745 0.11 MB/sec execute 413 sec latency 160.529 ms 2024-04-01T22:44:18.876 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11759 0.11 MB/sec execute 414 sec latency 343.252 ms 2024-04-01T22:44:19.876 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11790 0.11 MB/sec execute 415 sec latency 344.436 ms 2024-04-01T22:44:20.233 INFO:tasks.ceph.mon.a.smithi047.stderr:==00:00:11:34.846 37051== Warning: unimplemented fcntl command: 1036 2024-04-01T22:44:20.238 INFO:tasks.ceph.mon.a.smithi047.stderr:==00:00:11:34.852 37051== Warning: unimplemented fcntl command: 1036 2024-04-01T22:44:20.249 INFO:tasks.ceph.mon.c.smithi181.stderr:==00:00:11:34.805 37188== Warning: unimplemented fcntl command: 1036 2024-04-01T22:44:20.249 INFO:tasks.ceph.mon.b.smithi181.stderr:==00:00:11:34.805 37187== Warning: unimplemented fcntl command: 1036 2024-04-01T22:44:20.252 INFO:tasks.ceph.mon.c.smithi181.stderr:==00:00:11:34.807 37188== Warning: unimplemented fcntl command: 1036 2024-04-01T22:44:20.252 INFO:tasks.ceph.mon.b.smithi181.stderr:==00:00:11:34.808 37187== Warning: unimplemented fcntl command: 1036 2024-04-01T22:44:20.336 INFO:tasks.ceph.mon.a.smithi047.stderr:==00:00:11:34.949 37051== Warning: unimplemented fcntl command: 1036 2024-04-01T22:44:20.338 INFO:tasks.ceph.mon.b.smithi181.stderr:==00:00:11:34.894 37187== Warning: unimplemented fcntl command: 1036 2024-04-01T22:44:20.339 INFO:tasks.ceph.mon.c.smithi181.stderr:==00:00:11:34.895 37188== Warning: unimplemented fcntl command: 1036 2024-04-01T22:44:20.876 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11814 0.11 MB/sec execute 416 sec latency 269.515 ms 2024-04-01T22:44:21.876 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11826 0.11 MB/sec execute 417 sec latency 352.283 ms 2024-04-01T22:44:22.876 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11836 0.11 MB/sec execute 418 sec latency 310.107 ms 2024-04-01T22:44:23.876 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11867 0.11 MB/sec execute 419 sec latency 340.638 ms 2024-04-01T22:44:24.876 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11900 0.11 MB/sec execute 420 sec latency 190.952 ms 2024-04-01T22:44:25.876 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11929 0.11 MB/sec execute 421 sec latency 372.045 ms 2024-04-01T22:44:26.876 INFO:tasks.workunit.client.0.smithi047.stdout: 1 11937 0.11 MB/sec execute 422 sec latency 384.010 ms 2024-04-01T22:44:27.876 INFO:tasks.workunit.client.0.smithi047.stdout: 1 12032 0.11 MB/sec execute 423 sec latency 367.388 ms 2024-04-01T22:44:28.877 INFO:tasks.workunit.client.0.smithi047.stdout: 1 12037 0.11 MB/sec execute 424 sec latency 377.555 ms 2024-04-01T22:44:29.877 INFO:tasks.workunit.client.0.smithi047.stdout: 1 12051 0.11 MB/sec execute 425 sec latency 354.533 ms 2024-04-01T22:44:30.877 INFO:tasks.workunit.client.0.smithi047.stdout: 1 12072 0.11 MB/sec execute 426 sec latency 525.877 ms 2024-04-01T22:44:31.877 INFO:tasks.workunit.client.0.smithi047.stdout: 1 12097 0.11 MB/sec execute 427 sec latency 342.601 ms 2024-04-01T22:44:32.877 INFO:tasks.workunit.client.0.smithi047.stdout: 1 12118 0.11 MB/sec execute 428 sec latency 356.648 ms 2024-04-01T22:44:33.877 INFO:tasks.workunit.client.0.smithi047.stdout: 1 12141 0.11 MB/sec execute 429 sec latency 365.541 ms 2024-04-01T22:44:34.877 INFO:tasks.workunit.client.0.smithi047.stdout: 1 12146 0.11 MB/sec execute 430 sec latency 334.484 ms 2024-04-01T22:44:35.877 INFO:tasks.workunit.client.0.smithi047.stdout: 1 12179 0.11 MB/sec execute 431 sec latency 361.186 ms 2024-04-01T22:44:36.877 INFO:tasks.workunit.client.0.smithi047.stdout: 1 12194 0.11 MB/sec execute 432 sec latency 344.415 ms 2024-04-01T22:44:37.877 INFO:tasks.workunit.client.0.smithi047.stdout: 1 12217 0.11 MB/sec execute 433 sec latency 419.209 ms 2024-04-01T22:44:38.877 INFO:tasks.workunit.client.0.smithi047.stdout: 1 12244 0.11 MB/sec execute 434 sec latency 95.292 ms 2024-04-01T22:44:39.877 INFO:tasks.workunit.client.0.smithi047.stdout: 1 12262 0.11 MB/sec execute 435 sec latency 341.206 ms 2024-04-01T22:44:40.877 INFO:tasks.workunit.client.0.smithi047.stdout: 1 12272 0.11 MB/sec execute 436 sec latency 345.782 ms 2024-04-01T22:44:41.877 INFO:tasks.workunit.client.0.smithi047.stdout: 1 12298 0.11 MB/sec execute 437 sec latency 384.268 ms 2024-04-01T22:44:42.877 INFO:tasks.workunit.client.0.smithi047.stdout: 1 12317 0.11 MB/sec execute 438 sec latency 359.588 ms 2024-04-01T22:44:43.877 INFO:tasks.workunit.client.0.smithi047.stdout: 1 12354 0.11 MB/sec execute 439 sec latency 285.571 ms 2024-04-01T22:44:43.976 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:44:43.979 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:44:44.877 INFO:tasks.workunit.client.0.smithi047.stdout: 1 12374 0.11 MB/sec execute 440 sec latency 358.204 ms 2024-04-01T22:44:45.877 INFO:tasks.workunit.client.0.smithi047.stdout: 1 12427 0.11 MB/sec execute 441 sec latency 232.161 ms 2024-04-01T22:44:46.877 INFO:tasks.workunit.client.0.smithi047.stdout: 1 12462 0.11 MB/sec execute 442 sec latency 338.197 ms 2024-04-01T22:44:47.877 INFO:tasks.workunit.client.0.smithi047.stdout: 1 12482 0.11 MB/sec execute 443 sec latency 359.674 ms 2024-04-01T22:44:48.877 INFO:tasks.workunit.client.0.smithi047.stdout: 1 12497 0.11 MB/sec execute 444 sec latency 360.897 ms 2024-04-01T22:44:49.877 INFO:tasks.workunit.client.0.smithi047.stdout: 1 12518 0.11 MB/sec execute 445 sec latency 368.672 ms 2024-04-01T22:44:50.877 INFO:tasks.workunit.client.0.smithi047.stdout: 1 12527 0.11 MB/sec execute 446 sec latency 346.559 ms 2024-04-01T22:44:51.877 INFO:tasks.workunit.client.0.smithi047.stdout: 1 12561 0.11 MB/sec execute 447 sec latency 394.067 ms 2024-04-01T22:44:52.877 INFO:tasks.workunit.client.0.smithi047.stdout: 1 12576 0.11 MB/sec execute 448 sec latency 377.694 ms 2024-04-01T22:44:53.877 INFO:tasks.workunit.client.0.smithi047.stdout: 1 12631 0.11 MB/sec execute 449 sec latency 343.031 ms 2024-04-01T22:44:54.877 INFO:tasks.workunit.client.0.smithi047.stdout: 1 12654 0.11 MB/sec execute 450 sec latency 368.594 ms 2024-04-01T22:44:55.877 INFO:tasks.workunit.client.0.smithi047.stdout: 1 12690 0.11 MB/sec execute 451 sec latency 352.248 ms 2024-04-01T22:44:56.877 INFO:tasks.workunit.client.0.smithi047.stdout: 1 12706 0.11 MB/sec execute 452 sec latency 369.237 ms 2024-04-01T22:44:57.877 INFO:tasks.workunit.client.0.smithi047.stdout: 1 12715 0.11 MB/sec execute 453 sec latency 380.026 ms 2024-04-01T22:44:58.877 INFO:tasks.workunit.client.0.smithi047.stdout: 1 12735 0.11 MB/sec execute 454 sec latency 402.034 ms 2024-04-01T22:44:59.877 INFO:tasks.workunit.client.0.smithi047.stdout: 1 12748 0.11 MB/sec execute 455 sec latency 385.730 ms 2024-04-01T22:45:00.877 INFO:tasks.workunit.client.0.smithi047.stdout: 1 12792 0.11 MB/sec execute 456 sec latency 426.784 ms 2024-04-01T22:45:01.878 INFO:tasks.workunit.client.0.smithi047.stdout: 1 12801 0.11 MB/sec execute 457 sec latency 355.673 ms 2024-04-01T22:45:02.878 INFO:tasks.workunit.client.0.smithi047.stdout: 1 12830 0.11 MB/sec execute 458 sec latency 410.475 ms 2024-04-01T22:45:03.878 INFO:tasks.workunit.client.0.smithi047.stdout: 1 12845 0.11 MB/sec execute 459 sec latency 386.727 ms 2024-04-01T22:45:04.878 INFO:tasks.workunit.client.0.smithi047.stdout: 1 12875 0.11 MB/sec execute 460 sec latency 294.267 ms 2024-04-01T22:45:05.878 INFO:tasks.workunit.client.0.smithi047.stdout: 1 12947 0.11 MB/sec execute 461 sec latency 375.691 ms 2024-04-01T22:45:06.878 INFO:tasks.workunit.client.0.smithi047.stdout: 1 12957 0.11 MB/sec execute 462 sec latency 348.100 ms 2024-04-01T22:45:07.878 INFO:tasks.workunit.client.0.smithi047.stdout: 1 12961 0.11 MB/sec execute 463 sec latency 546.944 ms 2024-04-01T22:45:08.878 INFO:tasks.workunit.client.0.smithi047.stdout: 1 12981 0.11 MB/sec execute 464 sec latency 405.620 ms 2024-04-01T22:45:09.878 INFO:tasks.workunit.client.0.smithi047.stdout: 1 12994 0.11 MB/sec execute 465 sec latency 355.168 ms 2024-04-01T22:45:10.878 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13015 0.11 MB/sec execute 466 sec latency 329.435 ms 2024-04-01T22:45:11.878 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13018 0.11 MB/sec execute 467 sec latency 604.379 ms 2024-04-01T22:45:12.878 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13025 0.11 MB/sec execute 468 sec latency 355.220 ms 2024-04-01T22:45:13.878 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13045 0.11 MB/sec execute 469 sec latency 369.815 ms 2024-04-01T22:45:14.114 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:45:14.117 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:45:14.878 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13064 0.11 MB/sec execute 470 sec latency 344.616 ms 2024-04-01T22:45:15.878 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13085 0.11 MB/sec execute 471 sec latency 338.547 ms 2024-04-01T22:45:16.878 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13094 0.11 MB/sec execute 472 sec latency 346.204 ms 2024-04-01T22:45:17.878 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13120 0.11 MB/sec execute 473 sec latency 180.622 ms 2024-04-01T22:45:18.878 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13143 0.11 MB/sec execute 474 sec latency 345.782 ms 2024-04-01T22:45:19.878 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13151 0.11 MB/sec execute 475 sec latency 361.513 ms 2024-04-01T22:45:20.878 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13201 0.11 MB/sec execute 476 sec latency 420.860 ms 2024-04-01T22:45:21.878 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13212 0.11 MB/sec execute 477 sec latency 376.701 ms 2024-04-01T22:45:22.878 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13232 0.11 MB/sec execute 478 sec latency 351.034 ms 2024-04-01T22:45:23.878 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13243 0.11 MB/sec execute 479 sec latency 365.655 ms 2024-04-01T22:45:24.878 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13256 0.11 MB/sec execute 480 sec latency 323.792 ms 2024-04-01T22:45:25.878 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13269 0.11 MB/sec execute 481 sec latency 381.346 ms 2024-04-01T22:45:26.878 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13274 0.11 MB/sec execute 482 sec latency 391.781 ms 2024-04-01T22:45:27.878 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13397 0.11 MB/sec execute 483 sec latency 355.279 ms 2024-04-01T22:45:28.878 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13412 0.11 MB/sec execute 484 sec latency 405.752 ms 2024-04-01T22:45:29.878 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13431 0.11 MB/sec execute 485 sec latency 246.111 ms 2024-04-01T22:45:30.878 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13529 0.11 MB/sec execute 486 sec latency 401.803 ms 2024-04-01T22:45:31.878 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13553 0.11 MB/sec execute 487 sec latency 175.205 ms 2024-04-01T22:45:32.878 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13588 0.11 MB/sec execute 488 sec latency 217.816 ms 2024-04-01T22:45:33.878 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13619 0.11 MB/sec execute 489 sec latency 359.779 ms 2024-04-01T22:45:34.878 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13634 0.11 MB/sec execute 490 sec latency 362.667 ms 2024-04-01T22:45:35.878 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13650 0.11 MB/sec execute 491 sec latency 359.727 ms 2024-04-01T22:45:36.878 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13674 0.11 MB/sec execute 492 sec latency 260.228 ms 2024-04-01T22:45:37.878 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13819 0.11 MB/sec execute 493 sec latency 335.605 ms 2024-04-01T22:45:38.878 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13838 0.11 MB/sec execute 494 sec latency 320.019 ms 2024-04-01T22:45:39.878 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13882 0.11 MB/sec execute 495 sec latency 327.424 ms 2024-04-01T22:45:40.878 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13920 0.12 MB/sec execute 496 sec latency 422.430 ms 2024-04-01T22:45:41.879 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13931 0.12 MB/sec execute 497 sec latency 337.751 ms 2024-04-01T22:45:42.879 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13934 0.12 MB/sec execute 498 sec latency 346.858 ms 2024-04-01T22:45:43.879 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13939 0.11 MB/sec execute 499 sec latency 378.713 ms 2024-04-01T22:45:44.202 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:45:44.205 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:45:44.879 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13942 0.11 MB/sec execute 500 sec latency 428.848 ms 2024-04-01T22:45:45.879 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13944 0.11 MB/sec execute 501 sec latency 441.828 ms 2024-04-01T22:45:46.879 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13948 0.11 MB/sec execute 502 sec latency 460.955 ms 2024-04-01T22:45:47.879 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13956 0.11 MB/sec execute 503 sec latency 398.331 ms 2024-04-01T22:45:48.879 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13959 0.11 MB/sec execute 504 sec latency 354.279 ms 2024-04-01T22:45:49.879 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13962 0.11 MB/sec execute 505 sec latency 351.944 ms 2024-04-01T22:45:50.881 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13965 0.11 MB/sec execute 506 sec latency 451.975 ms 2024-04-01T22:45:51.879 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13968 0.11 MB/sec execute 507 sec latency 379.384 ms 2024-04-01T22:45:52.879 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13972 0.11 MB/sec execute 508 sec latency 366.814 ms 2024-04-01T22:45:53.879 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13975 0.11 MB/sec execute 509 sec latency 364.579 ms 2024-04-01T22:45:54.879 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13979 0.11 MB/sec execute 510 sec latency 355.639 ms 2024-04-01T22:45:55.879 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13982 0.11 MB/sec execute 511 sec latency 346.629 ms 2024-04-01T22:45:56.879 INFO:tasks.workunit.client.0.smithi047.stdout: 1 13985 0.11 MB/sec execute 512 sec latency 364.203 ms 2024-04-01T22:45:57.879 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14001 0.11 MB/sec execute 513 sec latency 371.883 ms 2024-04-01T22:45:58.879 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14022 0.11 MB/sec execute 514 sec latency 145.483 ms 2024-04-01T22:45:59.879 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14042 0.11 MB/sec execute 515 sec latency 348.205 ms 2024-04-01T22:46:00.879 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14047 0.11 MB/sec execute 516 sec latency 445.659 ms 2024-04-01T22:46:01.879 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14164 0.12 MB/sec execute 517 sec latency 340.723 ms 2024-04-01T22:46:02.879 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14186 0.12 MB/sec execute 518 sec latency 363.153 ms 2024-04-01T22:46:03.879 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14204 0.12 MB/sec execute 519 sec latency 338.185 ms 2024-04-01T22:46:04.879 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14218 0.12 MB/sec execute 520 sec latency 286.728 ms 2024-04-01T22:46:05.879 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14259 0.12 MB/sec execute 521 sec latency 392.788 ms 2024-04-01T22:46:06.879 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14283 0.12 MB/sec execute 522 sec latency 153.319 ms 2024-04-01T22:46:07.879 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14305 0.12 MB/sec execute 523 sec latency 450.643 ms 2024-04-01T22:46:08.880 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14317 0.12 MB/sec execute 524 sec latency 323.877 ms 2024-04-01T22:46:09.880 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14335 0.12 MB/sec execute 525 sec latency 362.111 ms 2024-04-01T22:46:10.880 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14356 0.12 MB/sec execute 526 sec latency 170.856 ms 2024-04-01T22:46:11.880 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14399 0.12 MB/sec execute 527 sec latency 344.890 ms 2024-04-01T22:46:12.880 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14419 0.12 MB/sec execute 528 sec latency 232.385 ms 2024-04-01T22:46:13.880 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14429 0.12 MB/sec execute 529 sec latency 218.963 ms 2024-04-01T22:46:14.358 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:46:14.360 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:46:14.880 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14436 0.12 MB/sec execute 530 sec latency 229.081 ms 2024-04-01T22:46:15.880 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14451 0.12 MB/sec execute 531 sec latency 219.351 ms 2024-04-01T22:46:16.880 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14467 0.12 MB/sec execute 532 sec latency 159.587 ms 2024-04-01T22:46:17.880 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14482 0.12 MB/sec execute 533 sec latency 184.049 ms 2024-04-01T22:46:18.880 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14495 0.12 MB/sec execute 534 sec latency 163.812 ms 2024-04-01T22:46:19.880 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14509 0.12 MB/sec execute 535 sec latency 170.969 ms 2024-04-01T22:46:20.880 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14517 0.12 MB/sec execute 536 sec latency 459.698 ms 2024-04-01T22:46:21.880 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14535 0.12 MB/sec execute 537 sec latency 374.938 ms 2024-04-01T22:46:22.880 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14553 0.12 MB/sec execute 538 sec latency 379.379 ms 2024-04-01T22:46:23.880 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14566 0.12 MB/sec execute 539 sec latency 369.781 ms 2024-04-01T22:46:24.880 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14577 0.11 MB/sec execute 540 sec latency 188.677 ms 2024-04-01T22:46:25.880 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14587 0.11 MB/sec execute 541 sec latency 235.433 ms 2024-04-01T22:46:26.880 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14601 0.11 MB/sec execute 542 sec latency 204.414 ms 2024-04-01T22:46:27.880 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14615 0.11 MB/sec execute 543 sec latency 177.146 ms 2024-04-01T22:46:28.880 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14630 0.11 MB/sec execute 544 sec latency 167.207 ms 2024-04-01T22:46:29.880 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14645 0.11 MB/sec execute 545 sec latency 178.605 ms 2024-04-01T22:46:30.880 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14661 0.11 MB/sec execute 546 sec latency 174.042 ms 2024-04-01T22:46:31.880 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14671 0.11 MB/sec execute 547 sec latency 336.968 ms 2024-04-01T22:46:32.880 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14677 0.11 MB/sec execute 548 sec latency 380.030 ms 2024-04-01T22:46:33.880 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14697 0.11 MB/sec execute 549 sec latency 348.993 ms 2024-04-01T22:46:34.880 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14709 0.11 MB/sec execute 550 sec latency 342.565 ms 2024-04-01T22:46:35.880 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14722 0.11 MB/sec execute 551 sec latency 428.445 ms 2024-04-01T22:46:36.881 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14748 0.11 MB/sec execute 552 sec latency 144.845 ms 2024-04-01T22:46:37.880 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14769 0.11 MB/sec execute 553 sec latency 173.113 ms 2024-04-01T22:46:38.880 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14793 0.11 MB/sec execute 554 sec latency 181.687 ms 2024-04-01T22:46:39.880 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14809 0.11 MB/sec execute 555 sec latency 216.787 ms 2024-04-01T22:46:40.880 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14815 0.11 MB/sec execute 556 sec latency 439.652 ms 2024-04-01T22:46:41.881 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14822 0.11 MB/sec execute 557 sec latency 481.518 ms 2024-04-01T22:46:42.880 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14853 0.11 MB/sec execute 558 sec latency 441.574 ms 2024-04-01T22:46:43.881 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14862 0.11 MB/sec execute 559 sec latency 369.920 ms 2024-04-01T22:46:44.496 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:46:44.499 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:46:44.881 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14888 0.11 MB/sec execute 560 sec latency 307.670 ms 2024-04-01T22:46:45.881 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14917 0.11 MB/sec execute 561 sec latency 349.910 ms 2024-04-01T22:46:46.881 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14951 0.11 MB/sec execute 562 sec latency 291.397 ms 2024-04-01T22:46:47.881 INFO:tasks.workunit.client.0.smithi047.stdout: 1 14978 0.11 MB/sec execute 563 sec latency 344.869 ms 2024-04-01T22:46:48.881 INFO:tasks.workunit.client.0.smithi047.stdout: 1 15013 0.11 MB/sec execute 564 sec latency 246.029 ms 2024-04-01T22:46:49.881 INFO:tasks.workunit.client.0.smithi047.stdout: 1 15023 0.11 MB/sec execute 565 sec latency 337.326 ms 2024-04-01T22:46:50.881 INFO:tasks.workunit.client.0.smithi047.stdout: 1 15059 0.11 MB/sec execute 566 sec latency 354.734 ms 2024-04-01T22:46:51.881 INFO:tasks.workunit.client.0.smithi047.stdout: 1 15068 0.11 MB/sec execute 567 sec latency 432.554 ms 2024-04-01T22:46:52.881 INFO:tasks.workunit.client.0.smithi047.stdout: 1 15086 0.11 MB/sec execute 568 sec latency 353.422 ms 2024-04-01T22:46:53.881 INFO:tasks.workunit.client.0.smithi047.stdout: 1 15109 0.11 MB/sec execute 569 sec latency 341.524 ms 2024-04-01T22:46:54.881 INFO:tasks.workunit.client.0.smithi047.stdout: 1 15134 0.11 MB/sec execute 570 sec latency 338.199 ms 2024-04-01T22:46:55.881 INFO:tasks.workunit.client.0.smithi047.stdout: 1 15140 0.11 MB/sec execute 571 sec latency 336.771 ms 2024-04-01T22:46:56.881 INFO:tasks.workunit.client.0.smithi047.stdout: 1 15157 0.11 MB/sec execute 572 sec latency 479.184 ms 2024-04-01T22:46:57.881 INFO:tasks.workunit.client.0.smithi047.stdout: 1 15188 0.11 MB/sec execute 573 sec latency 301.429 ms 2024-04-01T22:46:58.881 INFO:tasks.workunit.client.0.smithi047.stdout: 1 15232 0.11 MB/sec execute 574 sec latency 368.226 ms 2024-04-01T22:46:59.881 INFO:tasks.workunit.client.0.smithi047.stdout: 1 15241 0.11 MB/sec execute 575 sec latency 393.785 ms 2024-04-01T22:47:00.881 INFO:tasks.workunit.client.0.smithi047.stdout: 1 15252 0.11 MB/sec execute 576 sec latency 343.401 ms 2024-04-01T22:47:01.881 INFO:tasks.workunit.client.0.smithi047.stdout: 1 15268 0.11 MB/sec execute 577 sec latency 380.640 ms 2024-04-01T22:47:02.881 INFO:tasks.workunit.client.0.smithi047.stdout: 1 15303 0.11 MB/sec execute 578 sec latency 399.742 ms 2024-04-01T22:47:03.881 INFO:tasks.workunit.client.0.smithi047.stdout: 1 15320 0.11 MB/sec execute 579 sec latency 368.734 ms 2024-04-01T22:47:04.881 INFO:tasks.workunit.client.0.smithi047.stdout: 1 15358 0.11 MB/sec execute 580 sec latency 215.864 ms 2024-04-01T22:47:05.881 INFO:tasks.workunit.client.0.smithi047.stdout: 1 15370 0.11 MB/sec execute 581 sec latency 349.769 ms 2024-04-01T22:47:06.881 INFO:tasks.workunit.client.0.smithi047.stdout: 1 15374 0.11 MB/sec execute 582 sec latency 488.060 ms 2024-04-01T22:47:07.882 INFO:tasks.workunit.client.0.smithi047.stdout: 1 15402 0.11 MB/sec execute 583 sec latency 160.514 ms 2024-04-01T22:47:08.881 INFO:tasks.workunit.client.0.smithi047.stdout: 1 15427 0.11 MB/sec execute 584 sec latency 342.619 ms 2024-04-01T22:47:09.881 INFO:tasks.workunit.client.0.smithi047.stdout: 1 15451 0.11 MB/sec execute 585 sec latency 265.595 ms 2024-04-01T22:47:10.881 INFO:tasks.workunit.client.0.smithi047.stdout: 1 15480 0.11 MB/sec execute 586 sec latency 358.256 ms 2024-04-01T22:47:11.881 INFO:tasks.workunit.client.0.smithi047.stdout: 1 15483 0.11 MB/sec execute 587 sec latency 527.887 ms 2024-04-01T22:47:12.881 INFO:tasks.workunit.client.0.smithi047.stdout: 1 15579 0.11 MB/sec execute 588 sec latency 376.692 ms 2024-04-01T22:47:13.882 INFO:tasks.workunit.client.0.smithi047.stdout: 1 15584 0.11 MB/sec execute 589 sec latency 378.014 ms 2024-04-01T22:47:14.560 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:47:14.562 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:47:14.882 INFO:tasks.workunit.client.0.smithi047.stdout: 1 15599 0.11 MB/sec execute 590 sec latency 356.751 ms 2024-04-01T22:47:15.882 INFO:tasks.workunit.client.0.smithi047.stdout: 1 15620 0.11 MB/sec execute 591 sec latency 366.299 ms 2024-04-01T22:47:16.882 INFO:tasks.workunit.client.0.smithi047.stdout: 1 15648 0.11 MB/sec execute 592 sec latency 198.614 ms 2024-04-01T22:47:17.882 INFO:tasks.workunit.client.0.smithi047.stdout: 1 15667 0.11 MB/sec execute 593 sec latency 357.375 ms 2024-04-01T22:47:18.882 INFO:tasks.workunit.client.0.smithi047.stdout: 1 15688 0.11 MB/sec execute 594 sec latency 359.714 ms 2024-04-01T22:47:19.882 INFO:tasks.workunit.client.0.smithi047.stdout: 1 15703 0.11 MB/sec execute 595 sec latency 362.083 ms 2024-04-01T22:47:20.882 INFO:tasks.workunit.client.0.smithi047.stdout: 1 15728 0.11 MB/sec execute 596 sec latency 200.771 ms 2024-04-01T22:47:21.882 INFO:tasks.workunit.client.0.smithi047.stdout: 1 15754 0.11 MB/sec execute 597 sec latency 364.861 ms 2024-04-01T22:47:22.882 INFO:tasks.workunit.client.0.smithi047.stdout: 1 15775 0.11 MB/sec execute 598 sec latency 355.951 ms 2024-04-01T22:47:23.882 INFO:tasks.workunit.client.0.smithi047.stdout: 1 15803 0.11 MB/sec execute 599 sec latency 319.902 ms 2024-04-01T22:47:24.882 INFO:tasks.workunit.client.0.smithi047.stdout: 1 cleanup 600 sec 2024-04-01T22:47:25.882 INFO:tasks.workunit.client.0.smithi047.stdout: 1 cleanup 601 sec 2024-04-01T22:47:26.882 INFO:tasks.workunit.client.0.smithi047.stdout: 1 cleanup 602 sec 2024-04-01T22:47:27.882 INFO:tasks.workunit.client.0.smithi047.stdout: 1 cleanup 603 sec 2024-04-01T22:47:28.882 INFO:tasks.workunit.client.0.smithi047.stdout: 1 cleanup 604 sec 2024-04-01T22:47:29.882 INFO:tasks.workunit.client.0.smithi047.stdout: 1 cleanup 605 sec 2024-04-01T22:47:30.882 INFO:tasks.workunit.client.0.smithi047.stdout: 1 cleanup 606 sec 2024-04-01T22:47:31.882 INFO:tasks.workunit.client.0.smithi047.stdout: 1 cleanup 607 sec 2024-04-01T22:47:32.882 INFO:tasks.workunit.client.0.smithi047.stdout: 1 cleanup 608 sec 2024-04-01T22:47:33.169 INFO:tasks.workunit.client.0.smithi047.stdout: 0 cleanup 608 sec 2024-04-01T22:47:33.169 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-04-01T22:47:33.169 INFO:tasks.workunit.client.0.smithi047.stdout: Operation Count AvgLat MaxLat 2024-04-01T22:47:33.169 INFO:tasks.workunit.client.0.smithi047.stdout: ---------------------------------------- 2024-04-01T22:47:33.169 INFO:tasks.workunit.client.0.smithi047.stdout: NTCreateX 2216 73.680 438.218 2024-04-01T22:47:33.169 INFO:tasks.workunit.client.0.smithi047.stdout: Close 1600 1.253 30.238 2024-04-01T22:47:33.169 INFO:tasks.workunit.client.0.smithi047.stdout: Rename 92 204.015 342.546 2024-04-01T22:47:33.169 INFO:tasks.workunit.client.0.smithi047.stdout: Unlink 468 80.376 188.278 2024-04-01T22:47:33.170 INFO:tasks.workunit.client.0.smithi047.stdout: Qpathinfo 1974 39.152 840.174 2024-04-01T22:47:33.170 INFO:tasks.workunit.client.0.smithi047.stdout: Qfileinfo 327 1.109 14.234 2024-04-01T22:47:33.170 INFO:tasks.workunit.client.0.smithi047.stdout: Qfsinfo 377 9.599 171.553 2024-04-01T22:47:33.170 INFO:tasks.workunit.client.0.smithi047.stdout: Sfileinfo 184 13.069 17.227 2024-04-01T22:47:33.170 INFO:tasks.workunit.client.0.smithi047.stdout: Find 781 359.773 1102.247 2024-04-01T22:47:33.170 INFO:tasks.workunit.client.0.smithi047.stdout: WriteX 1057 4.753 130.070 2024-04-01T22:47:33.170 INFO:tasks.workunit.client.0.smithi047.stdout: ReadX 3297 0.026 2.197 2024-04-01T22:47:33.170 INFO:tasks.workunit.client.0.smithi047.stdout: LockX 6 19.627 28.713 2024-04-01T22:47:33.170 INFO:tasks.workunit.client.0.smithi047.stdout: UnlockX 6 21.030 27.388 2024-04-01T22:47:33.170 INFO:tasks.workunit.client.0.smithi047.stdout: Flush 158 53.193 150.596 2024-04-01T22:47:33.170 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-04-01T22:47:33.170 INFO:tasks.workunit.client.0.smithi047.stdout:Throughput 0.11237 MB/sec 1 clients 1 procs max_latency=1102.253 ms 2024-04-01T22:47:33.171 INFO:tasks.workunit.client.0.smithi047.stderr:+ dbench 10 2024-04-01T22:47:33.171 INFO:tasks.workunit.client.0.smithi047.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-04-01T22:47:33.171 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-04-01T22:47:33.171 INFO:tasks.workunit.client.0.smithi047.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-04-01T22:47:33.171 INFO:tasks.workunit.client.0.smithi047.stdout:8 of 10 processes prepared for launch 0 sec 2024-04-01T22:47:33.270 INFO:tasks.workunit.client.0.smithi047.stdout:10 of 10 processes prepared for launch 0 sec 2024-04-01T22:47:33.270 INFO:tasks.workunit.client.0.smithi047.stdout:releasing clients 2024-04-01T22:47:34.270 INFO:tasks.workunit.client.0.smithi047.stdout: 0 2 0.00 MB/sec warmup 1 sec latency 999.946 ms 2024-04-01T22:47:35.270 INFO:tasks.workunit.client.0.smithi047.stdout: 0 5 0.00 MB/sec warmup 2 sec latency 1999.989 ms 2024-04-01T22:47:36.270 INFO:tasks.workunit.client.0.smithi047.stdout: 0 7 0.00 MB/sec warmup 3 sec latency 3000.034 ms 2024-04-01T22:47:37.270 INFO:tasks.workunit.client.0.smithi047.stdout: 2 13 0.52 MB/sec warmup 4 sec latency 747.368 ms 2024-04-01T22:47:38.270 INFO:tasks.workunit.client.0.smithi047.stdout: 5 26 1.65 MB/sec warmup 5 sec latency 786.634 ms 2024-04-01T22:47:39.270 INFO:tasks.workunit.client.0.smithi047.stdout: 10 43 2.83 MB/sec warmup 6 sec latency 849.293 ms 2024-04-01T22:47:40.270 INFO:tasks.workunit.client.0.smithi047.stdout: 10 56 3.37 MB/sec warmup 7 sec latency 910.040 ms 2024-04-01T22:47:41.270 INFO:tasks.workunit.client.0.smithi047.stdout: 10 72 4.01 MB/sec warmup 8 sec latency 950.290 ms 2024-04-01T22:47:42.270 INFO:tasks.workunit.client.0.smithi047.stdout: 10 87 4.39 MB/sec warmup 9 sec latency 1002.774 ms 2024-04-01T22:47:43.270 INFO:tasks.workunit.client.0.smithi047.stdout: 10 96 4.47 MB/sec warmup 10 sec latency 1007.536 ms 2024-04-01T22:47:44.271 INFO:tasks.workunit.client.0.smithi047.stdout: 10 110 4.65 MB/sec warmup 11 sec latency 1268.092 ms 2024-04-01T22:47:44.708 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:47:44.711 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:47:45.271 INFO:tasks.workunit.client.0.smithi047.stdout: 10 115 4.46 MB/sec warmup 12 sec latency 1308.009 ms 2024-04-01T22:47:46.271 INFO:tasks.workunit.client.0.smithi047.stdout: 10 120 4.21 MB/sec warmup 13 sec latency 1547.537 ms 2024-04-01T22:47:47.271 INFO:tasks.workunit.client.0.smithi047.stdout: 10 126 4.06 MB/sec warmup 14 sec latency 1708.318 ms 2024-04-01T22:47:48.271 INFO:tasks.workunit.client.0.smithi047.stdout: 10 131 3.89 MB/sec warmup 15 sec latency 1396.982 ms 2024-04-01T22:47:49.271 INFO:tasks.workunit.client.0.smithi047.stdout: 10 138 3.77 MB/sec warmup 16 sec latency 1595.415 ms 2024-04-01T22:47:50.271 INFO:tasks.workunit.client.0.smithi047.stdout: 10 143 3.63 MB/sec warmup 17 sec latency 1239.186 ms 2024-04-01T22:47:51.271 INFO:tasks.workunit.client.0.smithi047.stdout: 10 145 3.46 MB/sec warmup 18 sec latency 1578.074 ms 2024-04-01T22:47:52.271 INFO:tasks.workunit.client.0.smithi047.stdout: 10 149 3.33 MB/sec warmup 19 sec latency 1556.791 ms 2024-04-01T22:47:53.271 INFO:tasks.workunit.client.0.smithi047.stdout: 10 153 3.25 MB/sec warmup 20 sec latency 2033.254 ms 2024-04-01T22:47:54.271 INFO:tasks.workunit.client.0.smithi047.stdout: 10 160 3.18 MB/sec warmup 21 sec latency 2408.636 ms 2024-04-01T22:47:55.271 INFO:tasks.workunit.client.0.smithi047.stdout: 10 164 3.08 MB/sec warmup 22 sec latency 1438.045 ms 2024-04-01T22:47:56.271 INFO:tasks.workunit.client.0.smithi047.stdout: 10 169 3.03 MB/sec warmup 23 sec latency 2021.568 ms 2024-04-01T22:47:57.271 INFO:tasks.workunit.client.0.smithi047.stdout: 10 172 2.93 MB/sec warmup 24 sec latency 2087.794 ms 2024-04-01T22:47:58.271 INFO:tasks.workunit.client.0.smithi047.stdout: 10 179 2.91 MB/sec warmup 25 sec latency 1806.673 ms 2024-04-01T22:47:59.271 INFO:tasks.workunit.client.0.smithi047.stdout: 10 180 2.81 MB/sec warmup 26 sec latency 1510.826 ms 2024-04-01T22:48:00.271 INFO:tasks.workunit.client.0.smithi047.stdout: 10 187 2.79 MB/sec warmup 27 sec latency 1920.937 ms 2024-04-01T22:48:01.271 INFO:tasks.workunit.client.0.smithi047.stdout: 10 192 2.74 MB/sec warmup 28 sec latency 1605.156 ms 2024-04-01T22:48:02.271 INFO:tasks.workunit.client.0.smithi047.stdout: 10 195 2.69 MB/sec warmup 29 sec latency 1635.646 ms 2024-04-01T22:48:03.271 INFO:tasks.workunit.client.0.smithi047.stdout: 10 199 2.63 MB/sec warmup 30 sec latency 1936.868 ms 2024-04-01T22:48:04.271 INFO:tasks.workunit.client.0.smithi047.stdout: 10 204 2.60 MB/sec warmup 31 sec latency 2268.765 ms 2024-04-01T22:48:05.271 INFO:tasks.workunit.client.0.smithi047.stdout: 10 209 2.55 MB/sec warmup 32 sec latency 1861.888 ms 2024-04-01T22:48:06.271 INFO:tasks.workunit.client.0.smithi047.stdout: 10 214 2.53 MB/sec warmup 33 sec latency 1533.256 ms 2024-04-01T22:48:07.271 INFO:tasks.workunit.client.0.smithi047.stdout: 10 217 2.48 MB/sec warmup 34 sec latency 1995.082 ms 2024-04-01T22:48:08.271 INFO:tasks.workunit.client.0.smithi047.stdout: 10 219 2.43 MB/sec warmup 35 sec latency 2220.533 ms 2024-04-01T22:48:09.271 INFO:tasks.workunit.client.0.smithi047.stdout: 10 227 2.43 MB/sec warmup 36 sec latency 2358.908 ms 2024-04-01T22:48:10.271 INFO:tasks.workunit.client.0.smithi047.stdout: 10 232 2.42 MB/sec warmup 37 sec latency 1568.880 ms 2024-04-01T22:48:11.271 INFO:tasks.workunit.client.0.smithi047.stdout: 10 235 2.38 MB/sec warmup 38 sec latency 1601.223 ms 2024-04-01T22:48:12.271 INFO:tasks.workunit.client.0.smithi047.stdout: 10 241 2.36 MB/sec warmup 39 sec latency 1897.444 ms 2024-04-01T22:48:13.271 INFO:tasks.workunit.client.0.smithi047.stdout: 10 244 2.33 MB/sec warmup 40 sec latency 2484.659 ms 2024-04-01T22:48:14.271 INFO:tasks.workunit.client.0.smithi047.stdout: 10 249 2.31 MB/sec warmup 41 sec latency 1618.371 ms 2024-04-01T22:48:14.770 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:48:14.773 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:48:15.271 INFO:tasks.workunit.client.0.smithi047.stdout: 10 255 2.30 MB/sec warmup 42 sec latency 1968.061 ms 2024-04-01T22:48:16.272 INFO:tasks.workunit.client.0.smithi047.stdout: 10 257 2.27 MB/sec warmup 43 sec latency 1990.506 ms 2024-04-01T22:48:17.272 INFO:tasks.workunit.client.0.smithi047.stdout: 10 260 2.24 MB/sec warmup 44 sec latency 2018.406 ms 2024-04-01T22:48:18.272 INFO:tasks.workunit.client.0.smithi047.stdout: 10 263 2.21 MB/sec warmup 45 sec latency 2862.577 ms 2024-04-01T22:48:19.272 INFO:tasks.workunit.client.0.smithi047.stdout: 10 269 2.20 MB/sec warmup 46 sec latency 3127.363 ms 2024-04-01T22:48:20.272 INFO:tasks.workunit.client.0.smithi047.stdout: 10 274 2.19 MB/sec warmup 47 sec latency 1867.167 ms 2024-04-01T22:48:21.272 INFO:tasks.workunit.client.0.smithi047.stdout: 10 278 2.17 MB/sec warmup 48 sec latency 2197.899 ms 2024-04-01T22:48:22.272 INFO:tasks.workunit.client.0.smithi047.stdout: 10 283 2.16 MB/sec warmup 49 sec latency 2372.717 ms 2024-04-01T22:48:23.272 INFO:tasks.workunit.client.0.smithi047.stdout: 10 287 2.14 MB/sec warmup 50 sec latency 2217.529 ms 2024-04-01T22:48:24.272 INFO:tasks.workunit.client.0.smithi047.stdout: 10 292 2.12 MB/sec warmup 51 sec latency 2358.961 ms 2024-04-01T22:48:25.272 INFO:tasks.workunit.client.0.smithi047.stdout: 10 298 2.12 MB/sec warmup 52 sec latency 1993.543 ms 2024-04-01T22:48:26.272 INFO:tasks.workunit.client.0.smithi047.stdout: 10 301 2.10 MB/sec warmup 53 sec latency 2191.249 ms 2024-04-01T22:48:27.272 INFO:tasks.workunit.client.0.smithi047.stdout: 10 305 2.08 MB/sec warmup 54 sec latency 2609.443 ms 2024-04-01T22:48:28.272 INFO:tasks.workunit.client.0.smithi047.stdout: 10 309 2.06 MB/sec warmup 55 sec latency 2153.213 ms 2024-04-01T22:48:29.272 INFO:tasks.workunit.client.0.smithi047.stdout: 10 314 2.05 MB/sec warmup 56 sec latency 2086.510 ms 2024-04-01T22:48:29.281 INFO:tasks.ceph.mon.a.smithi047.stderr:==00:00:15:43.895 37051== Warning: unimplemented fcntl command: 1036 2024-04-01T22:48:29.284 INFO:tasks.ceph.mon.a.smithi047.stderr:==00:00:15:43.899 37051== Warning: unimplemented fcntl command: 1036 2024-04-01T22:48:29.337 INFO:tasks.ceph.mon.c.smithi181.stderr:==00:00:15:43.894 37188== Warning: unimplemented fcntl command: 1036 2024-04-01T22:48:29.342 INFO:tasks.ceph.mon.b.smithi181.stderr:==00:00:15:43.899 37187== Warning: unimplemented fcntl command: 1036 2024-04-01T22:48:29.344 INFO:tasks.ceph.mon.b.smithi181.stderr:==00:00:15:43.901 37187== Warning: unimplemented fcntl command: 1036 2024-04-01T22:48:29.344 INFO:tasks.ceph.mon.c.smithi181.stderr:==00:00:15:43.901 37188== Warning: unimplemented fcntl command: 1036 2024-04-01T22:48:29.401 INFO:tasks.ceph.mon.a.smithi047.stderr:==00:00:15:44.016 37051== Warning: unimplemented fcntl command: 1036 2024-04-01T22:48:29.427 INFO:tasks.ceph.mon.b.smithi181.stderr:==00:00:15:43.984 37187== Warning: unimplemented fcntl command: 1036 2024-04-01T22:48:29.431 INFO:tasks.ceph.mon.c.smithi181.stderr:==00:00:15:43.988 37188== Warning: unimplemented fcntl command: 1036 2024-04-01T22:48:30.272 INFO:tasks.workunit.client.0.smithi047.stdout: 10 317 2.03 MB/sec warmup 57 sec latency 1475.919 ms 2024-04-01T22:48:31.272 INFO:tasks.workunit.client.0.smithi047.stdout: 10 324 2.04 MB/sec warmup 58 sec latency 1596.514 ms 2024-04-01T22:48:32.272 INFO:tasks.workunit.client.0.smithi047.stdout: 10 326 2.01 MB/sec warmup 59 sec latency 1725.322 ms 2024-04-01T22:48:33.272 INFO:tasks.workunit.client.0.smithi047.stdout: 10 331 2.01 MB/sec warmup 60 sec latency 2087.434 ms 2024-04-01T22:48:34.272 INFO:tasks.workunit.client.0.smithi047.stdout: 10 335 1.99 MB/sec warmup 61 sec latency 1905.939 ms 2024-04-01T22:48:35.272 INFO:tasks.workunit.client.0.smithi047.stdout: 10 340 1.98 MB/sec warmup 62 sec latency 2034.485 ms 2024-04-01T22:48:36.272 INFO:tasks.workunit.client.0.smithi047.stdout: 10 346 1.98 MB/sec warmup 63 sec latency 1474.152 ms 2024-04-01T22:48:37.272 INFO:tasks.workunit.client.0.smithi047.stdout: 10 350 1.97 MB/sec warmup 64 sec latency 1787.660 ms 2024-04-01T22:48:38.272 INFO:tasks.workunit.client.0.smithi047.stdout: 10 353 1.95 MB/sec warmup 65 sec latency 2008.974 ms 2024-04-01T22:48:39.273 INFO:tasks.workunit.client.0.smithi047.stdout: 10 358 1.95 MB/sec warmup 66 sec latency 2221.791 ms 2024-04-01T22:48:40.272 INFO:tasks.workunit.client.0.smithi047.stdout: 10 364 1.94 MB/sec warmup 67 sec latency 2325.887 ms 2024-04-01T22:48:41.273 INFO:tasks.workunit.client.0.smithi047.stdout: 10 367 1.93 MB/sec warmup 68 sec latency 1645.606 ms 2024-04-01T22:48:42.272 INFO:tasks.workunit.client.0.smithi047.stdout: 10 374 1.94 MB/sec warmup 69 sec latency 1763.046 ms 2024-04-01T22:48:43.272 INFO:tasks.workunit.client.0.smithi047.stdout: 10 376 1.92 MB/sec warmup 70 sec latency 1883.969 ms 2024-04-01T22:48:44.272 INFO:tasks.workunit.client.0.smithi047.stdout: 10 382 1.92 MB/sec warmup 71 sec latency 2266.012 ms 2024-04-01T22:48:45.059 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:48:45.062 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:48:45.273 INFO:tasks.workunit.client.0.smithi047.stdout: 10 386 1.91 MB/sec warmup 72 sec latency 2098.736 ms 2024-04-01T22:48:46.272 INFO:tasks.workunit.client.0.smithi047.stdout: 10 390 1.90 MB/sec warmup 73 sec latency 1931.773 ms 2024-04-01T22:48:47.273 INFO:tasks.workunit.client.0.smithi047.stdout: 10 396 1.90 MB/sec warmup 74 sec latency 1928.364 ms 2024-04-01T22:48:48.273 INFO:tasks.workunit.client.0.smithi047.stdout: 10 398 1.89 MB/sec warmup 75 sec latency 2263.948 ms 2024-04-01T22:48:49.273 INFO:tasks.workunit.client.0.smithi047.stdout: 10 403 1.88 MB/sec warmup 76 sec latency 2402.670 ms 2024-04-01T22:48:50.273 INFO:tasks.workunit.client.0.smithi047.stdout: 10 405 1.87 MB/sec warmup 77 sec latency 2442.651 ms 2024-04-01T22:48:51.273 INFO:tasks.workunit.client.0.smithi047.stdout: 10 411 1.87 MB/sec warmup 78 sec latency 2354.527 ms 2024-04-01T22:48:52.273 INFO:tasks.workunit.client.0.smithi047.stdout: 10 414 1.85 MB/sec warmup 79 sec latency 2073.810 ms 2024-04-01T22:48:53.273 INFO:tasks.workunit.client.0.smithi047.stdout: 10 418 1.85 MB/sec warmup 80 sec latency 2239.646 ms 2024-04-01T22:48:54.273 INFO:tasks.workunit.client.0.smithi047.stdout: 10 425 1.85 MB/sec warmup 81 sec latency 2315.462 ms 2024-04-01T22:48:55.273 INFO:tasks.workunit.client.0.smithi047.stdout: 10 427 1.84 MB/sec warmup 82 sec latency 2122.309 ms 2024-04-01T22:48:56.273 INFO:tasks.workunit.client.0.smithi047.stdout: 10 432 1.84 MB/sec warmup 83 sec latency 2113.848 ms 2024-04-01T22:48:57.273 INFO:tasks.workunit.client.0.smithi047.stdout: 10 436 1.83 MB/sec warmup 84 sec latency 2206.881 ms 2024-04-01T22:48:58.273 INFO:tasks.workunit.client.0.smithi047.stdout: 10 439 1.82 MB/sec warmup 85 sec latency 2411.678 ms 2024-04-01T22:48:59.273 INFO:tasks.workunit.client.0.smithi047.stdout: 10 444 1.82 MB/sec warmup 86 sec latency 2353.523 ms 2024-04-01T22:49:00.273 INFO:tasks.workunit.client.0.smithi047.stdout: 10 447 1.81 MB/sec warmup 87 sec latency 2349.679 ms 2024-04-01T22:49:01.273 INFO:tasks.workunit.client.0.smithi047.stdout: 10 452 1.80 MB/sec warmup 88 sec latency 2165.444 ms 2024-04-01T22:49:02.273 INFO:tasks.workunit.client.0.smithi047.stdout: 10 459 1.81 MB/sec warmup 89 sec latency 2202.736 ms 2024-04-01T22:49:03.273 INFO:tasks.workunit.client.0.smithi047.stdout: 10 459 1.79 MB/sec warmup 90 sec latency 2383.061 ms 2024-04-01T22:49:04.273 INFO:tasks.workunit.client.0.smithi047.stdout: 10 464 1.79 MB/sec warmup 91 sec latency 2716.801 ms 2024-04-01T22:49:05.273 INFO:tasks.workunit.client.0.smithi047.stdout: 10 470 1.79 MB/sec warmup 92 sec latency 2717.297 ms 2024-04-01T22:49:06.273 INFO:tasks.workunit.client.0.smithi047.stdout: 10 479 1.80 MB/sec warmup 93 sec latency 1894.227 ms 2024-04-01T22:49:07.273 INFO:tasks.workunit.client.0.smithi047.stdout: 10 485 1.81 MB/sec warmup 94 sec latency 2458.340 ms 2024-04-01T22:49:08.273 INFO:tasks.workunit.client.0.smithi047.stdout: 10 485 1.79 MB/sec warmup 95 sec latency 2132.166 ms 2024-04-01T22:49:09.273 INFO:tasks.workunit.client.0.smithi047.stdout: 10 490 1.79 MB/sec warmup 96 sec latency 3132.213 ms 2024-04-01T22:49:10.274 INFO:tasks.workunit.client.0.smithi047.stdout: 10 493 1.78 MB/sec warmup 97 sec latency 4132.249 ms 2024-04-01T22:49:11.273 INFO:tasks.workunit.client.0.smithi047.stdout: 10 497 1.77 MB/sec warmup 98 sec latency 5132.287 ms 2024-04-01T22:49:12.274 INFO:tasks.workunit.client.0.smithi047.stdout: 10 500 1.76 MB/sec warmup 99 sec latency 6049.031 ms 2024-04-01T22:49:13.273 INFO:tasks.workunit.client.0.smithi047.stdout: 10 502 1.75 MB/sec warmup 100 sec latency 2420.044 ms 2024-04-01T22:49:14.273 INFO:tasks.workunit.client.0.smithi047.stdout: 10 510 1.76 MB/sec warmup 101 sec latency 2588.001 ms 2024-04-01T22:49:15.148 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:49:15.150 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:49:15.273 INFO:tasks.workunit.client.0.smithi047.stdout: 10 517 1.76 MB/sec warmup 102 sec latency 1507.372 ms 2024-04-01T22:49:16.273 INFO:tasks.workunit.client.0.smithi047.stdout: 10 524 1.77 MB/sec warmup 103 sec latency 2507.403 ms 2024-04-01T22:49:17.274 INFO:tasks.workunit.client.0.smithi047.stdout: 10 534 1.78 MB/sec warmup 104 sec latency 3507.433 ms 2024-04-01T22:49:18.274 INFO:tasks.workunit.client.0.smithi047.stdout: 10 535 1.77 MB/sec warmup 105 sec latency 4507.485 ms 2024-04-01T22:49:19.274 INFO:tasks.workunit.client.0.smithi047.stdout: 10 541 1.77 MB/sec warmup 106 sec latency 4714.599 ms 2024-04-01T22:49:20.274 INFO:tasks.workunit.client.0.smithi047.stdout: 10 546 1.77 MB/sec warmup 107 sec latency 3010.417 ms 2024-04-01T22:49:21.274 INFO:tasks.workunit.client.0.smithi047.stdout: 10 561 1.80 MB/sec warmup 108 sec latency 3464.339 ms 2024-04-01T22:49:22.274 INFO:tasks.workunit.client.0.smithi047.stdout: 10 572 1.82 MB/sec warmup 109 sec latency 3761.104 ms 2024-04-01T22:49:23.274 INFO:tasks.workunit.client.0.smithi047.stdout: 10 581 1.82 MB/sec warmup 110 sec latency 4440.519 ms 2024-04-01T22:49:24.274 INFO:tasks.workunit.client.0.smithi047.stdout: 10 584 1.81 MB/sec warmup 111 sec latency 4290.619 ms 2024-04-01T22:49:25.274 INFO:tasks.workunit.client.0.smithi047.stdout: 10 594 1.82 MB/sec warmup 112 sec latency 4454.392 ms 2024-04-01T22:49:26.274 INFO:tasks.workunit.client.0.smithi047.stdout: 10 599 1.82 MB/sec warmup 113 sec latency 3814.198 ms 2024-04-01T22:49:27.274 INFO:tasks.workunit.client.0.smithi047.stdout: 10 611 1.84 MB/sec warmup 114 sec latency 3356.759 ms 2024-04-01T22:49:28.274 INFO:tasks.workunit.client.0.smithi047.stdout: 10 612 1.82 MB/sec warmup 115 sec latency 3626.898 ms 2024-04-01T22:49:29.274 INFO:tasks.workunit.client.0.smithi047.stdout: 10 616 1.81 MB/sec warmup 116 sec latency 3869.395 ms 2024-04-01T22:49:30.274 INFO:tasks.workunit.client.0.smithi047.stdout: 10 621 1.80 MB/sec warmup 117 sec latency 3768.420 ms 2024-04-01T22:49:31.274 INFO:tasks.workunit.client.0.smithi047.stdout: 10 622 1.78 MB/sec warmup 118 sec latency 2597.330 ms 2024-04-01T22:49:32.274 INFO:tasks.workunit.client.0.smithi047.stdout: 10 626 1.77 MB/sec warmup 119 sec latency 3184.045 ms 2024-04-01T22:49:34.274 INFO:tasks.workunit.client.0.smithi047.stdout: 10 636 0.19 MB/sec execute 1 sec latency 3655.657 ms 2024-04-01T22:49:35.278 INFO:tasks.workunit.client.0.smithi047.stdout: 10 636 0.10 MB/sec execute 2 sec latency 3293.535 ms 2024-04-01T22:49:36.274 INFO:tasks.workunit.client.0.smithi047.stdout: 10 641 0.13 MB/sec execute 3 sec latency 3471.013 ms 2024-04-01T22:49:37.274 INFO:tasks.workunit.client.0.smithi047.stdout: 10 646 0.12 MB/sec execute 4 sec latency 3214.044 ms 2024-04-01T22:49:38.274 INFO:tasks.workunit.client.0.smithi047.stdout: 10 649 0.11 MB/sec execute 5 sec latency 3588.861 ms 2024-04-01T22:49:39.274 INFO:tasks.workunit.client.0.smithi047.stdout: 10 650 0.09 MB/sec execute 6 sec latency 3355.106 ms 2024-04-01T22:49:40.274 INFO:tasks.workunit.client.0.smithi047.stdout: 10 652 0.08 MB/sec execute 7 sec latency 3232.904 ms 2024-04-01T22:49:41.274 INFO:tasks.workunit.client.0.smithi047.stdout: 10 654 0.08 MB/sec execute 8 sec latency 2823.883 ms 2024-04-01T22:49:42.274 INFO:tasks.workunit.client.0.smithi047.stdout: 10 657 0.09 MB/sec execute 9 sec latency 3025.996 ms 2024-04-01T22:49:43.275 INFO:tasks.workunit.client.0.smithi047.stdout: 10 659 0.08 MB/sec execute 10 sec latency 3435.093 ms 2024-04-01T22:49:44.274 INFO:tasks.workunit.client.0.smithi047.stdout: 10 661 0.07 MB/sec execute 11 sec latency 3570.436 ms 2024-04-01T22:49:45.274 INFO:tasks.workunit.client.0.smithi047.stdout: 10 665 0.09 MB/sec execute 12 sec latency 3317.655 ms 2024-04-01T22:49:45.328 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:49:45.331 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:49:46.274 INFO:tasks.workunit.client.0.smithi047.stdout: 10 669 0.08 MB/sec execute 13 sec latency 3423.367 ms 2024-04-01T22:49:47.275 INFO:tasks.workunit.client.0.smithi047.stdout: 10 673 0.09 MB/sec execute 14 sec latency 3700.300 ms 2024-04-01T22:49:48.275 INFO:tasks.workunit.client.0.smithi047.stdout: 10 676 0.10 MB/sec execute 15 sec latency 3725.910 ms 2024-04-01T22:49:49.275 INFO:tasks.workunit.client.0.smithi047.stdout: 10 681 0.10 MB/sec execute 16 sec latency 3432.093 ms 2024-04-01T22:49:50.275 INFO:tasks.workunit.client.0.smithi047.stdout: 10 686 0.10 MB/sec execute 17 sec latency 3486.537 ms 2024-04-01T22:49:51.275 INFO:tasks.workunit.client.0.smithi047.stdout: 10 690 0.10 MB/sec execute 18 sec latency 3265.924 ms 2024-04-01T22:49:52.275 INFO:tasks.workunit.client.0.smithi047.stdout: 10 693 0.10 MB/sec execute 19 sec latency 3364.664 ms 2024-04-01T22:49:53.275 INFO:tasks.workunit.client.0.smithi047.stdout: 10 693 0.09 MB/sec execute 20 sec latency 3507.103 ms 2024-04-01T22:49:54.275 INFO:tasks.workunit.client.0.smithi047.stdout: 10 698 0.10 MB/sec execute 21 sec latency 3719.621 ms 2024-04-01T22:49:55.275 INFO:tasks.workunit.client.0.smithi047.stdout: 10 702 0.09 MB/sec execute 22 sec latency 3601.290 ms 2024-04-01T22:49:56.275 INFO:tasks.workunit.client.0.smithi047.stdout: 10 709 0.09 MB/sec execute 23 sec latency 3578.867 ms 2024-04-01T22:49:57.275 INFO:tasks.workunit.client.0.smithi047.stdout: 10 711 0.09 MB/sec execute 24 sec latency 3585.535 ms 2024-04-01T22:49:58.275 INFO:tasks.workunit.client.0.smithi047.stdout: 10 716 0.09 MB/sec execute 25 sec latency 3713.461 ms 2024-04-01T22:49:59.275 INFO:tasks.workunit.client.0.smithi047.stdout: 10 721 0.09 MB/sec execute 26 sec latency 4111.111 ms 2024-04-01T22:50:00.275 INFO:tasks.workunit.client.0.smithi047.stdout: 10 726 0.09 MB/sec execute 27 sec latency 4446.150 ms 2024-04-01T22:50:01.275 INFO:tasks.workunit.client.0.smithi047.stdout: 10 729 0.09 MB/sec execute 28 sec latency 4811.103 ms 2024-04-01T22:50:02.195 INFO:tasks.ceph.mon.a.smithi047.stderr:==00:00:17:16.811 37051== Warning: unimplemented fcntl command: 1036 2024-04-01T22:50:02.266 INFO:tasks.ceph.mon.a.smithi047.stderr:==00:00:17:16.881 37051== Warning: unimplemented fcntl command: 1036 2024-04-01T22:50:02.275 INFO:tasks.workunit.client.0.smithi047.stdout: 10 734 0.09 MB/sec execute 29 sec latency 4882.477 ms 2024-04-01T22:50:02.310 INFO:tasks.ceph.mon.a.smithi047.stderr:==00:00:17:16.926 37051== Warning: unimplemented fcntl command: 1036 2024-04-01T22:50:02.330 INFO:tasks.ceph.mon.b.smithi181.stderr:==00:00:17:16.888 37187== Warning: unimplemented fcntl command: 1036 2024-04-01T22:50:02.332 INFO:tasks.ceph.mon.c.smithi181.stderr:==00:00:17:16.889 37188== Warning: unimplemented fcntl command: 1036 2024-04-01T22:50:02.332 INFO:tasks.ceph.mon.b.smithi181.stderr:==00:00:17:16.889 37187== Warning: unimplemented fcntl command: 1036 2024-04-01T22:50:02.335 INFO:tasks.ceph.mon.c.smithi181.stderr:==00:00:17:16.892 37188== Warning: unimplemented fcntl command: 1036 2024-04-01T22:50:02.368 INFO:tasks.ceph.mon.b.smithi181.stderr:==00:00:17:16.926 37187== Warning: unimplemented fcntl command: 1036 2024-04-01T22:50:02.371 INFO:tasks.ceph.mon.c.smithi181.stderr:==00:00:17:16.929 37188== Warning: unimplemented fcntl command: 1036 2024-04-01T22:50:03.275 INFO:tasks.workunit.client.0.smithi047.stdout: 10 737 0.10 MB/sec execute 30 sec latency 2034.835 ms 2024-04-01T22:50:04.275 INFO:tasks.workunit.client.0.smithi047.stdout: 10 742 0.10 MB/sec execute 31 sec latency 3034.877 ms 2024-04-01T22:50:05.275 INFO:tasks.workunit.client.0.smithi047.stdout: 10 746 0.10 MB/sec execute 32 sec latency 4034.905 ms 2024-04-01T22:50:06.275 INFO:tasks.workunit.client.0.smithi047.stdout: 10 751 0.10 MB/sec execute 33 sec latency 4362.042 ms 2024-04-01T22:50:07.275 INFO:tasks.workunit.client.0.smithi047.stdout: 10 755 0.10 MB/sec execute 34 sec latency 3999.198 ms 2024-04-01T22:50:08.275 INFO:tasks.workunit.client.0.smithi047.stdout: 10 757 0.09 MB/sec execute 35 sec latency 3609.875 ms 2024-04-01T22:50:09.275 INFO:tasks.workunit.client.0.smithi047.stdout: 10 758 0.09 MB/sec execute 36 sec latency 4130.532 ms 2024-04-01T22:50:10.275 INFO:tasks.workunit.client.0.smithi047.stdout: 10 759 0.09 MB/sec execute 37 sec latency 3875.968 ms 2024-04-01T22:50:11.275 INFO:tasks.workunit.client.0.smithi047.stdout: 10 766 0.09 MB/sec execute 38 sec latency 3709.489 ms 2024-04-01T22:50:12.275 INFO:tasks.workunit.client.0.smithi047.stdout: 10 771 0.09 MB/sec execute 39 sec latency 3367.562 ms 2024-04-01T22:50:13.275 INFO:tasks.workunit.client.0.smithi047.stdout: 10 777 0.09 MB/sec execute 40 sec latency 3465.356 ms 2024-04-01T22:50:14.275 INFO:tasks.workunit.client.0.smithi047.stdout: 10 783 0.09 MB/sec execute 41 sec latency 3518.548 ms 2024-04-01T22:50:15.276 INFO:tasks.workunit.client.0.smithi047.stdout: 10 786 0.09 MB/sec execute 42 sec latency 4052.366 ms 2024-04-01T22:50:15.383 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:50:15.390 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:50:16.275 INFO:tasks.workunit.client.0.smithi047.stdout: 10 791 0.09 MB/sec execute 43 sec latency 3377.025 ms 2024-04-01T22:50:17.275 INFO:tasks.workunit.client.0.smithi047.stdout: 10 794 0.09 MB/sec execute 44 sec latency 4006.293 ms 2024-04-01T22:50:18.275 INFO:tasks.workunit.client.0.smithi047.stdout: 10 798 0.09 MB/sec execute 45 sec latency 4575.827 ms 2024-04-01T22:50:19.276 INFO:tasks.workunit.client.0.smithi047.stdout: 10 800 0.09 MB/sec execute 46 sec latency 4951.195 ms 2024-04-01T22:50:20.276 INFO:tasks.workunit.client.0.smithi047.stdout: 10 805 0.10 MB/sec execute 47 sec latency 3370.876 ms 2024-04-01T22:50:21.276 INFO:tasks.workunit.client.0.smithi047.stdout: 10 810 0.10 MB/sec execute 48 sec latency 4306.650 ms 2024-04-01T22:50:22.276 INFO:tasks.workunit.client.0.smithi047.stdout: 10 813 0.09 MB/sec execute 49 sec latency 3940.618 ms 2024-04-01T22:50:23.276 INFO:tasks.workunit.client.0.smithi047.stdout: 10 817 0.09 MB/sec execute 50 sec latency 3508.337 ms 2024-04-01T22:50:24.276 INFO:tasks.workunit.client.0.smithi047.stdout: 10 817 0.09 MB/sec execute 51 sec latency 3265.606 ms 2024-04-01T22:50:25.276 INFO:tasks.workunit.client.0.smithi047.stdout: 10 818 0.09 MB/sec execute 52 sec latency 3426.841 ms 2024-04-01T22:50:26.276 INFO:tasks.workunit.client.0.smithi047.stdout: 10 820 0.09 MB/sec execute 53 sec latency 2861.418 ms 2024-04-01T22:50:27.276 INFO:tasks.workunit.client.0.smithi047.stdout: 10 820 0.09 MB/sec execute 54 sec latency 2669.720 ms 2024-04-01T22:50:28.276 INFO:tasks.workunit.client.0.smithi047.stdout: 10 824 0.09 MB/sec execute 55 sec latency 2730.635 ms 2024-04-01T22:50:29.276 INFO:tasks.workunit.client.0.smithi047.stdout: 10 829 0.09 MB/sec execute 56 sec latency 3094.582 ms 2024-04-01T22:50:30.276 INFO:tasks.workunit.client.0.smithi047.stdout: 10 830 0.09 MB/sec execute 57 sec latency 2289.224 ms 2024-04-01T22:50:31.276 INFO:tasks.workunit.client.0.smithi047.stdout: 10 832 0.09 MB/sec execute 58 sec latency 2848.409 ms 2024-04-01T22:50:32.276 INFO:tasks.workunit.client.0.smithi047.stdout: 10 839 0.09 MB/sec execute 59 sec latency 2687.956 ms 2024-04-01T22:50:33.276 INFO:tasks.workunit.client.0.smithi047.stdout: 10 839 0.09 MB/sec execute 60 sec latency 2614.037 ms 2024-04-01T22:50:34.276 INFO:tasks.workunit.client.0.smithi047.stdout: 10 849 0.09 MB/sec execute 61 sec latency 2916.961 ms 2024-04-01T22:50:35.276 INFO:tasks.workunit.client.0.smithi047.stdout: 10 854 0.09 MB/sec execute 62 sec latency 3108.172 ms 2024-04-01T22:50:36.276 INFO:tasks.workunit.client.0.smithi047.stdout: 10 857 0.09 MB/sec execute 63 sec latency 3078.659 ms 2024-04-01T22:50:37.276 INFO:tasks.workunit.client.0.smithi047.stdout: 10 858 0.09 MB/sec execute 64 sec latency 3088.117 ms 2024-04-01T22:50:38.276 INFO:tasks.workunit.client.0.smithi047.stdout: 10 860 0.09 MB/sec execute 65 sec latency 3126.020 ms 2024-04-01T22:50:39.277 INFO:tasks.workunit.client.0.smithi047.stdout: 10 863 0.09 MB/sec execute 66 sec latency 3301.448 ms 2024-04-01T22:50:40.276 INFO:tasks.workunit.client.0.smithi047.stdout: 10 864 0.09 MB/sec execute 67 sec latency 3496.915 ms 2024-04-01T22:50:41.276 INFO:tasks.workunit.client.0.smithi047.stdout: 10 867 0.09 MB/sec execute 68 sec latency 3716.639 ms 2024-04-01T22:50:42.277 INFO:tasks.workunit.client.0.smithi047.stdout: 10 871 0.09 MB/sec execute 69 sec latency 3374.343 ms 2024-04-01T22:50:43.276 INFO:tasks.workunit.client.0.smithi047.stdout: 10 871 0.08 MB/sec execute 70 sec latency 4002.220 ms 2024-04-01T22:50:44.276 INFO:tasks.workunit.client.0.smithi047.stdout: 10 874 0.09 MB/sec execute 71 sec latency 3650.999 ms 2024-04-01T22:50:45.277 INFO:tasks.workunit.client.0.smithi047.stdout: 10 878 0.09 MB/sec execute 72 sec latency 4090.719 ms 2024-04-01T22:50:45.454 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:50:45.457 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:50:46.277 INFO:tasks.workunit.client.0.smithi047.stdout: 10 880 0.08 MB/sec execute 73 sec latency 3909.882 ms 2024-04-01T22:50:47.277 INFO:tasks.workunit.client.0.smithi047.stdout: 10 883 0.09 MB/sec execute 74 sec latency 3319.599 ms 2024-04-01T22:50:48.277 INFO:tasks.workunit.client.0.smithi047.stdout: 10 886 0.09 MB/sec execute 75 sec latency 3375.849 ms 2024-04-01T22:50:49.277 INFO:tasks.workunit.client.0.smithi047.stdout: 10 893 0.09 MB/sec execute 76 sec latency 3780.540 ms 2024-04-01T22:50:50.277 INFO:tasks.workunit.client.0.smithi047.stdout: 10 896 0.09 MB/sec execute 77 sec latency 3659.282 ms 2024-04-01T22:50:51.277 INFO:tasks.workunit.client.0.smithi047.stdout: 10 898 0.09 MB/sec execute 78 sec latency 2780.374 ms 2024-04-01T22:50:52.277 INFO:tasks.workunit.client.0.smithi047.stdout: 10 901 0.09 MB/sec execute 79 sec latency 3385.002 ms 2024-04-01T22:50:53.277 INFO:tasks.workunit.client.0.smithi047.stdout: 10 906 0.09 MB/sec execute 80 sec latency 3644.980 ms 2024-04-01T22:50:54.277 INFO:tasks.workunit.client.0.smithi047.stdout: 10 911 0.09 MB/sec execute 81 sec latency 3697.891 ms 2024-04-01T22:50:55.277 INFO:tasks.workunit.client.0.smithi047.stdout: 10 914 0.09 MB/sec execute 82 sec latency 4189.748 ms 2024-04-01T22:50:56.277 INFO:tasks.workunit.client.0.smithi047.stdout: 10 915 0.09 MB/sec execute 83 sec latency 4321.141 ms 2024-04-01T22:50:57.277 INFO:tasks.workunit.client.0.smithi047.stdout: 10 918 0.09 MB/sec execute 84 sec latency 4687.345 ms 2024-04-01T22:50:58.277 INFO:tasks.workunit.client.0.smithi047.stdout: 10 922 0.09 MB/sec execute 85 sec latency 4999.075 ms 2024-04-01T22:50:59.277 INFO:tasks.workunit.client.0.smithi047.stdout: 10 926 0.09 MB/sec execute 86 sec latency 4811.688 ms 2024-04-01T22:51:00.277 INFO:tasks.workunit.client.0.smithi047.stdout: 10 928 0.09 MB/sec execute 87 sec latency 4884.211 ms 2024-04-01T22:51:01.277 INFO:tasks.workunit.client.0.smithi047.stdout: 10 928 0.09 MB/sec execute 88 sec latency 5098.010 ms 2024-04-01T22:51:02.277 INFO:tasks.workunit.client.0.smithi047.stdout: 10 929 0.08 MB/sec execute 89 sec latency 3842.535 ms 2024-04-01T22:51:03.277 INFO:tasks.workunit.client.0.smithi047.stdout: 10 929 0.08 MB/sec execute 90 sec latency 3040.088 ms 2024-04-01T22:51:04.277 INFO:tasks.workunit.client.0.smithi047.stdout: 10 930 0.08 MB/sec execute 91 sec latency 2840.742 ms 2024-04-01T22:51:05.277 INFO:tasks.workunit.client.0.smithi047.stdout: 10 931 0.08 MB/sec execute 92 sec latency 2904.668 ms 2024-04-01T22:51:06.277 INFO:tasks.workunit.client.0.smithi047.stdout: 10 934 0.08 MB/sec execute 93 sec latency 2826.850 ms 2024-04-01T22:51:07.277 INFO:tasks.workunit.client.0.smithi047.stdout: 10 935 0.08 MB/sec execute 94 sec latency 1936.965 ms 2024-04-01T22:51:08.277 INFO:tasks.workunit.client.0.smithi047.stdout: 10 935 0.08 MB/sec execute 95 sec latency 2937.000 ms 2024-04-01T22:51:09.277 INFO:tasks.workunit.client.0.smithi047.stdout: 10 938 0.08 MB/sec execute 96 sec latency 3046.397 ms 2024-04-01T22:51:10.277 INFO:tasks.workunit.client.0.smithi047.stdout: 10 940 0.08 MB/sec execute 97 sec latency 3211.285 ms 2024-04-01T22:51:11.277 INFO:tasks.workunit.client.0.smithi047.stdout: 10 942 0.08 MB/sec execute 98 sec latency 3024.830 ms 2024-04-01T22:51:12.277 INFO:tasks.workunit.client.0.smithi047.stdout: 10 946 0.08 MB/sec execute 99 sec latency 2755.308 ms 2024-04-01T22:51:13.277 INFO:tasks.workunit.client.0.smithi047.stdout: 10 948 0.08 MB/sec execute 100 sec latency 2976.727 ms 2024-04-01T22:51:14.277 INFO:tasks.workunit.client.0.smithi047.stdout: 10 953 0.09 MB/sec execute 101 sec latency 2606.508 ms 2024-04-01T22:51:15.278 INFO:tasks.workunit.client.0.smithi047.stdout: 10 956 0.09 MB/sec execute 102 sec latency 3257.704 ms 2024-04-01T22:51:15.602 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:51:15.604 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:51:16.278 INFO:tasks.workunit.client.0.smithi047.stdout: 10 960 0.09 MB/sec execute 103 sec latency 3129.561 ms 2024-04-01T22:51:17.278 INFO:tasks.workunit.client.0.smithi047.stdout: 10 964 0.09 MB/sec execute 104 sec latency 3236.530 ms 2024-04-01T22:51:18.278 INFO:tasks.workunit.client.0.smithi047.stdout: 10 966 0.09 MB/sec execute 105 sec latency 3174.080 ms 2024-04-01T22:51:19.278 INFO:tasks.workunit.client.0.smithi047.stdout: 10 974 0.09 MB/sec execute 106 sec latency 3659.912 ms 2024-04-01T22:51:20.278 INFO:tasks.workunit.client.0.smithi047.stdout: 10 979 0.09 MB/sec execute 107 sec latency 3360.948 ms 2024-04-01T22:51:21.278 INFO:tasks.workunit.client.0.smithi047.stdout: 10 985 0.09 MB/sec execute 108 sec latency 2845.047 ms 2024-04-01T22:51:22.278 INFO:tasks.workunit.client.0.smithi047.stdout: 10 988 0.10 MB/sec execute 109 sec latency 3730.006 ms 2024-04-01T22:51:23.278 INFO:tasks.workunit.client.0.smithi047.stdout: 10 990 0.10 MB/sec execute 110 sec latency 2322.028 ms 2024-04-01T22:51:24.278 INFO:tasks.workunit.client.0.smithi047.stdout: 10 995 0.10 MB/sec execute 111 sec latency 3322.064 ms 2024-04-01T22:51:25.278 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1001 0.11 MB/sec execute 112 sec latency 3964.434 ms 2024-04-01T22:51:26.278 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1007 0.11 MB/sec execute 113 sec latency 3791.953 ms 2024-04-01T22:51:27.278 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1012 0.12 MB/sec execute 114 sec latency 3487.311 ms 2024-04-01T22:51:28.278 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1013 0.12 MB/sec execute 115 sec latency 3841.988 ms 2024-04-01T22:51:29.278 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1013 0.12 MB/sec execute 116 sec latency 3596.095 ms 2024-04-01T22:51:30.278 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1017 0.13 MB/sec execute 117 sec latency 3723.755 ms 2024-04-01T22:51:31.278 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1023 0.13 MB/sec execute 118 sec latency 3480.830 ms 2024-04-01T22:51:32.278 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1032 0.16 MB/sec execute 119 sec latency 2909.688 ms 2024-04-01T22:51:33.278 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1033 0.16 MB/sec execute 120 sec latency 2989.488 ms 2024-04-01T22:51:34.278 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1034 0.15 MB/sec execute 121 sec latency 3066.105 ms 2024-04-01T22:51:35.278 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1037 0.15 MB/sec execute 122 sec latency 2876.731 ms 2024-04-01T22:51:36.278 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1041 0.15 MB/sec execute 123 sec latency 2704.037 ms 2024-04-01T22:51:37.279 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1042 0.15 MB/sec execute 124 sec latency 2805.389 ms 2024-04-01T22:51:38.278 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1044 0.15 MB/sec execute 125 sec latency 3615.094 ms 2024-04-01T22:51:39.278 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1045 0.15 MB/sec execute 126 sec latency 3633.843 ms 2024-04-01T22:51:40.278 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1047 0.15 MB/sec execute 127 sec latency 3840.937 ms 2024-04-01T22:51:41.278 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1050 0.15 MB/sec execute 128 sec latency 2981.364 ms 2024-04-01T22:51:42.278 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1051 0.15 MB/sec execute 129 sec latency 3148.674 ms 2024-04-01T22:51:43.278 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1053 0.14 MB/sec execute 130 sec latency 3351.595 ms 2024-04-01T22:51:44.279 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1054 0.14 MB/sec execute 131 sec latency 3543.518 ms 2024-04-01T22:51:45.279 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1055 0.14 MB/sec execute 132 sec latency 3364.689 ms 2024-04-01T22:51:45.908 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:51:45.911 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:51:46.278 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1059 0.14 MB/sec execute 133 sec latency 3042.617 ms 2024-04-01T22:51:47.279 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1061 0.14 MB/sec execute 134 sec latency 3157.575 ms 2024-04-01T22:51:48.279 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1065 0.14 MB/sec execute 135 sec latency 3442.469 ms 2024-04-01T22:51:49.279 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1065 0.14 MB/sec execute 136 sec latency 2673.037 ms 2024-04-01T22:51:50.279 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1068 0.14 MB/sec execute 137 sec latency 3673.095 ms 2024-04-01T22:51:51.279 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1071 0.14 MB/sec execute 138 sec latency 3919.790 ms 2024-04-01T22:51:52.279 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1075 0.14 MB/sec execute 139 sec latency 3714.599 ms 2024-04-01T22:51:53.279 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1079 0.14 MB/sec execute 140 sec latency 2302.931 ms 2024-04-01T22:51:54.279 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1083 0.14 MB/sec execute 141 sec latency 3302.964 ms 2024-04-01T22:51:55.279 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1086 0.13 MB/sec execute 142 sec latency 3927.592 ms 2024-04-01T22:51:56.279 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1088 0.13 MB/sec execute 143 sec latency 3753.203 ms 2024-04-01T22:51:57.279 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1097 0.13 MB/sec execute 144 sec latency 3576.153 ms 2024-04-01T22:51:58.279 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1101 0.13 MB/sec execute 145 sec latency 3259.392 ms 2024-04-01T22:51:59.279 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1102 0.13 MB/sec execute 146 sec latency 4259.438 ms 2024-04-01T22:52:00.279 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1103 0.13 MB/sec execute 147 sec latency 4765.457 ms 2024-04-01T22:52:01.279 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1105 0.13 MB/sec execute 148 sec latency 4088.870 ms 2024-04-01T22:52:02.279 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1107 0.13 MB/sec execute 149 sec latency 4301.031 ms 2024-04-01T22:52:03.279 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1113 0.13 MB/sec execute 150 sec latency 3192.107 ms 2024-04-01T22:52:04.279 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1115 0.13 MB/sec execute 151 sec latency 3385.384 ms 2024-04-01T22:52:05.279 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1119 0.13 MB/sec execute 152 sec latency 3598.773 ms 2024-04-01T22:52:06.279 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1121 0.13 MB/sec execute 153 sec latency 3630.641 ms 2024-04-01T22:52:07.279 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1125 0.13 MB/sec execute 154 sec latency 3764.622 ms 2024-04-01T22:52:08.280 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1131 0.13 MB/sec execute 155 sec latency 3169.581 ms 2024-04-01T22:52:09.279 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1133 0.13 MB/sec execute 156 sec latency 2921.762 ms 2024-04-01T22:52:10.279 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1137 0.13 MB/sec execute 157 sec latency 3559.667 ms 2024-04-01T22:52:11.279 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1139 0.12 MB/sec execute 158 sec latency 3691.713 ms 2024-04-01T22:52:12.279 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1143 0.12 MB/sec execute 159 sec latency 3566.696 ms 2024-04-01T22:52:13.279 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1147 0.12 MB/sec execute 160 sec latency 3193.613 ms 2024-04-01T22:52:14.280 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1151 0.12 MB/sec execute 161 sec latency 3411.657 ms 2024-04-01T22:52:15.280 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1155 0.12 MB/sec execute 162 sec latency 3269.026 ms 2024-04-01T22:52:15.980 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:52:15.983 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:52:16.280 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1159 0.12 MB/sec execute 163 sec latency 3419.480 ms 2024-04-01T22:52:17.280 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1162 0.12 MB/sec execute 164 sec latency 3582.137 ms 2024-04-01T22:52:18.280 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1166 0.12 MB/sec execute 165 sec latency 2840.768 ms 2024-04-01T22:52:19.280 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1167 0.12 MB/sec execute 166 sec latency 3788.282 ms 2024-04-01T22:52:20.280 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1167 0.12 MB/sec execute 167 sec latency 4097.265 ms 2024-04-01T22:52:21.280 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1168 0.12 MB/sec execute 168 sec latency 3753.801 ms 2024-04-01T22:52:22.280 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1170 0.12 MB/sec execute 169 sec latency 3941.485 ms 2024-04-01T22:52:23.280 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1172 0.12 MB/sec execute 170 sec latency 3285.990 ms 2024-04-01T22:52:24.280 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1174 0.12 MB/sec execute 171 sec latency 3773.342 ms 2024-04-01T22:52:25.280 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1176 0.12 MB/sec execute 172 sec latency 3229.715 ms 2024-04-01T22:52:26.280 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1178 0.12 MB/sec execute 173 sec latency 3803.234 ms 2024-04-01T22:52:27.280 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1181 0.12 MB/sec execute 174 sec latency 3557.050 ms 2024-04-01T22:52:28.280 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1184 0.11 MB/sec execute 175 sec latency 2775.033 ms 2024-04-01T22:52:29.280 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1185 0.11 MB/sec execute 176 sec latency 3775.066 ms 2024-04-01T22:52:30.280 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1186 0.11 MB/sec execute 177 sec latency 3826.868 ms 2024-04-01T22:52:31.280 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1189 0.11 MB/sec execute 178 sec latency 3782.051 ms 2024-04-01T22:52:32.280 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1191 0.11 MB/sec execute 179 sec latency 3417.091 ms 2024-04-01T22:52:33.280 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1196 0.11 MB/sec execute 180 sec latency 3730.099 ms 2024-04-01T22:52:34.280 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1199 0.11 MB/sec execute 181 sec latency 3933.888 ms 2024-04-01T22:52:35.280 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1203 0.11 MB/sec execute 182 sec latency 4066.008 ms 2024-04-01T22:52:36.280 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1207 0.11 MB/sec execute 183 sec latency 3720.700 ms 2024-04-01T22:52:37.280 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1209 0.11 MB/sec execute 184 sec latency 4237.987 ms 2024-04-01T22:52:37.478 INFO:tasks.ceph.mon.a.smithi047.stderr:==00:00:19:52.093 37051== Warning: unimplemented fcntl command: 1036 2024-04-01T22:52:37.530 INFO:tasks.ceph.mon.a.smithi047.stderr:==00:00:19:52.145 37051== Warning: unimplemented fcntl command: 1036 2024-04-01T22:52:37.534 INFO:tasks.ceph.mon.b.smithi181.stderr:==00:00:19:52.092 37187== Warning: unimplemented fcntl command: 1036 2024-04-01T22:52:37.537 INFO:tasks.ceph.mon.b.smithi181.stderr:==00:00:19:52.095 37187== Warning: unimplemented fcntl command: 1036 2024-04-01T22:52:37.587 INFO:tasks.ceph.mon.c.smithi181.stderr:==00:00:19:52.145 37188== Warning: unimplemented fcntl command: 1036 2024-04-01T22:52:37.588 INFO:tasks.ceph.mon.c.smithi181.stderr:==00:00:19:52.146 37188== Warning: unimplemented fcntl command: 1036 2024-04-01T22:52:37.595 INFO:tasks.ceph.mon.b.smithi181.stderr:==00:00:19:52.153 37187== Warning: unimplemented fcntl command: 1036 2024-04-01T22:52:37.605 INFO:tasks.ceph.mon.a.smithi047.stderr:==00:00:19:52.221 37051== Warning: unimplemented fcntl command: 1036 2024-04-01T22:52:37.651 INFO:tasks.ceph.mon.c.smithi181.stderr:==00:00:19:52.208 37188== Warning: unimplemented fcntl command: 1036 2024-04-01T22:52:38.280 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1213 0.11 MB/sec execute 185 sec latency 4343.744 ms 2024-04-01T22:52:39.281 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1215 0.11 MB/sec execute 186 sec latency 2421.126 ms 2024-04-01T22:52:40.280 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1222 0.11 MB/sec execute 187 sec latency 3421.175 ms 2024-04-01T22:52:41.280 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1226 0.11 MB/sec execute 188 sec latency 3467.742 ms 2024-04-01T22:52:42.280 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1228 0.11 MB/sec execute 189 sec latency 4189.037 ms 2024-04-01T22:52:43.281 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1231 0.11 MB/sec execute 190 sec latency 4424.594 ms 2024-04-01T22:52:44.281 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1233 0.11 MB/sec execute 191 sec latency 4169.075 ms 2024-04-01T22:52:45.281 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1237 0.11 MB/sec execute 192 sec latency 4123.923 ms 2024-04-01T22:52:46.086 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:52:46.089 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:52:46.281 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1241 0.11 MB/sec execute 193 sec latency 4206.931 ms 2024-04-01T22:52:47.281 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1245 0.11 MB/sec execute 194 sec latency 4088.136 ms 2024-04-01T22:52:48.281 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1250 0.11 MB/sec execute 195 sec latency 4218.085 ms 2024-04-01T22:52:49.281 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1256 0.11 MB/sec execute 196 sec latency 3979.661 ms 2024-04-01T22:52:50.281 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1265 0.12 MB/sec execute 197 sec latency 4373.708 ms 2024-04-01T22:52:51.281 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1271 0.12 MB/sec execute 198 sec latency 4391.337 ms 2024-04-01T22:52:52.281 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1272 0.12 MB/sec execute 199 sec latency 4042.316 ms 2024-04-01T22:52:53.281 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1275 0.12 MB/sec execute 200 sec latency 3871.646 ms 2024-04-01T22:52:54.281 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1276 0.12 MB/sec execute 201 sec latency 4332.279 ms 2024-04-01T22:52:55.283 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1276 0.12 MB/sec execute 202 sec latency 4312.058 ms 2024-04-01T22:52:56.281 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1277 0.12 MB/sec execute 203 sec latency 4211.587 ms 2024-04-01T22:52:57.281 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1281 0.12 MB/sec execute 204 sec latency 3687.157 ms 2024-04-01T22:52:58.281 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1284 0.12 MB/sec execute 205 sec latency 3427.382 ms 2024-04-01T22:52:59.281 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1289 0.12 MB/sec execute 206 sec latency 3463.381 ms 2024-04-01T22:53:00.281 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1289 0.12 MB/sec execute 207 sec latency 4463.408 ms 2024-04-01T22:53:01.281 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1290 0.12 MB/sec execute 208 sec latency 4813.490 ms 2024-04-01T22:53:02.281 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1292 0.12 MB/sec execute 209 sec latency 4484.208 ms 2024-04-01T22:53:03.281 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1301 0.13 MB/sec execute 210 sec latency 4070.053 ms 2024-04-01T22:53:04.281 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1310 0.14 MB/sec execute 211 sec latency 2841.215 ms 2024-04-01T22:53:05.281 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1311 0.14 MB/sec execute 212 sec latency 3438.453 ms 2024-04-01T22:53:06.281 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1320 0.15 MB/sec execute 213 sec latency 3244.818 ms 2024-04-01T22:53:07.281 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1324 0.16 MB/sec execute 214 sec latency 3348.855 ms 2024-04-01T22:53:08.281 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1334 0.17 MB/sec execute 215 sec latency 2803.361 ms 2024-04-01T22:53:09.281 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1341 0.18 MB/sec execute 216 sec latency 2965.547 ms 2024-04-01T22:53:10.282 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1342 0.18 MB/sec execute 217 sec latency 3123.527 ms 2024-04-01T22:53:11.282 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1351 0.19 MB/sec execute 218 sec latency 2981.347 ms 2024-04-01T22:53:12.282 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1354 0.19 MB/sec execute 219 sec latency 3025.150 ms 2024-04-01T22:53:13.282 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1382 0.23 MB/sec execute 220 sec latency 2937.308 ms 2024-04-01T22:53:14.282 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1382 0.23 MB/sec execute 221 sec latency 3022.129 ms 2024-04-01T22:53:15.282 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1383 0.22 MB/sec execute 222 sec latency 3206.405 ms 2024-04-01T22:53:16.233 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:53:16.235 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:53:16.282 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1384 0.22 MB/sec execute 223 sec latency 2978.450 ms 2024-04-01T22:53:17.282 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1386 0.22 MB/sec execute 224 sec latency 2828.480 ms 2024-04-01T22:53:18.282 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1390 0.22 MB/sec execute 225 sec latency 2976.630 ms 2024-04-01T22:53:19.282 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1391 0.22 MB/sec execute 226 sec latency 3178.235 ms 2024-04-01T22:53:20.282 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1392 0.22 MB/sec execute 227 sec latency 3281.523 ms 2024-04-01T22:53:21.282 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1394 0.22 MB/sec execute 228 sec latency 3255.716 ms 2024-04-01T22:53:22.282 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1396 0.22 MB/sec execute 229 sec latency 3244.019 ms 2024-04-01T22:53:23.282 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1400 0.22 MB/sec execute 230 sec latency 2869.604 ms 2024-04-01T22:53:24.282 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1403 0.22 MB/sec execute 231 sec latency 2607.127 ms 2024-04-01T22:53:25.282 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1405 0.22 MB/sec execute 232 sec latency 2921.395 ms 2024-04-01T22:53:26.282 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1408 0.21 MB/sec execute 233 sec latency 2972.081 ms 2024-04-01T22:53:27.282 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1411 0.21 MB/sec execute 234 sec latency 3289.039 ms 2024-04-01T22:53:28.282 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1415 0.21 MB/sec execute 235 sec latency 3352.432 ms 2024-04-01T22:53:29.282 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1418 0.21 MB/sec execute 236 sec latency 2947.317 ms 2024-04-01T22:53:30.282 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1423 0.21 MB/sec execute 237 sec latency 3379.104 ms 2024-04-01T22:53:31.282 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1426 0.21 MB/sec execute 238 sec latency 3030.606 ms 2024-04-01T22:53:32.282 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1429 0.21 MB/sec execute 239 sec latency 4030.634 ms 2024-04-01T22:53:33.282 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1432 0.21 MB/sec execute 240 sec latency 4357.770 ms 2024-04-01T22:53:34.282 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1435 0.21 MB/sec execute 241 sec latency 3505.366 ms 2024-04-01T22:53:35.282 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1438 0.21 MB/sec execute 242 sec latency 3776.183 ms 2024-04-01T22:53:36.282 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1441 0.21 MB/sec execute 243 sec latency 4025.539 ms 2024-04-01T22:53:37.282 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1443 0.21 MB/sec execute 244 sec latency 3718.974 ms 2024-04-01T22:53:38.282 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1445 0.20 MB/sec execute 245 sec latency 4401.498 ms 2024-04-01T22:53:39.282 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1448 0.20 MB/sec execute 246 sec latency 4128.725 ms 2024-04-01T22:53:40.283 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1450 0.20 MB/sec execute 247 sec latency 4152.124 ms 2024-04-01T22:53:41.282 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1453 0.20 MB/sec execute 248 sec latency 2929.289 ms 2024-04-01T22:53:42.283 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1457 0.20 MB/sec execute 249 sec latency 3562.291 ms 2024-04-01T22:53:43.282 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1462 0.20 MB/sec execute 250 sec latency 3025.635 ms 2024-04-01T22:53:44.283 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1464 0.20 MB/sec execute 251 sec latency 4025.669 ms 2024-04-01T22:53:45.283 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1468 0.20 MB/sec execute 252 sec latency 4285.066 ms 2024-04-01T22:53:46.283 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1471 0.20 MB/sec execute 253 sec latency 3679.744 ms 2024-04-01T22:53:46.304 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:53:46.306 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:53:47.283 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1474 0.20 MB/sec execute 254 sec latency 4159.935 ms 2024-04-01T22:53:48.283 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1475 0.20 MB/sec execute 255 sec latency 3439.468 ms 2024-04-01T22:53:49.283 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1477 0.20 MB/sec execute 256 sec latency 3535.044 ms 2024-04-01T22:53:50.283 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1479 0.20 MB/sec execute 257 sec latency 4161.571 ms 2024-04-01T22:53:51.283 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1482 0.19 MB/sec execute 258 sec latency 3775.849 ms 2024-04-01T22:53:52.283 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1485 0.19 MB/sec execute 259 sec latency 3258.636 ms 2024-04-01T22:53:53.283 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1486 0.19 MB/sec execute 260 sec latency 2161.181 ms 2024-04-01T22:53:54.283 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1489 0.19 MB/sec execute 261 sec latency 2948.584 ms 2024-04-01T22:53:55.283 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1491 0.19 MB/sec execute 262 sec latency 3423.483 ms 2024-04-01T22:53:56.283 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1499 0.19 MB/sec execute 263 sec latency 3203.872 ms 2024-04-01T22:53:57.283 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1501 0.19 MB/sec execute 264 sec latency 1541.465 ms 2024-04-01T22:53:58.283 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1502 0.19 MB/sec execute 265 sec latency 2531.384 ms 2024-04-01T22:53:59.283 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1506 0.19 MB/sec execute 266 sec latency 2489.416 ms 2024-04-01T22:54:00.283 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1510 0.19 MB/sec execute 267 sec latency 3352.883 ms 2024-04-01T22:54:01.283 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1513 0.19 MB/sec execute 268 sec latency 3950.543 ms 2024-04-01T22:54:02.283 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1515 0.19 MB/sec execute 269 sec latency 4007.504 ms 2024-04-01T22:54:03.283 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1517 0.19 MB/sec execute 270 sec latency 1396.723 ms 2024-04-01T22:54:04.283 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1520 0.19 MB/sec execute 271 sec latency 2396.762 ms 2024-04-01T22:54:05.283 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1521 0.19 MB/sec execute 272 sec latency 3184.928 ms 2024-04-01T22:54:06.283 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1525 0.19 MB/sec execute 273 sec latency 3633.264 ms 2024-04-01T22:54:07.283 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1526 0.18 MB/sec execute 274 sec latency 3737.552 ms 2024-04-01T22:54:08.283 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1530 0.18 MB/sec execute 275 sec latency 3807.530 ms 2024-04-01T22:54:09.283 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1532 0.18 MB/sec execute 276 sec latency 3355.446 ms 2024-04-01T22:54:10.283 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1536 0.18 MB/sec execute 277 sec latency 3699.863 ms 2024-04-01T22:54:11.284 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1542 0.18 MB/sec execute 278 sec latency 4367.803 ms 2024-04-01T22:54:12.284 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1545 0.18 MB/sec execute 279 sec latency 4510.031 ms 2024-04-01T22:54:13.284 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1547 0.18 MB/sec execute 280 sec latency 4760.984 ms 2024-04-01T22:54:14.284 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1550 0.18 MB/sec execute 281 sec latency 4905.581 ms 2024-04-01T22:54:15.284 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1552 0.18 MB/sec execute 282 sec latency 3092.250 ms 2024-04-01T22:54:16.284 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1553 0.18 MB/sec execute 283 sec latency 3748.175 ms 2024-04-01T22:54:16.442 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:54:16.445 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:54:17.284 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1557 0.18 MB/sec execute 284 sec latency 3606.391 ms 2024-04-01T22:54:18.284 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1559 0.18 MB/sec execute 285 sec latency 4276.065 ms 2024-04-01T22:54:19.284 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1563 0.18 MB/sec execute 286 sec latency 3496.457 ms 2024-04-01T22:54:20.284 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1565 0.18 MB/sec execute 287 sec latency 3919.315 ms 2024-04-01T22:54:21.284 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1568 0.18 MB/sec execute 288 sec latency 4390.214 ms 2024-04-01T22:54:22.284 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1574 0.18 MB/sec execute 289 sec latency 3703.536 ms 2024-04-01T22:54:23.284 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1579 0.18 MB/sec execute 290 sec latency 2262.416 ms 2024-04-01T22:54:24.284 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1582 0.18 MB/sec execute 291 sec latency 3081.285 ms 2024-04-01T22:54:25.284 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1584 0.18 MB/sec execute 292 sec latency 3045.798 ms 2024-04-01T22:54:26.284 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1585 0.17 MB/sec execute 293 sec latency 3670.730 ms 2024-04-01T22:54:27.284 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1591 0.17 MB/sec execute 294 sec latency 3417.868 ms 2024-04-01T22:54:28.284 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1595 0.17 MB/sec execute 295 sec latency 2763.388 ms 2024-04-01T22:54:29.284 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1597 0.17 MB/sec execute 296 sec latency 3032.554 ms 2024-04-01T22:54:30.284 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1598 0.17 MB/sec execute 297 sec latency 3679.748 ms 2024-04-01T22:54:31.284 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1602 0.17 MB/sec execute 298 sec latency 3861.891 ms 2024-04-01T22:54:32.284 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1605 0.17 MB/sec execute 299 sec latency 4282.358 ms 2024-04-01T22:54:33.284 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1607 0.17 MB/sec execute 300 sec latency 3373.623 ms 2024-04-01T22:54:34.284 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1610 0.17 MB/sec execute 301 sec latency 1784.183 ms 2024-04-01T22:54:35.284 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1613 0.17 MB/sec execute 302 sec latency 2385.424 ms 2024-04-01T22:54:36.284 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1615 0.17 MB/sec execute 303 sec latency 3104.661 ms 2024-04-01T22:54:37.285 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1620 0.17 MB/sec execute 304 sec latency 3241.564 ms 2024-04-01T22:54:38.285 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1623 0.17 MB/sec execute 305 sec latency 942.890 ms 2024-04-01T22:54:39.285 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1624 0.17 MB/sec execute 306 sec latency 1384.100 ms 2024-04-01T22:54:40.285 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1624 0.17 MB/sec execute 307 sec latency 2384.141 ms 2024-04-01T22:54:41.285 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1624 0.17 MB/sec execute 308 sec latency 3384.174 ms 2024-04-01T22:54:42.285 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1631 0.17 MB/sec execute 309 sec latency 3547.771 ms 2024-04-01T22:54:43.285 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1637 0.17 MB/sec execute 310 sec latency 3680.597 ms 2024-04-01T22:54:44.285 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1642 0.17 MB/sec execute 311 sec latency 2241.534 ms 2024-04-01T22:54:45.285 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1643 0.17 MB/sec execute 312 sec latency 3002.757 ms 2024-04-01T22:54:46.285 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1645 0.17 MB/sec execute 313 sec latency 3012.236 ms 2024-04-01T22:54:46.581 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:54:46.583 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:54:47.285 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1647 0.16 MB/sec execute 314 sec latency 3144.542 ms 2024-04-01T22:54:48.285 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1649 0.16 MB/sec execute 315 sec latency 2757.937 ms 2024-04-01T22:54:49.285 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1651 0.16 MB/sec execute 316 sec latency 3166.840 ms 2024-04-01T22:54:50.285 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1656 0.16 MB/sec execute 317 sec latency 3414.093 ms 2024-04-01T22:54:51.285 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1657 0.16 MB/sec execute 318 sec latency 4050.402 ms 2024-04-01T22:54:52.285 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1663 0.16 MB/sec execute 319 sec latency 4535.210 ms 2024-04-01T22:54:53.285 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1670 0.16 MB/sec execute 320 sec latency 3632.707 ms 2024-04-01T22:54:54.287 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1674 0.16 MB/sec execute 321 sec latency 2436.625 ms 2024-04-01T22:54:55.285 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1680 0.16 MB/sec execute 322 sec latency 2595.306 ms 2024-04-01T22:54:56.285 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1681 0.16 MB/sec execute 323 sec latency 3225.771 ms 2024-04-01T22:54:57.285 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1688 0.16 MB/sec execute 324 sec latency 3792.614 ms 2024-04-01T22:54:58.285 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1689 0.16 MB/sec execute 325 sec latency 3972.038 ms 2024-04-01T22:54:59.285 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1691 0.16 MB/sec execute 326 sec latency 4972.067 ms 2024-04-01T22:55:00.285 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1693 0.16 MB/sec execute 327 sec latency 5906.849 ms 2024-04-01T22:55:01.285 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1694 0.16 MB/sec execute 328 sec latency 4097.492 ms 2024-04-01T22:55:02.285 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1699 0.16 MB/sec execute 329 sec latency 5097.522 ms 2024-04-01T22:55:03.285 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1700 0.16 MB/sec execute 330 sec latency 6097.569 ms 2024-04-01T22:55:04.286 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1702 0.16 MB/sec execute 331 sec latency 6913.677 ms 2024-04-01T22:55:05.285 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1702 0.16 MB/sec execute 332 sec latency 5708.980 ms 2024-04-01T22:55:06.285 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1706 0.16 MB/sec execute 333 sec latency 4218.634 ms 2024-04-01T22:55:07.286 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1708 0.16 MB/sec execute 334 sec latency 3124.252 ms 2024-04-01T22:55:08.285 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1712 0.16 MB/sec execute 335 sec latency 3588.174 ms 2024-04-01T22:55:09.286 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1719 0.16 MB/sec execute 336 sec latency 3670.844 ms 2024-04-01T22:55:10.286 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1722 0.16 MB/sec execute 337 sec latency 3670.086 ms 2024-04-01T22:55:11.286 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1725 0.15 MB/sec execute 338 sec latency 3986.902 ms 2024-04-01T22:55:12.286 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1727 0.15 MB/sec execute 339 sec latency 4986.949 ms 2024-04-01T22:55:13.286 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1734 0.15 MB/sec execute 340 sec latency 5513.664 ms 2024-04-01T22:55:14.286 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1742 0.15 MB/sec execute 341 sec latency 714.655 ms 2024-04-01T22:55:15.286 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1746 0.15 MB/sec execute 342 sec latency 1527.834 ms 2024-04-01T22:55:16.286 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1749 0.15 MB/sec execute 343 sec latency 2527.880 ms 2024-04-01T22:55:16.635 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:55:16.638 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:55:17.286 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1751 0.15 MB/sec execute 344 sec latency 3527.920 ms 2024-04-01T22:55:18.286 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1758 0.15 MB/sec execute 345 sec latency 4527.965 ms 2024-04-01T22:55:19.287 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1759 0.15 MB/sec execute 346 sec latency 4653.775 ms 2024-04-01T22:55:20.286 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1760 0.15 MB/sec execute 347 sec latency 4586.439 ms 2024-04-01T22:55:21.286 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1764 0.15 MB/sec execute 348 sec latency 4820.154 ms 2024-04-01T22:55:22.286 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1766 0.15 MB/sec execute 349 sec latency 4952.132 ms 2024-04-01T22:55:23.286 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1768 0.15 MB/sec execute 350 sec latency 3517.307 ms 2024-04-01T22:55:24.286 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1770 0.15 MB/sec execute 351 sec latency 4517.338 ms 2024-04-01T22:55:25.286 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1772 0.15 MB/sec execute 352 sec latency 5407.165 ms 2024-04-01T22:55:26.286 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1778 0.15 MB/sec execute 353 sec latency 4770.373 ms 2024-04-01T22:55:27.286 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1784 0.15 MB/sec execute 354 sec latency 4172.444 ms 2024-04-01T22:55:28.286 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1792 0.15 MB/sec execute 355 sec latency 1377.477 ms 2024-04-01T22:55:29.286 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1796 0.15 MB/sec execute 356 sec latency 2377.504 ms 2024-04-01T22:55:30.286 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1801 0.15 MB/sec execute 357 sec latency 3377.531 ms 2024-04-01T22:55:31.286 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1804 0.15 MB/sec execute 358 sec latency 3629.384 ms 2024-04-01T22:55:32.287 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1807 0.15 MB/sec execute 359 sec latency 3909.515 ms 2024-04-01T22:55:33.286 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1809 0.15 MB/sec execute 360 sec latency 4080.583 ms 2024-04-01T22:55:34.286 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1812 0.15 MB/sec execute 361 sec latency 3128.461 ms 2024-04-01T22:55:35.286 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1812 0.15 MB/sec execute 362 sec latency 3744.608 ms 2024-04-01T22:55:36.286 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1815 0.15 MB/sec execute 363 sec latency 4336.942 ms 2024-04-01T22:55:37.287 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1820 0.15 MB/sec execute 364 sec latency 4064.032 ms 2024-04-01T22:55:38.287 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1824 0.15 MB/sec execute 365 sec latency 4048.264 ms 2024-04-01T22:55:39.287 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1825 0.15 MB/sec execute 366 sec latency 2759.325 ms 2024-04-01T22:55:40.287 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1827 0.15 MB/sec execute 367 sec latency 3126.277 ms 2024-04-01T22:55:41.287 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1829 0.14 MB/sec execute 368 sec latency 3516.638 ms 2024-04-01T22:55:42.287 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1832 0.14 MB/sec execute 369 sec latency 3684.166 ms 2024-04-01T22:55:43.287 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1836 0.14 MB/sec execute 370 sec latency 3303.840 ms 2024-04-01T22:55:44.287 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1840 0.14 MB/sec execute 371 sec latency 2831.941 ms 2024-04-01T22:55:45.287 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1842 0.14 MB/sec execute 372 sec latency 2628.593 ms 2024-04-01T22:55:46.287 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1842 0.14 MB/sec execute 373 sec latency 3245.877 ms 2024-04-01T22:55:46.775 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:55:46.779 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:55:47.287 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1847 0.14 MB/sec execute 374 sec latency 3086.662 ms 2024-04-01T22:55:48.287 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1850 0.14 MB/sec execute 375 sec latency 2921.972 ms 2024-04-01T22:55:49.287 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1850 0.14 MB/sec execute 376 sec latency 2747.846 ms 2024-04-01T22:55:50.287 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1853 0.14 MB/sec execute 377 sec latency 3052.256 ms 2024-04-01T22:55:51.287 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1856 0.14 MB/sec execute 378 sec latency 3437.616 ms 2024-04-01T22:55:52.287 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1860 0.14 MB/sec execute 379 sec latency 3113.435 ms 2024-04-01T22:55:53.287 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1863 0.14 MB/sec execute 380 sec latency 2488.793 ms 2024-04-01T22:55:54.287 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1864 0.14 MB/sec execute 381 sec latency 2720.495 ms 2024-04-01T22:55:55.287 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1867 0.14 MB/sec execute 382 sec latency 2574.707 ms 2024-04-01T22:55:56.287 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1869 0.14 MB/sec execute 383 sec latency 2719.359 ms 2024-04-01T22:55:57.287 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1872 0.14 MB/sec execute 384 sec latency 2880.364 ms 2024-04-01T22:55:58.287 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1875 0.14 MB/sec execute 385 sec latency 2931.075 ms 2024-04-01T22:55:59.287 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1879 0.14 MB/sec execute 386 sec latency 2842.135 ms 2024-04-01T22:56:00.287 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1885 0.14 MB/sec execute 387 sec latency 2933.500 ms 2024-04-01T22:56:01.287 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1886 0.14 MB/sec execute 388 sec latency 2894.351 ms 2024-04-01T22:56:02.287 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1892 0.14 MB/sec execute 389 sec latency 3258.659 ms 2024-04-01T22:56:03.287 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1893 0.14 MB/sec execute 390 sec latency 3507.912 ms 2024-04-01T22:56:04.288 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1896 0.14 MB/sec execute 391 sec latency 3540.022 ms 2024-04-01T22:56:05.288 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1898 0.14 MB/sec execute 392 sec latency 3320.115 ms 2024-04-01T22:56:06.288 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1902 0.14 MB/sec execute 393 sec latency 3611.260 ms 2024-04-01T22:56:07.288 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1904 0.14 MB/sec execute 394 sec latency 3515.074 ms 2024-04-01T22:56:08.288 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1910 0.14 MB/sec execute 395 sec latency 3182.326 ms 2024-04-01T22:56:09.288 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1913 0.14 MB/sec execute 396 sec latency 3445.208 ms 2024-04-01T22:56:10.288 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1918 0.14 MB/sec execute 397 sec latency 3509.150 ms 2024-04-01T22:56:11.288 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1921 0.14 MB/sec execute 398 sec latency 3526.103 ms 2024-04-01T22:56:12.288 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1924 0.14 MB/sec execute 399 sec latency 2985.898 ms 2024-04-01T22:56:13.288 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1925 0.14 MB/sec execute 400 sec latency 3485.872 ms 2024-04-01T22:56:14.288 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1927 0.14 MB/sec execute 401 sec latency 3574.107 ms 2024-04-01T22:56:15.288 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1929 0.14 MB/sec execute 402 sec latency 3885.550 ms 2024-04-01T22:56:16.288 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1932 0.14 MB/sec execute 403 sec latency 4191.719 ms 2024-04-01T22:56:16.873 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:56:16.902 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:56:17.288 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1933 0.13 MB/sec execute 404 sec latency 3426.204 ms 2024-04-01T22:56:18.290 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1936 0.13 MB/sec execute 405 sec latency 3305.299 ms 2024-04-01T22:56:19.288 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1948 0.13 MB/sec execute 406 sec latency 2810.261 ms 2024-04-01T22:56:20.288 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1956 0.13 MB/sec execute 407 sec latency 2852.460 ms 2024-04-01T22:56:21.288 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1959 0.13 MB/sec execute 408 sec latency 3354.584 ms 2024-04-01T22:56:22.288 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1964 0.13 MB/sec execute 409 sec latency 4087.672 ms 2024-04-01T22:56:23.288 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1967 0.13 MB/sec execute 410 sec latency 4552.772 ms 2024-04-01T22:56:24.288 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1969 0.13 MB/sec execute 411 sec latency 4621.353 ms 2024-04-01T22:56:25.288 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1970 0.13 MB/sec execute 412 sec latency 3762.627 ms 2024-04-01T22:56:26.288 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1970 0.13 MB/sec execute 413 sec latency 4762.672 ms 2024-04-01T22:56:27.288 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1970 0.13 MB/sec execute 414 sec latency 5573.811 ms 2024-04-01T22:56:28.288 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1973 0.13 MB/sec execute 415 sec latency 5611.233 ms 2024-04-01T22:56:29.288 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1980 0.13 MB/sec execute 416 sec latency 5311.158 ms 2024-04-01T22:56:30.288 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1983 0.13 MB/sec execute 417 sec latency 5807.767 ms 2024-04-01T22:56:31.289 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1987 0.13 MB/sec execute 418 sec latency 3896.509 ms 2024-04-01T22:56:32.290 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1989 0.13 MB/sec execute 419 sec latency 4118.649 ms 2024-04-01T22:56:33.289 INFO:tasks.workunit.client.0.smithi047.stdout: 10 1997 0.13 MB/sec execute 420 sec latency 2916.570 ms 2024-04-01T22:56:34.289 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2001 0.13 MB/sec execute 421 sec latency 3174.338 ms 2024-04-01T22:56:35.289 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2002 0.13 MB/sec execute 422 sec latency 3636.953 ms 2024-04-01T22:56:36.289 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2007 0.13 MB/sec execute 423 sec latency 3508.456 ms 2024-04-01T22:56:37.289 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2009 0.13 MB/sec execute 424 sec latency 4161.592 ms 2024-04-01T22:56:38.289 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2012 0.13 MB/sec execute 425 sec latency 4582.003 ms 2024-04-01T22:56:39.289 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2013 0.13 MB/sec execute 426 sec latency 3797.697 ms 2024-04-01T22:56:40.289 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2016 0.13 MB/sec execute 427 sec latency 4704.562 ms 2024-04-01T22:56:41.289 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2019 0.13 MB/sec execute 428 sec latency 5704.600 ms 2024-04-01T22:56:42.289 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2022 0.13 MB/sec execute 429 sec latency 5937.374 ms 2024-04-01T22:56:43.289 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2028 0.13 MB/sec execute 430 sec latency 6025.279 ms 2024-04-01T22:56:44.289 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2030 0.13 MB/sec execute 431 sec latency 2186.366 ms 2024-04-01T22:56:45.289 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2031 0.13 MB/sec execute 432 sec latency 2682.862 ms 2024-04-01T22:56:46.289 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2033 0.13 MB/sec execute 433 sec latency 3136.934 ms 2024-04-01T22:56:47.161 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:56:47.164 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:56:47.289 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2037 0.13 MB/sec execute 434 sec latency 3386.428 ms 2024-04-01T22:56:48.289 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2039 0.13 MB/sec execute 435 sec latency 3259.208 ms 2024-04-01T22:56:49.289 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2042 0.13 MB/sec execute 436 sec latency 3134.651 ms 2024-04-01T22:56:50.289 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2045 0.13 MB/sec execute 437 sec latency 3331.716 ms 2024-04-01T22:56:51.289 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2048 0.13 MB/sec execute 438 sec latency 3974.940 ms 2024-04-01T22:56:52.289 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2053 0.13 MB/sec execute 439 sec latency 4151.271 ms 2024-04-01T22:56:53.289 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2053 0.13 MB/sec execute 440 sec latency 3404.580 ms 2024-04-01T22:56:54.289 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2054 0.13 MB/sec execute 441 sec latency 3427.686 ms 2024-04-01T22:56:55.289 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2056 0.13 MB/sec execute 442 sec latency 3146.370 ms 2024-04-01T22:56:56.289 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2057 0.13 MB/sec execute 443 sec latency 2924.932 ms 2024-04-01T22:56:57.289 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2058 0.13 MB/sec execute 444 sec latency 3483.770 ms 2024-04-01T22:56:58.290 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2062 0.13 MB/sec execute 445 sec latency 3546.926 ms 2024-04-01T22:56:59.289 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2065 0.13 MB/sec execute 446 sec latency 3776.549 ms 2024-04-01T22:57:00.290 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2067 0.13 MB/sec execute 447 sec latency 1329.361 ms 2024-04-01T22:57:01.290 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2068 0.13 MB/sec execute 448 sec latency 2329.407 ms 2024-04-01T22:57:02.290 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2069 0.13 MB/sec execute 449 sec latency 3023.065 ms 2024-04-01T22:57:03.271 INFO:tasks.ceph.mon.a.smithi047.stderr:==00:00:24:17.887 37051== Warning: unimplemented fcntl command: 1036 2024-04-01T22:57:03.290 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2070 0.12 MB/sec execute 450 sec latency 3221.141 ms 2024-04-01T22:57:03.324 INFO:tasks.ceph.mon.a.smithi047.stderr:==00:00:24:17.941 37051== Warning: unimplemented fcntl command: 1036 2024-04-01T22:57:03.384 INFO:tasks.ceph.mon.c.smithi181.stderr:==00:00:24:17.942 37188== Warning: unimplemented fcntl command: 1036 2024-04-01T22:57:03.385 INFO:tasks.ceph.mon.b.smithi181.stderr:==00:00:24:17.943 37187== Warning: unimplemented fcntl command: 1036 2024-04-01T22:57:03.385 INFO:tasks.ceph.mon.c.smithi181.stderr:==00:00:24:17.944 37188== Warning: unimplemented fcntl command: 1036 2024-04-01T22:57:03.387 INFO:tasks.ceph.mon.b.smithi181.stderr:==00:00:24:17.946 37187== Warning: unimplemented fcntl command: 1036 2024-04-01T22:57:03.439 INFO:tasks.ceph.mon.a.smithi047.stderr:==00:00:24:18.055 37051== Warning: unimplemented fcntl command: 1036 2024-04-01T22:57:03.483 INFO:tasks.ceph.mon.b.smithi181.stderr:==00:00:24:18.042 37187== Warning: unimplemented fcntl command: 1036 2024-04-01T22:57:03.498 INFO:tasks.ceph.mon.c.smithi181.stderr:==00:00:24:18.054 37188== Warning: unimplemented fcntl command: 1036 2024-04-01T22:57:04.290 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2073 0.12 MB/sec execute 451 sec latency 3738.255 ms 2024-04-01T22:57:05.290 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2075 0.12 MB/sec execute 452 sec latency 3221.765 ms 2024-04-01T22:57:06.290 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2081 0.12 MB/sec execute 453 sec latency 3637.622 ms 2024-04-01T22:57:07.290 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2082 0.12 MB/sec execute 454 sec latency 3764.344 ms 2024-04-01T22:57:08.290 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2085 0.12 MB/sec execute 455 sec latency 3819.822 ms 2024-04-01T22:57:09.290 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2090 0.12 MB/sec execute 456 sec latency 3982.415 ms 2024-04-01T22:57:10.290 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2091 0.12 MB/sec execute 457 sec latency 2175.389 ms 2024-04-01T22:57:11.290 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2092 0.12 MB/sec execute 458 sec latency 3153.516 ms 2024-04-01T22:57:12.290 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2095 0.12 MB/sec execute 459 sec latency 3244.383 ms 2024-04-01T22:57:13.290 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2100 0.12 MB/sec execute 460 sec latency 3295.834 ms 2024-04-01T22:57:14.290 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2102 0.12 MB/sec execute 461 sec latency 2728.200 ms 2024-04-01T22:57:15.290 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2102 0.12 MB/sec execute 462 sec latency 2929.037 ms 2024-04-01T22:57:16.290 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2104 0.12 MB/sec execute 463 sec latency 3153.614 ms 2024-04-01T22:57:17.225 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:57:17.227 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:57:17.290 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2106 0.12 MB/sec execute 464 sec latency 3344.369 ms 2024-04-01T22:57:18.290 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2107 0.12 MB/sec execute 465 sec latency 3485.423 ms 2024-04-01T22:57:19.290 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2110 0.12 MB/sec execute 466 sec latency 3765.777 ms 2024-04-01T22:57:20.290 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2113 0.12 MB/sec execute 467 sec latency 3633.655 ms 2024-04-01T22:57:21.290 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2121 0.12 MB/sec execute 468 sec latency 3408.767 ms 2024-04-01T22:57:22.290 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2131 0.12 MB/sec execute 469 sec latency 2417.553 ms 2024-04-01T22:57:23.290 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2136 0.12 MB/sec execute 470 sec latency 2669.445 ms 2024-04-01T22:57:24.290 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2140 0.12 MB/sec execute 471 sec latency 2766.307 ms 2024-04-01T22:57:25.290 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2143 0.12 MB/sec execute 472 sec latency 2923.139 ms 2024-04-01T22:57:26.290 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2145 0.12 MB/sec execute 473 sec latency 3240.047 ms 2024-04-01T22:57:27.290 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2147 0.12 MB/sec execute 474 sec latency 3380.211 ms 2024-04-01T22:57:28.290 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2151 0.12 MB/sec execute 475 sec latency 3418.544 ms 2024-04-01T22:57:29.290 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2151 0.12 MB/sec execute 476 sec latency 4418.572 ms 2024-04-01T22:57:30.291 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2157 0.12 MB/sec execute 477 sec latency 5133.201 ms 2024-04-01T22:57:31.291 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2160 0.12 MB/sec execute 478 sec latency 5351.916 ms 2024-04-01T22:57:32.291 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2161 0.12 MB/sec execute 479 sec latency 5827.543 ms 2024-04-01T22:57:33.291 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2165 0.12 MB/sec execute 480 sec latency 6608.305 ms 2024-04-01T22:57:34.291 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2166 0.12 MB/sec execute 481 sec latency 7029.182 ms 2024-04-01T22:57:35.291 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2169 0.12 MB/sec execute 482 sec latency 7321.318 ms 2024-04-01T22:57:36.291 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2171 0.12 MB/sec execute 483 sec latency 4747.439 ms 2024-04-01T22:57:37.291 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2173 0.12 MB/sec execute 484 sec latency 5747.471 ms 2024-04-01T22:57:38.291 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2177 0.12 MB/sec execute 485 sec latency 5833.330 ms 2024-04-01T22:57:39.291 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2180 0.12 MB/sec execute 486 sec latency 5897.499 ms 2024-04-01T22:57:40.291 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2184 0.12 MB/sec execute 487 sec latency 5327.484 ms 2024-04-01T22:57:41.291 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2185 0.12 MB/sec execute 488 sec latency 3634.021 ms 2024-04-01T22:57:42.291 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2186 0.12 MB/sec execute 489 sec latency 3921.991 ms 2024-04-01T22:57:43.291 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2191 0.12 MB/sec execute 490 sec latency 3307.658 ms 2024-04-01T22:57:44.291 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2193 0.12 MB/sec execute 491 sec latency 3147.569 ms 2024-04-01T22:57:45.291 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2199 0.12 MB/sec execute 492 sec latency 3191.419 ms 2024-04-01T22:57:46.291 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2200 0.12 MB/sec execute 493 sec latency 3542.774 ms 2024-04-01T22:57:47.291 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2201 0.12 MB/sec execute 494 sec latency 3736.798 ms 2024-04-01T22:57:47.355 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:57:47.358 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:57:48.291 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2204 0.12 MB/sec execute 495 sec latency 2993.228 ms 2024-04-01T22:57:49.291 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2206 0.12 MB/sec execute 496 sec latency 1568.172 ms 2024-04-01T22:57:50.291 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2207 0.12 MB/sec execute 497 sec latency 2568.216 ms 2024-04-01T22:57:51.291 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2209 0.12 MB/sec execute 498 sec latency 3350.883 ms 2024-04-01T22:57:52.291 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2214 0.12 MB/sec execute 499 sec latency 3511.548 ms 2024-04-01T22:57:53.292 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2219 0.12 MB/sec execute 500 sec latency 3261.693 ms 2024-04-01T22:57:54.292 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2224 0.12 MB/sec execute 501 sec latency 2308.030 ms 2024-04-01T22:57:55.292 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2230 0.12 MB/sec execute 502 sec latency 1823.043 ms 2024-04-01T22:57:56.294 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2232 0.12 MB/sec execute 503 sec latency 2754.764 ms 2024-04-01T22:57:57.292 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2239 0.12 MB/sec execute 504 sec latency 3023.378 ms 2024-04-01T22:57:58.292 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2247 0.12 MB/sec execute 505 sec latency 3321.789 ms 2024-04-01T22:57:59.292 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2251 0.12 MB/sec execute 506 sec latency 3068.428 ms 2024-04-01T22:58:00.292 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2260 0.12 MB/sec execute 507 sec latency 3670.891 ms 2024-04-01T22:58:01.292 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2270 0.12 MB/sec execute 508 sec latency 3949.542 ms 2024-04-01T22:58:02.292 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2273 0.12 MB/sec execute 509 sec latency 3816.049 ms 2024-04-01T22:58:03.292 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2284 0.13 MB/sec execute 510 sec latency 4816.079 ms 2024-04-01T22:58:04.292 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2286 0.13 MB/sec execute 511 sec latency 5143.657 ms 2024-04-01T22:58:05.292 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2287 0.13 MB/sec execute 512 sec latency 5063.508 ms 2024-04-01T22:58:06.292 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2287 0.13 MB/sec execute 513 sec latency 5382.244 ms 2024-04-01T22:58:07.292 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2288 0.13 MB/sec execute 514 sec latency 4464.235 ms 2024-04-01T22:58:08.292 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2291 0.13 MB/sec execute 515 sec latency 4808.833 ms 2024-04-01T22:58:09.292 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2297 0.13 MB/sec execute 516 sec latency 4547.816 ms 2024-04-01T22:58:10.292 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2300 0.13 MB/sec execute 517 sec latency 5301.948 ms 2024-04-01T22:58:11.292 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2307 0.13 MB/sec execute 518 sec latency 5326.169 ms 2024-04-01T22:58:12.292 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2309 0.13 MB/sec execute 519 sec latency 3416.330 ms 2024-04-01T22:58:13.292 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2310 0.13 MB/sec execute 520 sec latency 3667.497 ms 2024-04-01T22:58:14.292 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2311 0.13 MB/sec execute 521 sec latency 3012.694 ms 2024-04-01T22:58:15.292 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2312 0.13 MB/sec execute 522 sec latency 3221.929 ms 2024-04-01T22:58:16.292 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2313 0.13 MB/sec execute 523 sec latency 3272.283 ms 2024-04-01T22:58:17.292 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2314 0.13 MB/sec execute 524 sec latency 3961.927 ms 2024-04-01T22:58:17.452 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:58:17.454 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:58:18.292 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2316 0.13 MB/sec execute 525 sec latency 4082.582 ms 2024-04-01T22:58:19.292 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2318 0.13 MB/sec execute 526 sec latency 4030.462 ms 2024-04-01T22:58:20.292 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2321 0.13 MB/sec execute 527 sec latency 3233.312 ms 2024-04-01T22:58:21.292 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2322 0.13 MB/sec execute 528 sec latency 2986.874 ms 2024-04-01T22:58:22.292 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2325 0.13 MB/sec execute 529 sec latency 3292.355 ms 2024-04-01T22:58:23.292 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2327 0.13 MB/sec execute 530 sec latency 3267.303 ms 2024-04-01T22:58:23.707 INFO:tasks.ceph.mon.a.smithi047.stderr:==00:00:25:38.324 37051== Warning: unimplemented fcntl command: 1036 2024-04-01T22:58:23.719 INFO:tasks.ceph.mon.a.smithi047.stderr:==00:00:25:38.335 37051== Warning: unimplemented fcntl command: 1036 2024-04-01T22:58:23.754 INFO:tasks.ceph.mon.a.smithi047.stderr:==00:00:25:38.368 37051== Warning: unimplemented fcntl command: 1036 2024-04-01T22:58:23.771 INFO:tasks.ceph.mon.c.smithi181.stderr:==00:00:25:38.329 37188== Warning: unimplemented fcntl command: 1036 2024-04-01T22:58:23.773 INFO:tasks.ceph.mon.b.smithi181.stderr:==00:00:25:38.332 37187== Warning: unimplemented fcntl command: 1036 2024-04-01T22:58:23.776 INFO:tasks.ceph.mon.c.smithi181.stderr:==00:00:25:38.335 37188== Warning: unimplemented fcntl command: 1036 2024-04-01T22:58:23.777 INFO:tasks.ceph.mon.b.smithi181.stderr:==00:00:25:38.336 37187== Warning: unimplemented fcntl command: 1036 2024-04-01T22:58:23.810 INFO:tasks.ceph.mon.c.smithi181.stderr:==00:00:25:38.369 37188== Warning: unimplemented fcntl command: 1036 2024-04-01T22:58:23.811 INFO:tasks.ceph.mon.b.smithi181.stderr:==00:00:25:38.369 37187== Warning: unimplemented fcntl command: 1036 2024-04-01T22:58:24.292 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2328 0.13 MB/sec execute 531 sec latency 2955.237 ms 2024-04-01T22:58:25.292 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2329 0.13 MB/sec execute 532 sec latency 2849.893 ms 2024-04-01T22:58:26.292 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2334 0.13 MB/sec execute 533 sec latency 3037.895 ms 2024-04-01T22:58:27.293 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2335 0.13 MB/sec execute 534 sec latency 3014.363 ms 2024-04-01T22:58:28.293 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2336 0.13 MB/sec execute 535 sec latency 3268.481 ms 2024-04-01T22:58:29.293 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2338 0.13 MB/sec execute 536 sec latency 3134.988 ms 2024-04-01T22:58:30.293 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2341 0.13 MB/sec execute 537 sec latency 3292.353 ms 2024-04-01T22:58:31.293 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2342 0.13 MB/sec execute 538 sec latency 3473.691 ms 2024-04-01T22:58:32.293 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2342 0.13 MB/sec execute 539 sec latency 3833.595 ms 2024-04-01T22:58:33.293 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2345 0.13 MB/sec execute 540 sec latency 3573.302 ms 2024-04-01T22:58:34.293 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2347 0.13 MB/sec execute 541 sec latency 3425.891 ms 2024-04-01T22:58:35.293 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2349 0.13 MB/sec execute 542 sec latency 3482.296 ms 2024-04-01T22:58:36.293 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2351 0.13 MB/sec execute 543 sec latency 3403.833 ms 2024-04-01T22:58:37.293 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2354 0.13 MB/sec execute 544 sec latency 3122.528 ms 2024-04-01T22:58:38.293 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2357 0.13 MB/sec execute 545 sec latency 3667.398 ms 2024-04-01T22:58:39.293 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2361 0.13 MB/sec execute 546 sec latency 3403.534 ms 2024-04-01T22:58:40.293 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2364 0.13 MB/sec execute 547 sec latency 3017.193 ms 2024-04-01T22:58:41.293 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2364 0.13 MB/sec execute 548 sec latency 3282.750 ms 2024-04-01T22:58:42.293 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2365 0.13 MB/sec execute 549 sec latency 3786.153 ms 2024-04-01T22:58:43.293 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2368 0.13 MB/sec execute 550 sec latency 3496.742 ms 2024-04-01T22:58:44.294 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2371 0.13 MB/sec execute 551 sec latency 3170.524 ms 2024-04-01T22:58:45.293 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2372 0.13 MB/sec execute 552 sec latency 3212.922 ms 2024-04-01T22:58:46.293 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2372 0.12 MB/sec execute 553 sec latency 3078.271 ms 2024-04-01T22:58:47.293 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2373 0.12 MB/sec execute 554 sec latency 3564.175 ms 2024-04-01T22:58:47.507 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:58:47.510 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:58:48.293 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2375 0.12 MB/sec execute 555 sec latency 3567.422 ms 2024-04-01T22:58:49.293 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2376 0.12 MB/sec execute 556 sec latency 2522.320 ms 2024-04-01T22:58:50.294 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2376 0.12 MB/sec execute 557 sec latency 2797.000 ms 2024-04-01T22:58:51.293 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2377 0.12 MB/sec execute 558 sec latency 2727.612 ms 2024-04-01T22:58:52.293 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2380 0.12 MB/sec execute 559 sec latency 2958.411 ms 2024-04-01T22:58:53.293 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2382 0.12 MB/sec execute 560 sec latency 3301.355 ms 2024-04-01T22:58:54.294 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2385 0.12 MB/sec execute 561 sec latency 3483.933 ms 2024-04-01T22:58:55.294 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2387 0.12 MB/sec execute 562 sec latency 3678.265 ms 2024-04-01T22:58:56.294 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2389 0.12 MB/sec execute 563 sec latency 3417.894 ms 2024-04-01T22:58:57.294 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2390 0.12 MB/sec execute 564 sec latency 3482.088 ms 2024-04-01T22:58:58.294 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2396 0.12 MB/sec execute 565 sec latency 3536.088 ms 2024-04-01T22:58:59.294 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2398 0.12 MB/sec execute 566 sec latency 2693.545 ms 2024-04-01T22:59:00.294 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2399 0.12 MB/sec execute 567 sec latency 3693.605 ms 2024-04-01T22:59:01.294 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2400 0.12 MB/sec execute 568 sec latency 3747.694 ms 2024-04-01T22:59:02.294 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2403 0.12 MB/sec execute 569 sec latency 3662.671 ms 2024-04-01T22:59:03.294 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2407 0.12 MB/sec execute 570 sec latency 3747.044 ms 2024-04-01T22:59:04.294 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2410 0.12 MB/sec execute 571 sec latency 3525.818 ms 2024-04-01T22:59:05.294 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2412 0.12 MB/sec execute 572 sec latency 2828.398 ms 2024-04-01T22:59:06.294 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2414 0.12 MB/sec execute 573 sec latency 3828.432 ms 2024-04-01T22:59:07.294 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2417 0.12 MB/sec execute 574 sec latency 4037.450 ms 2024-04-01T22:59:08.294 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2419 0.12 MB/sec execute 575 sec latency 3373.319 ms 2024-04-01T22:59:09.294 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2423 0.12 MB/sec execute 576 sec latency 4078.671 ms 2024-04-01T22:59:10.294 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2425 0.12 MB/sec execute 577 sec latency 3957.182 ms 2024-04-01T22:59:11.294 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2426 0.12 MB/sec execute 578 sec latency 3410.790 ms 2024-04-01T22:59:12.294 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2428 0.12 MB/sec execute 579 sec latency 3783.074 ms 2024-04-01T22:59:13.294 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2432 0.12 MB/sec execute 580 sec latency 3875.381 ms 2024-04-01T22:59:14.294 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2437 0.12 MB/sec execute 581 sec latency 3702.381 ms 2024-04-01T22:59:15.294 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2439 0.12 MB/sec execute 582 sec latency 3302.322 ms 2024-04-01T22:59:16.295 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2440 0.12 MB/sec execute 583 sec latency 3682.492 ms 2024-04-01T22:59:17.294 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2441 0.12 MB/sec execute 584 sec latency 3303.462 ms 2024-04-01T22:59:17.655 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:59:17.657 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:59:18.294 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2444 0.12 MB/sec execute 585 sec latency 3739.359 ms 2024-04-01T22:59:19.294 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2446 0.12 MB/sec execute 586 sec latency 3453.491 ms 2024-04-01T22:59:20.295 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2452 0.12 MB/sec execute 587 sec latency 3333.000 ms 2024-04-01T22:59:21.294 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2453 0.12 MB/sec execute 588 sec latency 2815.316 ms 2024-04-01T22:59:22.295 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2455 0.12 MB/sec execute 589 sec latency 3574.720 ms 2024-04-01T22:59:23.295 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2458 0.12 MB/sec execute 590 sec latency 3510.712 ms 2024-04-01T22:59:24.295 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2460 0.12 MB/sec execute 591 sec latency 1355.815 ms 2024-04-01T22:59:25.295 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2462 0.12 MB/sec execute 592 sec latency 2355.848 ms 2024-04-01T22:59:26.295 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2466 0.12 MB/sec execute 593 sec latency 3355.888 ms 2024-04-01T22:59:27.295 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2468 0.12 MB/sec execute 594 sec latency 3728.627 ms 2024-04-01T22:59:28.295 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2471 0.12 MB/sec execute 595 sec latency 3378.017 ms 2024-04-01T22:59:29.295 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2474 0.12 MB/sec execute 596 sec latency 3081.591 ms 2024-04-01T22:59:30.295 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2481 0.13 MB/sec execute 597 sec latency 3979.445 ms 2024-04-01T22:59:31.295 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2485 0.13 MB/sec execute 598 sec latency 3966.290 ms 2024-04-01T22:59:32.295 INFO:tasks.workunit.client.0.smithi047.stdout: 10 2487 0.13 MB/sec execute 599 sec latency 4287.343 ms 2024-04-01T22:59:33.295 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 600 sec 2024-04-01T22:59:34.295 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 601 sec 2024-04-01T22:59:35.295 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 602 sec 2024-04-01T22:59:36.295 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 603 sec 2024-04-01T22:59:37.295 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 604 sec 2024-04-01T22:59:38.295 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 605 sec 2024-04-01T22:59:39.295 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 606 sec 2024-04-01T22:59:40.295 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 607 sec 2024-04-01T22:59:41.299 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 608 sec 2024-04-01T22:59:42.295 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 609 sec 2024-04-01T22:59:43.295 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 610 sec 2024-04-01T22:59:44.295 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 611 sec 2024-04-01T22:59:45.295 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 612 sec 2024-04-01T22:59:46.295 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 613 sec 2024-04-01T22:59:47.296 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 614 sec 2024-04-01T22:59:47.794 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:59:47.797 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T22:59:48.296 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 615 sec 2024-04-01T22:59:49.296 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 616 sec 2024-04-01T22:59:50.296 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 617 sec 2024-04-01T22:59:51.296 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 618 sec 2024-04-01T22:59:52.296 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 619 sec 2024-04-01T22:59:53.296 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 620 sec 2024-04-01T22:59:54.296 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 621 sec 2024-04-01T22:59:55.296 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 622 sec 2024-04-01T22:59:56.296 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 623 sec 2024-04-01T22:59:57.296 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 624 sec 2024-04-01T22:59:58.296 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 625 sec 2024-04-01T22:59:59.296 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 626 sec 2024-04-01T23:00:00.296 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 627 sec 2024-04-01T23:00:01.296 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 628 sec 2024-04-01T23:00:02.296 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 629 sec 2024-04-01T23:00:03.296 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 630 sec 2024-04-01T23:00:04.296 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 631 sec 2024-04-01T23:00:05.296 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 632 sec 2024-04-01T23:00:06.296 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 633 sec 2024-04-01T23:00:07.296 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 634 sec 2024-04-01T23:00:08.296 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 635 sec 2024-04-01T23:00:09.297 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 636 sec 2024-04-01T23:00:10.296 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 637 sec 2024-04-01T23:00:11.296 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 638 sec 2024-04-01T23:00:12.296 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 639 sec 2024-04-01T23:00:13.296 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 640 sec 2024-04-01T23:00:14.297 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 641 sec 2024-04-01T23:00:15.296 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 642 sec 2024-04-01T23:00:16.297 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 643 sec 2024-04-01T23:00:17.297 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 644 sec 2024-04-01T23:00:17.882 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T23:00:17.886 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T23:00:18.297 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 645 sec 2024-04-01T23:00:19.297 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 646 sec 2024-04-01T23:00:20.297 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 647 sec 2024-04-01T23:00:21.297 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 648 sec 2024-04-01T23:00:22.297 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 649 sec 2024-04-01T23:00:23.297 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 650 sec 2024-04-01T23:00:24.297 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 651 sec 2024-04-01T23:00:25.298 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 652 sec 2024-04-01T23:00:26.297 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 653 sec 2024-04-01T23:00:27.297 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 654 sec 2024-04-01T23:00:28.297 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 655 sec 2024-04-01T23:00:29.297 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 656 sec 2024-04-01T23:00:30.297 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 657 sec 2024-04-01T23:00:31.297 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 658 sec 2024-04-01T23:00:32.297 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 659 sec 2024-04-01T23:00:33.297 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 660 sec 2024-04-01T23:00:34.297 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 661 sec 2024-04-01T23:00:35.297 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 662 sec 2024-04-01T23:00:36.298 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 663 sec 2024-04-01T23:00:37.297 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 664 sec 2024-04-01T23:00:38.297 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 665 sec 2024-04-01T23:00:39.297 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 666 sec 2024-04-01T23:00:40.298 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 667 sec 2024-04-01T23:00:41.298 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 668 sec 2024-04-01T23:00:42.298 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 669 sec 2024-04-01T23:00:43.298 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 670 sec 2024-04-01T23:00:44.298 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 671 sec 2024-04-01T23:00:45.299 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 672 sec 2024-04-01T23:00:46.298 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 673 sec 2024-04-01T23:00:47.298 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 674 sec 2024-04-01T23:00:47.979 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T23:00:47.982 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T23:00:48.298 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 675 sec 2024-04-01T23:00:49.298 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 676 sec 2024-04-01T23:00:50.298 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 677 sec 2024-04-01T23:00:51.298 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 678 sec 2024-04-01T23:00:52.298 INFO:tasks.workunit.client.0.smithi047.stdout: 10 cleanup 679 sec 2024-04-01T23:00:52.463 INFO:tasks.ceph.mon.a.smithi047.stderr:==00:00:28:07.080 37051== Warning: unimplemented fcntl command: 1036 2024-04-01T23:00:52.468 INFO:tasks.ceph.mon.a.smithi047.stderr:==00:00:28:07.085 37051== Warning: unimplemented fcntl command: 1036 2024-04-01T23:00:52.475 INFO:tasks.ceph.mon.b.smithi181.stderr:==00:00:28:07.034 37187== Warning: unimplemented fcntl command: 1036 2024-04-01T23:00:52.476 INFO:tasks.ceph.mon.c.smithi181.stderr:==00:00:28:07.035 37188== Warning: unimplemented fcntl command: 1036 2024-04-01T23:00:52.477 INFO:tasks.ceph.mon.b.smithi181.stderr:==00:00:28:07.036 37187== Warning: unimplemented fcntl command: 1036 2024-04-01T23:00:52.478 INFO:tasks.ceph.mon.c.smithi181.stderr:==00:00:28:07.037 37188== Warning: unimplemented fcntl command: 1036 2024-04-01T23:00:52.536 INFO:tasks.ceph.mon.a.smithi047.stderr:==00:00:28:07.153 37051== Warning: unimplemented fcntl command: 1036 2024-04-01T23:00:52.537 INFO:tasks.ceph.mon.b.smithi181.stderr:==00:00:28:07.096 37187== Warning: unimplemented fcntl command: 1036 2024-04-01T23:00:52.538 INFO:tasks.ceph.mon.c.smithi181.stderr:==00:00:28:07.097 37188== Warning: unimplemented fcntl command: 1036 2024-04-01T23:00:53.298 INFO:tasks.workunit.client.0.smithi047.stdout: 9 cleanup 680 sec 2024-04-01T23:00:54.298 INFO:tasks.workunit.client.0.smithi047.stdout: 9 cleanup 681 sec 2024-04-01T23:00:55.298 INFO:tasks.workunit.client.0.smithi047.stdout: 9 cleanup 682 sec 2024-04-01T23:00:56.298 INFO:tasks.workunit.client.0.smithi047.stdout: 9 cleanup 683 sec 2024-04-01T23:00:57.298 INFO:tasks.workunit.client.0.smithi047.stdout: 3 cleanup 684 sec 2024-04-01T23:00:58.298 INFO:tasks.workunit.client.0.smithi047.stdout: 2 cleanup 685 sec 2024-04-01T23:00:59.088 INFO:tasks.workunit.client.0.smithi047.stdout: 0 cleanup 686 sec 2024-04-01T23:00:59.088 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-04-01T23:00:59.088 INFO:tasks.workunit.client.0.smithi047.stdout: Operation Count AvgLat MaxLat 2024-04-01T23:00:59.088 INFO:tasks.workunit.client.0.smithi047.stdout: ---------------------------------------- 2024-04-01T23:00:59.088 INFO:tasks.workunit.client.0.smithi047.stdout: NTCreateX 3384 337.820 2167.026 2024-04-01T23:00:59.089 INFO:tasks.workunit.client.0.smithi047.stdout: Close 2892 3.348 56.109 2024-04-01T23:00:59.089 INFO:tasks.workunit.client.0.smithi047.stdout: Rename 145 1036.451 1895.294 2024-04-01T23:00:59.089 INFO:tasks.workunit.client.0.smithi047.stdout: Unlink 365 344.724 1198.041 2024-04-01T23:00:59.089 INFO:tasks.workunit.client.0.smithi047.stdout: Qpathinfo 3261 211.743 2599.492 2024-04-01T23:00:59.089 INFO:tasks.workunit.client.0.smithi047.stdout: Qfileinfo 621 6.357 70.348 2024-04-01T23:00:59.089 INFO:tasks.workunit.client.0.smithi047.stdout: Qfsinfo 371 20.851 202.470 2024-04-01T23:00:59.089 INFO:tasks.workunit.client.0.smithi047.stdout: Sfileinfo 448 42.232 149.294 2024-04-01T23:00:59.089 INFO:tasks.workunit.client.0.smithi047.stdout: Find 1083 3458.304 7321.311 2024-04-01T23:00:59.089 INFO:tasks.workunit.client.0.smithi047.stdout: WriteX 1916 13.904 1068.140 2024-04-01T23:00:59.089 INFO:tasks.workunit.client.0.smithi047.stdout: ReadX 3800 0.142 14.816 2024-04-01T23:00:59.089 INFO:tasks.workunit.client.0.smithi047.stdout: Flush 335 321.346 975.866 2024-04-01T23:00:59.089 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-04-01T23:00:59.089 INFO:tasks.workunit.client.0.smithi047.stdout:Throughput 0.126633 MB/sec 10 clients 10 procs max_latency=7321.318 ms 2024-04-01T23:00:59.090 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-01T23:00:59.090 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-01T23:01:18.118 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T23:01:18.121 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T23:01:24.067 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2024-04-01T23:01:24.067 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-01T23:01:24.351 DEBUG:teuthology.parallel:result is None 2024-04-01T23:01:24.352 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-01T23:01:24.563 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-01T23:01:24.563 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-01T23:01:24.573 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-01T23:01:24.573 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-01T23:01:24.574 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-01T23:01:24.589 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-01T23:01:24.589 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-01T23:01:24.644 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T23:01:24.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.790+0000 7fd2c228f640 1 Processor -- start 2024-04-01T23:01:24.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.790+0000 7fd2c228f640 1 -- start start 2024-04-01T23:01:24.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.791+0000 7fd2c228f640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd2bc150880 0x7fd2bc06ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:24.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.791+0000 7fd2c228f640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd2bc06f2a0 0x7fd2bc0c4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:24.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.791+0000 7fd2c228f640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd2bc0c2c40 0x7fd2bc0c4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:24.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.791+0000 7fd2c228f640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fd2bc0c2950 con 0x7fd2bc150880 2024-04-01T23:01:24.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.791+0000 7fd2c228f640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fd2bc1574c0 con 0x7fd2bc06f2a0 2024-04-01T23:01:24.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.791+0000 7fd2c228f640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fd2bc1568b0 con 0x7fd2bc0c2c40 2024-04-01T23:01:24.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.792+0000 7fd2bbfff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd2bc150880 0x7fd2bc06ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:24.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.792+0000 7fd2bb7fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd2bc06f2a0 0x7fd2bc0c4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:24.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.792+0000 7fd2c082c640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd2bc0c2c40 0x7fd2bc0c4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:24.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.792+0000 7fd2bbfff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd2bc150880 0x7fd2bc06ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36918/0 (socket says 172.21.15.47:36918) 2024-04-01T23:01:24.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.792+0000 7fd2bbfff640 1 -- 172.21.15.47:0/4283403552 learned_addr learned my addr 172.21.15.47:0/4283403552 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:24.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.795+0000 7fd2bbfff640 1 -- 172.21.15.47:0/4283403552 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd2bc0c2c40 msgr2=0x7fd2bc0c4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:01:24.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.795+0000 7fd2bbfff640 1 --2- 172.21.15.47:0/4283403552 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd2bc0c2c40 0x7fd2bc0c4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:24.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.795+0000 7fd2bbfff640 1 -- 172.21.15.47:0/4283403552 >> v2:172.21.15.181:3300/0 conn(0x7fd2bc06f2a0 msgr2=0x7fd2bc0c4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:01:24.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.795+0000 7fd2bbfff640 1 --2- 172.21.15.47:0/4283403552 >> v2:172.21.15.181:3300/0 conn(0x7fd2bc06f2a0 0x7fd2bc0c4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:24.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.795+0000 7fd2bbfff640 1 -- 172.21.15.47:0/4283403552 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2bc156b90 con 0x7fd2bc150880 2024-04-01T23:01:24.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.797+0000 7fd2bbfff640 1 --2- 172.21.15.47:0/4283403552 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2bc150880 0x7fd2bc06ed60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc070140 tx=0x7fd2ac02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fb72e8c47c7b92 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:24.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.800+0000 7fd2baffd640 1 -- 172.21.15.47:0/4283403552 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac034070 con 0x7fd2bc150880 2024-04-01T23:01:24.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.800+0000 7fd2baffd640 1 -- 172.21.15.47:0/4283403552 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2ac030860 con 0x7fd2bc150880 2024-04-01T23:01:24.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.800+0000 7fd2baffd640 1 -- 172.21.15.47:0/4283403552 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac030c30 con 0x7fd2bc150880 2024-04-01T23:01:24.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.801+0000 7fd2c228f640 1 -- 172.21.15.47:0/4283403552 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2bc150880 msgr2=0x7fd2bc06ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:24.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.801+0000 7fd2c228f640 1 --2- 172.21.15.47:0/4283403552 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2bc150880 0x7fd2bc06ed60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc070140 tx=0x7fd2ac02b9a0 comp rx=0 tx=0).stop 2024-04-01T23:01:24.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.801+0000 7fd2c228f640 1 -- 172.21.15.47:0/4283403552 shutdown_connections 2024-04-01T23:01:24.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.801+0000 7fd2c228f640 1 --2- 172.21.15.47:0/4283403552 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd2bc0c2c40 0x7fd2bc0c4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:24.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.801+0000 7fd2c228f640 1 --2- 172.21.15.47:0/4283403552 >> v2:172.21.15.181:3300/0 conn(0x7fd2bc06f2a0 0x7fd2bc0c4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:24.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.801+0000 7fd2c228f640 1 --2- 172.21.15.47:0/4283403552 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2bc150880 0x7fd2bc06ed60 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:24.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.801+0000 7fd2c228f640 1 -- 172.21.15.47:0/4283403552 >> 172.21.15.47:0/4283403552 conn(0x7fd2bc0cb740 msgr2=0x7fd2bc0cbb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:24.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.801+0000 7fd2c228f640 1 -- 172.21.15.47:0/4283403552 shutdown_connections 2024-04-01T23:01:24.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.801+0000 7fd2c228f640 1 -- 172.21.15.47:0/4283403552 wait complete. 2024-04-01T23:01:24.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.803+0000 7fd2c228f640 1 Processor -- start 2024-04-01T23:01:24.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.803+0000 7fd2c228f640 1 -- start start 2024-04-01T23:01:24.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.804+0000 7fd2c228f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2bc06f2a0 0x7fd2bc155880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:24.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.804+0000 7fd2c228f640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd2bc0c2c40 0x7fd2bc141490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:24.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.804+0000 7fd2c228f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd2bc150880 0x7fd2bc1419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:24.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.804+0000 7fd2c228f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd2bc0c8240 con 0x7fd2bc06f2a0 2024-04-01T23:01:24.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.804+0000 7fd2c228f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd2bc157150 con 0x7fd2bc150880 2024-04-01T23:01:24.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.804+0000 7fd2c228f640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fd2bc0c83c0 con 0x7fd2bc0c2c40 2024-04-01T23:01:24.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.804+0000 7fd2bbfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2bc06f2a0 0x7fd2bc155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:24.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.804+0000 7fd2bb7fe640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd2bc0c2c40 0x7fd2bc141490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:24.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.804+0000 7fd2c082c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd2bc150880 0x7fd2bc1419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:24.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.804+0000 7fd2bbfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2bc06f2a0 0x7fd2bc155880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36932/0 (socket says 172.21.15.47:36932) 2024-04-01T23:01:24.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.804+0000 7fd2bbfff640 1 -- 172.21.15.47:0/4199333816 learned_addr learned my addr 172.21.15.47:0/4199333816 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:24.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.808+0000 7fd2bbfff640 1 -- 172.21.15.47:0/4199333816 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd2bc0c2c40 msgr2=0x7fd2bc141490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:24.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.808+0000 7fd2bbfff640 1 --2- 172.21.15.47:0/4199333816 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd2bc0c2c40 0x7fd2bc141490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:24.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.808+0000 7fd2bbfff640 1 -- 172.21.15.47:0/4199333816 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd2bc150880 msgr2=0x7fd2bc1419d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:24.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.808+0000 7fd2bbfff640 1 --2- 172.21.15.47:0/4199333816 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd2bc150880 0x7fd2bc1419d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:24.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.808+0000 7fd2bbfff640 1 -- 172.21.15.47:0/4199333816 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2bc143440 con 0x7fd2bc06f2a0 2024-04-01T23:01:24.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.810+0000 7fd2bbfff640 1 --2- 172.21.15.47:0/4199333816 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2bc06f2a0 0x7fd2bc155880 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac02b9e0 tx=0x7fd2ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:24.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.814+0000 7fd2b8ff9640 1 -- 172.21.15.47:0/4199333816 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac034040 con 0x7fd2bc06f2a0 2024-04-01T23:01:24.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.814+0000 7fd2b8ff9640 1 -- 172.21.15.47:0/4199333816 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2ac039d90 con 0x7fd2bc06f2a0 2024-04-01T23:01:24.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.814+0000 7fd2b8ff9640 1 -- 172.21.15.47:0/4199333816 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac0433f0 con 0x7fd2bc06f2a0 2024-04-01T23:01:24.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.814+0000 7fd2c228f640 1 -- 172.21.15.47:0/4199333816 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2bc1554f0 con 0x7fd2bc06f2a0 2024-04-01T23:01:24.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.814+0000 7fd2c228f640 1 -- 172.21.15.47:0/4199333816 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2bc156470 con 0x7fd2bc06f2a0 2024-04-01T23:01:24.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:24.815+0000 7fd2c228f640 1 -- 172.21.15.47:0/4199333816 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2bc068210 con 0x7fd2bc06f2a0 2024-04-01T23:01:25.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.084+0000 7fd2b8ff9640 1 -- 172.21.15.47:0/4199333816 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7fd2ac037070 con 0x7fd2bc06f2a0 2024-04-01T23:01:25.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.085+0000 7fd2b8ff9640 1 --2- 172.21.15.47:0/4199333816 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fd29c06b9e0 0x7fd29c06dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:25.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.085+0000 7fd2bb7fe640 1 --2- 172.21.15.47:0/4199333816 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fd29c06b9e0 0x7fd29c06dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:25.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.085+0000 7fd2bb7fe640 1 --2- 172.21.15.47:0/4199333816 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fd29c06b9e0 0x7fd29c06dea0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc1548c0 tx=0x7fd2a400a2a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:25.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.099+0000 7fd2b8ff9640 1 -- 172.21.15.47:0/4199333816 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fd2ac079460 con 0x7fd2bc06f2a0 2024-04-01T23:01:25.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.100+0000 7fd2b8ff9640 1 -- 172.21.15.47:0/4199333816 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fd2ac03e070 con 0x7fd2bc06f2a0 2024-04-01T23:01:25.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.295+0000 7fd2c228f640 1 -- 172.21.15.47:0/4199333816 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd2bc0c7c40 con 0x7fd2bc06f2a0 2024-04-01T23:01:25.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.371+0000 7fd2b8ff9640 1 -- 172.21.15.47:0/4199333816 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18914 (secure 0 0 0) 0x7fd2ac07b3c0 con 0x7fd2bc06f2a0 2024-04-01T23:01:25.367 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T23:01:25.368 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":27,"fsid":"a6998a48-38bc-4e42-b0d9-04f2fb5c3c87","created":"2024-04-01T22:32:57.112033+0000","modified":"2024-04-01T22:34:04.850029+0000","last_up_change":"2024-04-01T22:33:11.141073+0000","last_in_change":"2024-04-01T22:33:02.650459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T22:33:13.356568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T22:33:25.309421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T22:33:26.268050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-01T22:33:30.588103+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7bd3f25d-e3a5-4932-b381-53dcbb464dde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6811","nonce":3827395709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6813","nonce":3827395709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6817","nonce":3827395709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6815","nonce":3827395709}]},"public_addr":"172.21.15.47:6811/3827395709","cluster_addr":"172.21.15.47:6813/3827395709","heartbeat_back_addr":"172.21.15.47:6817/3827395709","heartbeat_front_addr":"172.21.15.47:6815/3827395709","state":["exists","up"]},{"osd":1,"uuid":"2aa60ba2-67ff-43c7-96c4-82ae2f3855ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6827","nonce":3152157503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6829","nonce":3152157503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6833","nonce":3152157503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6831","nonce":3152157503}]},"public_addr":"172.21.15.47:6827/3152157503","cluster_addr":"172.21.15.47:6829/3152157503","heartbeat_back_addr":"172.21.15.47:6833/3152157503","heartbeat_front_addr":"172.21.15.47:6831/3152157503","state":["exists","up"]},{"osd":2,"uuid":"d83f8a98-6db8-42b7-9ef6-5b16eb9a3492","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6803","nonce":1003968856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6805","nonce":1003968856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6809","nonce":1003968856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6807","nonce":1003968856}]},"public_addr":"172.21.15.47:6803/1003968856","cluster_addr":"172.21.15.47:6805/1003968856","heartbeat_back_addr":"172.21.15.47:6809/1003968856","heartbeat_front_addr":"172.21.15.47:6807/1003968856","state":["exists","up"]},{"osd":3,"uuid":"edc02ed5-d25c-4dc9-a0c3-7a26f20fae07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6819","nonce":2845699561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6821","nonce":2845699561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6825","nonce":2845699561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6823","nonce":2845699561}]},"public_addr":"172.21.15.47:6819/2845699561","cluster_addr":"172.21.15.47:6821/2845699561","heartbeat_back_addr":"172.21.15.47:6825/2845699561","heartbeat_front_addr":"172.21.15.47:6823/2845699561","state":["exists","up"]},{"osd":4,"uuid":"b3d67e74-f51e-4474-9c62-dd0daa60c728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6809","nonce":2961538461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6811","nonce":2961538461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6815","nonce":2961538461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6813","nonce":2961538461}]},"public_addr":"172.21.15.181:6809/2961538461","cluster_addr":"172.21.15.181:6811/2961538461","heartbeat_back_addr":"172.21.15.181:6815/2961538461","heartbeat_front_addr":"172.21.15.181:6813/2961538461","state":["exists","up"]},{"osd":5,"uuid":"d86e8f7a-99f4-4457-9949-cf2cb853e79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6817","nonce":2161566540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6819","nonce":2161566540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6823","nonce":2161566540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6821","nonce":2161566540}]},"public_addr":"172.21.15.181:6817/2161566540","cluster_addr":"172.21.15.181:6819/2161566540","heartbeat_back_addr":"172.21.15.181:6823/2161566540","heartbeat_front_addr":"172.21.15.181:6821/2161566540","state":["exists","up"]},{"osd":6,"uuid":"aa08266c-1719-4abd-afb9-e7e8ac593658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6801","nonce":3792144865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6803","nonce":3792144865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6807","nonce":3792144865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6805","nonce":3792144865}]},"public_addr":"172.21.15.181:6801/3792144865","cluster_addr":"172.21.15.181:6803/3792144865","heartbeat_back_addr":"172.21.15.181:6807/3792144865","heartbeat_front_addr":"172.21.15.181:6805/3792144865","state":["exists","up"]},{"osd":7,"uuid":"6e509762-24c8-46c3-93a1-4c50b11ebcf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6825","nonce":1760995885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6827","nonce":1760995885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6831","nonce":1760995885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6829","nonce":1760995885}]},"public_addr":"172.21.15.181:6825/1760995885","cluster_addr":"172.21.15.181:6827/1760995885","heartbeat_back_addr":"172.21.15.181:6831/1760995885","heartbeat_front_addr":"172.21.15.181:6829/1760995885","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.202426+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.255318+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.170288+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.290065+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.214871+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.176432+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.139940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.299546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.15","mappings":[{"from":7,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T23:01:25.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.373+0000 7fd2c228f640 1 -- 172.21.15.47:0/4199333816 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fd29c06b9e0 msgr2=0x7fd29c06dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:25.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.373+0000 7fd2c228f640 1 --2- 172.21.15.47:0/4199333816 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fd29c06b9e0 0x7fd29c06dea0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc1548c0 tx=0x7fd2a400a2a0 comp rx=0 tx=0).stop 2024-04-01T23:01:25.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.373+0000 7fd2c228f640 1 -- 172.21.15.47:0/4199333816 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2bc06f2a0 msgr2=0x7fd2bc155880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:25.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.373+0000 7fd2c228f640 1 --2- 172.21.15.47:0/4199333816 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2bc06f2a0 0x7fd2bc155880 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac02b9e0 tx=0x7fd2ac0046c0 comp rx=0 tx=0).stop 2024-04-01T23:01:25.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.373+0000 7fd2c228f640 1 -- 172.21.15.47:0/4199333816 shutdown_connections 2024-04-01T23:01:25.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.373+0000 7fd2c228f640 1 --2- 172.21.15.47:0/4199333816 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fd29c06b9e0 0x7fd29c06dea0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:25.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.373+0000 7fd2c228f640 1 --2- 172.21.15.47:0/4199333816 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd2bc150880 0x7fd2bc1419d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:25.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.373+0000 7fd2c228f640 1 --2- 172.21.15.47:0/4199333816 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fd2bc0c2c40 0x7fd2bc141490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:25.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.373+0000 7fd2c228f640 1 --2- 172.21.15.47:0/4199333816 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2bc06f2a0 0x7fd2bc155880 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:25.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.373+0000 7fd2c228f640 1 -- 172.21.15.47:0/4199333816 >> 172.21.15.47:0/4199333816 conn(0x7fd2bc0cb740 msgr2=0x7fd2bc0c7360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:25.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.373+0000 7fd2c228f640 1 -- 172.21.15.47:0/4199333816 shutdown_connections 2024-04-01T23:01:25.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.373+0000 7fd2c228f640 1 -- 172.21.15.47:0/4199333816 wait complete. 2024-04-01T23:01:25.381 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-01T22:33:13.356568+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-01T22:33:25.309421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-01T22:33:26.268050+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-01T22:33:30.588103+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-01T23:01:25.381 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-01T23:01:25.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.490+0000 7f066fb7a640 1 Processor -- start 2024-04-01T23:01:25.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.491+0000 7f066fb7a640 1 -- start start 2024-04-01T23:01:25.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.491+0000 7f066fb7a640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f06680c90b0 0x7f066806b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:25.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.491+0000 7f066fb7a640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f066806bd10 0x7f06680c60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:25.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.492+0000 7f066fb7a640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06680c7600 con 0x7f0668152080 2024-04-01T23:01:25.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.492+0000 7f066fb7a640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f06680c73d0 con 0x7f06680c90b0 2024-04-01T23:01:25.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.492+0000 7f066fb7a640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f06680c8180 con 0x7f066806bd10 2024-04-01T23:01:25.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.492+0000 7f066d115640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f06680c90b0 0x7f066806b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:25.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.492+0000 7f066e117640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f066806bd10 0x7f06680c60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:25.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.493+0000 7f066e117640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f066806bd10 0x7f06680c60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:43232/0 (socket says 172.21.15.47:43232) 2024-04-01T23:01:25.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.493+0000 7f066e117640 1 -- 172.21.15.47:0/1412783718 learned_addr learned my addr 172.21.15.47:0/1412783718 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:25.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.496+0000 7f066e117640 1 -- 172.21.15.47:0/1412783718 >> v2:172.21.15.47:3300/0 conn(0x7f06680c90b0 msgr2=0x7f066806b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:01:25.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.496+0000 7f066e117640 1 --2- 172.21.15.47:0/1412783718 >> v2:172.21.15.47:3300/0 conn(0x7f06680c90b0 0x7f066806b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:25.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.496+0000 7f066e117640 1 -- 172.21.15.47:0/1412783718 >> v1:172.21.15.181:6789/0 conn(0x7f0668152080 legacy=0x7f06680cd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:25.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.496+0000 7f066e117640 1 -- 172.21.15.47:0/1412783718 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06680c78e0 con 0x7f066806bd10 2024-04-01T23:01:25.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.500+0000 7f066e117640 1 --2- 172.21.15.47:0/1412783718 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f066806bd10 0x7f06680c60e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f06680b8100 tx=0x7f066002c010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff8c42fd24d6ee0b server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:25.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.505+0000 7f066c914640 1 -- 172.21.15.47:0/1412783718 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f066002cbb0 con 0x7f066806bd10 2024-04-01T23:01:25.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.505+0000 7f066c914640 1 -- 172.21.15.47:0/1412783718 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f066002cd50 con 0x7f066806bd10 2024-04-01T23:01:25.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.505+0000 7f066c914640 1 -- 172.21.15.47:0/1412783718 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0660034610 con 0x7f066806bd10 2024-04-01T23:01:25.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.505+0000 7f066fb7a640 1 -- 172.21.15.47:0/1412783718 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f066806bd10 msgr2=0x7f06680c60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:25.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.505+0000 7f066fb7a640 1 --2- 172.21.15.47:0/1412783718 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f066806bd10 0x7f06680c60e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f06680b8100 tx=0x7f066002c010 comp rx=0 tx=0).stop 2024-04-01T23:01:25.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.505+0000 7f066fb7a640 1 -- 172.21.15.47:0/1412783718 shutdown_connections 2024-04-01T23:01:25.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.505+0000 7f066fb7a640 1 --2- 172.21.15.47:0/1412783718 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f066806bd10 0x7f06680c60e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:25.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.505+0000 7f066fb7a640 1 --2- 172.21.15.47:0/1412783718 >> v2:172.21.15.47:3300/0 conn(0x7f06680c90b0 0x7f066806b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:25.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.505+0000 7f066fb7a640 1 -- 172.21.15.47:0/1412783718 >> 172.21.15.47:0/1412783718 conn(0x7f0668072a10 msgr2=0x7f066806e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:25.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.506+0000 7f066fb7a640 1 -- 172.21.15.47:0/1412783718 shutdown_connections 2024-04-01T23:01:25.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.506+0000 7f066fb7a640 1 -- 172.21.15.47:0/1412783718 wait complete. 2024-04-01T23:01:25.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.507+0000 7f066fb7a640 1 Processor -- start 2024-04-01T23:01:25.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.507+0000 7f066fb7a640 1 -- start start 2024-04-01T23:01:25.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.507+0000 7f066fb7a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f066806bd10 0x7f0668150100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:25.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.507+0000 7f066fb7a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06680c90b0 0x7f06681e36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:25.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.507+0000 7f066fb7a640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0668152080 0x7f0668148810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:25.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.507+0000 7f066fb7a640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f06680c7ea0 con 0x7f066806bd10 2024-04-01T23:01:25.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.507+0000 7f066fb7a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0668158050 con 0x7f06680c90b0 2024-04-01T23:01:25.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.507+0000 7f066fb7a640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f066806b2b0 con 0x7f0668152080 2024-04-01T23:01:25.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.508+0000 7f066d115640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06680c90b0 0x7f06681e36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:25.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.508+0000 7f066e117640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0668152080 0x7f0668148810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:25.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.508+0000 7f066d115640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06680c90b0 0x7f06681e36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:43248/0 (socket says 172.21.15.47:43248) 2024-04-01T23:01:25.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.508+0000 7f066d115640 1 -- 172.21.15.47:0/1402865938 learned_addr learned my addr 172.21.15.47:0/1402865938 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:25.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.512+0000 7f066d115640 1 -- 172.21.15.47:0/1402865938 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0668152080 msgr2=0x7f0668148810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:25.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.512+0000 7f066d115640 1 --2- 172.21.15.47:0/1402865938 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0668152080 0x7f0668148810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:25.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.512+0000 7f066d115640 1 -- 172.21.15.47:0/1402865938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f066806bd10 msgr2=0x7f0668150100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:25.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.512+0000 7f066d115640 1 --2- 172.21.15.47:0/1402865938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f066806bd10 0x7f0668150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:25.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.512+0000 7f066d115640 1 -- 172.21.15.47:0/1402865938 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06680c4010 con 0x7f06680c90b0 2024-04-01T23:01:25.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.514+0000 7f066d115640 1 --2- 172.21.15.47:0/1402865938 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06680c90b0 0x7f06681e36e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f065c00e9b0 tx=0x7f065c00ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:25.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.518+0000 7f065a7fc640 1 -- 172.21.15.47:0/1402865938 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f065c017070 con 0x7f06680c90b0 2024-04-01T23:01:25.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.518+0000 7f065a7fc640 1 -- 172.21.15.47:0/1402865938 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f065c00c9a0 con 0x7f06680c90b0 2024-04-01T23:01:25.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.518+0000 7f066fb7a640 1 -- 172.21.15.47:0/1402865938 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f066814ede0 con 0x7f06680c90b0 2024-04-01T23:01:25.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.518+0000 7f065a7fc640 1 -- 172.21.15.47:0/1402865938 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f065c00cd90 con 0x7f06680c90b0 2024-04-01T23:01:25.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.518+0000 7f066fb7a640 1 -- 172.21.15.47:0/1402865938 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f066814f3a0 con 0x7f06680c90b0 2024-04-01T23:01:25.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.519+0000 7f066fb7a640 1 -- 172.21.15.47:0/1402865938 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0668068920 con 0x7f06680c90b0 2024-04-01T23:01:25.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.769+0000 7f065a7fc640 1 -- 172.21.15.47:0/1402865938 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f065c01a070 con 0x7f06680c90b0 2024-04-01T23:01:25.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.769+0000 7f065a7fc640 1 --2- 172.21.15.47:0/1402865938 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f064c06b990 0x7f064c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:25.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.770+0000 7f066d916640 1 --2- 172.21.15.47:0/1402865938 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f064c06b990 0x7f064c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:25.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.770+0000 7f066d916640 1 --2- 172.21.15.47:0/1402865938 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f064c06b990 0x7f064c06de50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0664000f60 tx=0x7f06640079d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:25.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.774+0000 7f065a7fc640 1 -- 172.21.15.47:0/1402865938 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f065c057600 con 0x7f06680c90b0 2024-04-01T23:01:25.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.785+0000 7f065a7fc640 1 -- 172.21.15.47:0/1402865938 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f065c059560 con 0x7f06680c90b0 2024-04-01T23:01:25.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.967+0000 7f066fb7a640 1 -- 172.21.15.47:0/1402865938 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0668157150 con 0x7f06680c90b0 2024-04-01T23:01:25.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.972+0000 7f065a7fc640 1 -- 172.21.15.47:0/1402865938 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f065c05d600 con 0x7f06680c90b0 2024-04-01T23:01:25.968 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-01T23:01:25.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.974+0000 7f066fb7a640 1 -- 172.21.15.47:0/1402865938 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f064c06b990 msgr2=0x7f064c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:25.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.974+0000 7f066fb7a640 1 --2- 172.21.15.47:0/1402865938 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f064c06b990 0x7f064c06de50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0664000f60 tx=0x7f06640079d0 comp rx=0 tx=0).stop 2024-04-01T23:01:25.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.974+0000 7f066fb7a640 1 -- 172.21.15.47:0/1402865938 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06680c90b0 msgr2=0x7f06681e36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:25.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.974+0000 7f066fb7a640 1 --2- 172.21.15.47:0/1402865938 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06680c90b0 0x7f06681e36e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f065c00e9b0 tx=0x7f065c00ee70 comp rx=0 tx=0).stop 2024-04-01T23:01:25.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.974+0000 7f066fb7a640 1 -- 172.21.15.47:0/1402865938 shutdown_connections 2024-04-01T23:01:25.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.974+0000 7f066fb7a640 1 --2- 172.21.15.47:0/1402865938 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f064c06b990 0x7f064c06de50 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:25.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.974+0000 7f066fb7a640 1 --2- 172.21.15.47:0/1402865938 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0668152080 0x7f0668148810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:25.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.974+0000 7f066fb7a640 1 --2- 172.21.15.47:0/1402865938 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06680c90b0 0x7f06681e36e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:25.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.974+0000 7f066fb7a640 1 --2- 172.21.15.47:0/1402865938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f066806bd10 0x7f0668150100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:25.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.974+0000 7f066fb7a640 1 -- 172.21.15.47:0/1402865938 >> 172.21.15.47:0/1402865938 conn(0x7f0668072a10 msgr2=0x7f06681513d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:25.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.974+0000 7f066fb7a640 1 -- 172.21.15.47:0/1402865938 shutdown_connections 2024-04-01T23:01:25.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:25.974+0000 7f066fb7a640 1 -- 172.21.15.47:0/1402865938 wait complete. 2024-04-01T23:01:25.981 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-01T23:01:26.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.091+0000 7f214a84e640 1 Processor -- start 2024-04-01T23:01:26.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.091+0000 7f214a84e640 1 -- start start 2024-04-01T23:01:26.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.092+0000 7f214a84e640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2144154660 0x7f214415e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:26.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.092+0000 7f214a84e640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f21440c88c0 0x7f21440c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:26.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.092+0000 7f214a84e640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21440c99d0 con 0x7f21440ca580 2024-04-01T23:01:26.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.092+0000 7f214a84e640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f21440c3790 con 0x7f2144154660 2024-04-01T23:01:26.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.092+0000 7f214a84e640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f21440c9cb0 con 0x7f21440c88c0 2024-04-01T23:01:26.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.093+0000 7f2143fff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2144154660 0x7f214415e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:26.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.093+0000 7f21437fe640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f21440c88c0 0x7f21440c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:26.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.093+0000 7f21437fe640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f21440c88c0 0x7f21440c8d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:52942/0 (socket says 172.21.15.47:52942) 2024-04-01T23:01:26.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.093+0000 7f21437fe640 1 -- 172.21.15.47:0/2374065125 learned_addr learned my addr 172.21.15.47:0/2374065125 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:26.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.095+0000 7f21437fe640 1 -- 172.21.15.47:0/2374065125 >> v2:172.21.15.181:3300/0 conn(0x7f2144154660 msgr2=0x7f214415e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:01:26.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.095+0000 7f21437fe640 1 --2- 172.21.15.47:0/2374065125 >> v2:172.21.15.181:3300/0 conn(0x7f2144154660 0x7f214415e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:26.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.095+0000 7f21437fe640 1 -- 172.21.15.47:0/2374065125 >> v1:172.21.15.181:6789/0 conn(0x7f21440ca580 legacy=0x7f21440ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:01:26.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.095+0000 7f21437fe640 1 -- 172.21.15.47:0/2374065125 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21440c9f90 con 0x7f21440c88c0 2024-04-01T23:01:26.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.097+0000 7f21437fe640 1 --2- 172.21.15.47:0/2374065125 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f21440c88c0 0x7f21440c8d30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2134009870 tx=0x7f213402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2502694eeecdeb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:26.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.101+0000 7f2142ffd640 1 -- 172.21.15.47:0/2374065125 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2134035020 con 0x7f21440c88c0 2024-04-01T23:01:26.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.101+0000 7f2142ffd640 1 -- 172.21.15.47:0/2374065125 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2134031640 con 0x7f21440c88c0 2024-04-01T23:01:26.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.101+0000 7f2142ffd640 1 -- 172.21.15.47:0/2374065125 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f213402d040 con 0x7f21440c88c0 2024-04-01T23:01:26.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.101+0000 7f214a84e640 1 -- 172.21.15.47:0/2374065125 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f21440c88c0 msgr2=0x7f21440c8d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:26.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.101+0000 7f214a84e640 1 --2- 172.21.15.47:0/2374065125 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f21440c88c0 0x7f21440c8d30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2134009870 tx=0x7f213402b8f0 comp rx=0 tx=0).stop 2024-04-01T23:01:26.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.101+0000 7f214a84e640 1 -- 172.21.15.47:0/2374065125 shutdown_connections 2024-04-01T23:01:26.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.101+0000 7f214a84e640 1 --2- 172.21.15.47:0/2374065125 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f21440c88c0 0x7f21440c8d30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:26.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.101+0000 7f214a84e640 1 --2- 172.21.15.47:0/2374065125 >> v2:172.21.15.181:3300/0 conn(0x7f2144154660 0x7f214415e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:26.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.101+0000 7f214a84e640 1 -- 172.21.15.47:0/2374065125 >> 172.21.15.47:0/2374065125 conn(0x7f2144071310 msgr2=0x7f2144071720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:26.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.101+0000 7f214a84e640 1 -- 172.21.15.47:0/2374065125 shutdown_connections 2024-04-01T23:01:26.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.101+0000 7f214a84e640 1 -- 172.21.15.47:0/2374065125 wait complete. 2024-04-01T23:01:26.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.102+0000 7f214a84e640 1 Processor -- start 2024-04-01T23:01:26.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.102+0000 7f214a84e640 1 -- start start 2024-04-01T23:01:26.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.103+0000 7f214a84e640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f21440c88c0 0x7f2144153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:26.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.103+0000 7f214a84e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21440ca580 0x7f2144159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:26.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.103+0000 7f214a84e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2144154660 0x7f214415a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:26.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.103+0000 7f214a84e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f21440ca270 con 0x7f21440ca580 2024-04-01T23:01:26.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.103+0000 7f214a84e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f214415de60 con 0x7f2144154660 2024-04-01T23:01:26.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.103+0000 7f214a84e640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f214406c8f0 con 0x7f21440c88c0 2024-04-01T23:01:26.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.104+0000 7f21437fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21440ca580 0x7f2144159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:26.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.104+0000 7f2143fff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f21440c88c0 0x7f2144153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:26.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.104+0000 7f2148deb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2144154660 0x7f214415a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:26.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.104+0000 7f2143fff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f21440c88c0 0x7f2144153650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:52950/0 (socket says 172.21.15.47:52950) 2024-04-01T23:01:26.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.104+0000 7f2143fff640 1 -- 172.21.15.47:0/2906698589 learned_addr learned my addr 172.21.15.47:0/2906698589 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:26.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.107+0000 7f2143fff640 1 -- 172.21.15.47:0/2906698589 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2144154660 msgr2=0x7f214415a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:26.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.107+0000 7f2143fff640 1 --2- 172.21.15.47:0/2906698589 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2144154660 0x7f214415a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:26.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.107+0000 7f2143fff640 1 -- 172.21.15.47:0/2906698589 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21440ca580 msgr2=0x7f2144159cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:26.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.107+0000 7f2143fff640 1 --2- 172.21.15.47:0/2906698589 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21440ca580 0x7f2144159cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:26.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.107+0000 7f2143fff640 1 -- 172.21.15.47:0/2906698589 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21440ad8c0 con 0x7f21440c88c0 2024-04-01T23:01:26.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.109+0000 7f2143fff640 1 --2- 172.21.15.47:0/2906698589 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f21440c88c0 0x7f2144153650 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f213800e870 tx=0x7f213800ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:26.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.113+0000 7f2140ff9640 1 -- 172.21.15.47:0/2906698589 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2138017070 con 0x7f21440c88c0 2024-04-01T23:01:26.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.113+0000 7f2140ff9640 1 -- 172.21.15.47:0/2906698589 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f213800c940 con 0x7f21440c88c0 2024-04-01T23:01:26.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.113+0000 7f214a84e640 1 -- 172.21.15.47:0/2906698589 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f214415d730 con 0x7f21440c88c0 2024-04-01T23:01:26.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.113+0000 7f2140ff9640 1 -- 172.21.15.47:0/2906698589 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f213800cd30 con 0x7f21440c88c0 2024-04-01T23:01:26.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.113+0000 7f214a84e640 1 -- 172.21.15.47:0/2906698589 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f21440adc00 con 0x7f21440c88c0 2024-04-01T23:01:26.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.114+0000 7f214a84e640 1 -- 172.21.15.47:0/2906698589 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2144068210 con 0x7f21440c88c0 2024-04-01T23:01:26.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.132+0000 7f2140ff9640 1 -- 172.21.15.47:0/2906698589 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f213801a070 con 0x7f21440c88c0 2024-04-01T23:01:26.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.133+0000 7f2140ff9640 1 --2- 172.21.15.47:0/2906698589 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f213006b9e0 0x7f213006dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:26.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.133+0000 7f21437fe640 1 --2- 172.21.15.47:0/2906698589 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f213006b9e0 0x7f213006dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:26.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.133+0000 7f21437fe640 1 --2- 172.21.15.47:0/2906698589 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f213006b9e0 0x7f213006dea0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2134036000 tx=0x7f213403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:26.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.135+0000 7f2140ff9640 1 -- 172.21.15.47:0/2906698589 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f2138057450 con 0x7f21440c88c0 2024-04-01T23:01:26.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.368+0000 7f2140ff9640 1 -- 172.21.15.47:0/2906698589 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f21380593b0 con 0x7f21440c88c0 2024-04-01T23:01:26.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.553+0000 7f214a84e640 1 -- 172.21.15.47:0/2906698589 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f21440adf10 con 0x7f21440c88c0 2024-04-01T23:01:26.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.558+0000 7f2140ff9640 1 -- 172.21.15.47:0/2906698589 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f213805d450 con 0x7f21440c88c0 2024-04-01T23:01:26.554 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-01T23:01:26.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.560+0000 7f214a84e640 1 -- 172.21.15.47:0/2906698589 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f213006b9e0 msgr2=0x7f213006dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:26.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.560+0000 7f214a84e640 1 --2- 172.21.15.47:0/2906698589 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f213006b9e0 0x7f213006dea0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2134036000 tx=0x7f213403c040 comp rx=0 tx=0).stop 2024-04-01T23:01:26.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.560+0000 7f214a84e640 1 -- 172.21.15.47:0/2906698589 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f21440c88c0 msgr2=0x7f2144153650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:26.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.560+0000 7f214a84e640 1 --2- 172.21.15.47:0/2906698589 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f21440c88c0 0x7f2144153650 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f213800e870 tx=0x7f213800ed30 comp rx=0 tx=0).stop 2024-04-01T23:01:26.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.560+0000 7f214a84e640 1 -- 172.21.15.47:0/2906698589 shutdown_connections 2024-04-01T23:01:26.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.560+0000 7f214a84e640 1 --2- 172.21.15.47:0/2906698589 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f213006b9e0 0x7f213006dea0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:26.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.560+0000 7f214a84e640 1 --2- 172.21.15.47:0/2906698589 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2144154660 0x7f214415a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:26.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.560+0000 7f214a84e640 1 --2- 172.21.15.47:0/2906698589 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21440ca580 0x7f2144159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:26.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.560+0000 7f214a84e640 1 --2- 172.21.15.47:0/2906698589 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f21440c88c0 0x7f2144153650 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:26.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.560+0000 7f214a84e640 1 -- 172.21.15.47:0/2906698589 >> 172.21.15.47:0/2906698589 conn(0x7f2144071310 msgr2=0x7f214406dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:26.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.560+0000 7f214a84e640 1 -- 172.21.15.47:0/2906698589 shutdown_connections 2024-04-01T23:01:26.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.560+0000 7f214a84e640 1 -- 172.21.15.47:0/2906698589 wait complete. 2024-04-01T23:01:26.568 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-01T23:01:26.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.677+0000 7f26743d0640 1 Processor -- start 2024-04-01T23:01:26.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.677+0000 7f26743d0640 1 -- start start 2024-04-01T23:01:26.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.678+0000 7f26743d0640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f266c0ca580 0x7f266c0ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:26.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.678+0000 7f26743d0640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f266c15bd80 0x7f266c15c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:26.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.678+0000 7f26743d0640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f266c15c750 con 0x7f266c152210 2024-04-01T23:01:26.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.678+0000 7f26743d0640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f266c0caf10 con 0x7f266c0ca580 2024-04-01T23:01:26.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.678+0000 7f26743d0640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f266c1585a0 con 0x7f266c15bd80 2024-04-01T23:01:26.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.679+0000 7f267196b640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f266c0ca580 0x7f266c0ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:26.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.679+0000 7f267296d640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f266c15bd80 0x7f266c15c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:26.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.679+0000 7f267296d640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f266c15bd80 0x7f266c15c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:52966/0 (socket says 172.21.15.47:52966) 2024-04-01T23:01:26.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.679+0000 7f267296d640 1 -- 172.21.15.47:0/1622505562 learned_addr learned my addr 172.21.15.47:0/1622505562 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:26.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.681+0000 7f267296d640 1 -- 172.21.15.47:0/1622505562 >> v2:172.21.15.47:3300/0 conn(0x7f266c0ca580 msgr2=0x7f266c0ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:01:26.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.681+0000 7f267296d640 1 --2- 172.21.15.47:0/1622505562 >> v2:172.21.15.47:3300/0 conn(0x7f266c0ca580 0x7f266c0ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:26.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.681+0000 7f267296d640 1 -- 172.21.15.47:0/1622505562 >> v1:172.21.15.47:6789/0 conn(0x7f266c152210 legacy=0x7f266c0c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:26.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.681+0000 7f267296d640 1 -- 172.21.15.47:0/1622505562 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f266c158880 con 0x7f266c15bd80 2024-04-01T23:01:26.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.683+0000 7f267296d640 1 --2- 172.21.15.47:0/1622505562 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f266c15bd80 0x7f266c15c210 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2664009e50 tx=0x7f266402bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23e8fdf89b503b77 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:26.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.687+0000 7f267116a640 1 -- 172.21.15.47:0/1622505562 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f266402cb00 con 0x7f266c15bd80 2024-04-01T23:01:26.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.687+0000 7f267116a640 1 -- 172.21.15.47:0/1622505562 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f266402cca0 con 0x7f266c15bd80 2024-04-01T23:01:26.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.687+0000 7f267116a640 1 -- 172.21.15.47:0/1622505562 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2664034610 con 0x7f266c15bd80 2024-04-01T23:01:26.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.687+0000 7f26743d0640 1 -- 172.21.15.47:0/1622505562 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f266c15bd80 msgr2=0x7f266c15c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:26.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.687+0000 7f26743d0640 1 --2- 172.21.15.47:0/1622505562 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f266c15bd80 0x7f266c15c210 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2664009e50 tx=0x7f266402bf60 comp rx=0 tx=0).stop 2024-04-01T23:01:26.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.688+0000 7f26743d0640 1 -- 172.21.15.47:0/1622505562 shutdown_connections 2024-04-01T23:01:26.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.688+0000 7f26743d0640 1 --2- 172.21.15.47:0/1622505562 >> v2:172.21.15.47:3300/0 conn(0x7f266c0ca580 0x7f266c0ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:26.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.688+0000 7f26743d0640 1 --2- 172.21.15.47:0/1622505562 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f266c15bd80 0x7f266c15c210 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:26.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.688+0000 7f26743d0640 1 -- 172.21.15.47:0/1622505562 >> 172.21.15.47:0/1622505562 conn(0x7f266c071310 msgr2=0x7f266c071720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:26.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.688+0000 7f26743d0640 1 -- 172.21.15.47:0/1622505562 shutdown_connections 2024-04-01T23:01:26.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.688+0000 7f26743d0640 1 -- 172.21.15.47:0/1622505562 wait complete. 2024-04-01T23:01:26.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.689+0000 7f26743d0640 1 Processor -- start 2024-04-01T23:01:26.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.689+0000 7f26743d0640 1 -- start start 2024-04-01T23:01:26.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.690+0000 7f26743d0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f266c0ca580 0x7f266c14f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:26.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.690+0000 7f26743d0640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f266c152210 0x7f266c0cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:26.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.690+0000 7f26743d0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f266c15bd80 0x7f266c0ce210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:26.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.690+0000 7f26743d0640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f266c159120 con 0x7f266c15bd80 2024-04-01T23:01:26.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.690+0000 7f26743d0640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f266c158e40 con 0x7f266c0ca580 2024-04-01T23:01:26.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.690+0000 7f26743d0640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f266c15b860 con 0x7f266c152210 2024-04-01T23:01:26.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.690+0000 7f267296d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f266c15bd80 0x7f266c0ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:26.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.690+0000 7f267196b640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f266c152210 0x7f266c0cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:26.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.690+0000 7f267216c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f266c0ca580 0x7f266c14f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:26.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.690+0000 7f267296d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f266c15bd80 0x7f266c0ce210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36968/0 (socket says 172.21.15.47:36968) 2024-04-01T23:01:26.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.690+0000 7f267296d640 1 -- 172.21.15.47:0/295913717 learned_addr learned my addr 172.21.15.47:0/295913717 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:26.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.694+0000 7f267196b640 1 -- 172.21.15.47:0/295913717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f266c0ca580 msgr2=0x7f266c14f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:26.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.694+0000 7f267196b640 1 --2- 172.21.15.47:0/295913717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f266c0ca580 0x7f266c14f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:26.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.694+0000 7f267196b640 1 -- 172.21.15.47:0/295913717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f266c15bd80 msgr2=0x7f266c0ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:26.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.694+0000 7f267196b640 1 --2- 172.21.15.47:0/295913717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f266c15bd80 0x7f266c0ce210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:26.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.694+0000 7f267196b640 1 -- 172.21.15.47:0/295913717 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f266c0c5340 con 0x7f266c152210 2024-04-01T23:01:26.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.696+0000 7f267196b640 1 --2- 172.21.15.47:0/295913717 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f266c152210 0x7f266c0cdcd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f266000e880 tx=0x7f266000ed40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:26.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.700+0000 7f265effd640 1 -- 172.21.15.47:0/295913717 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2660017070 con 0x7f266c152210 2024-04-01T23:01:26.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.700+0000 7f265effd640 1 -- 172.21.15.47:0/295913717 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f266000c940 con 0x7f266c152210 2024-04-01T23:01:26.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.700+0000 7f26743d0640 1 -- 172.21.15.47:0/295913717 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f266c1580c0 con 0x7f266c152210 2024-04-01T23:01:26.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.700+0000 7f265effd640 1 -- 172.21.15.47:0/295913717 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f266000cd30 con 0x7f266c152210 2024-04-01T23:01:26.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.700+0000 7f26743d0640 1 -- 172.21.15.47:0/295913717 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f266c0c5060 con 0x7f266c152210 2024-04-01T23:01:26.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.701+0000 7f26743d0640 1 -- 172.21.15.47:0/295913717 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f266c068210 con 0x7f266c152210 2024-04-01T23:01:26.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.947+0000 7f265effd640 1 -- 172.21.15.47:0/295913717 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f266001a070 con 0x7f266c152210 2024-04-01T23:01:26.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.947+0000 7f265effd640 1 --2- 172.21.15.47:0/295913717 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f265006b9e0 0x7f265006dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:26.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.948+0000 7f267216c640 1 --2- 172.21.15.47:0/295913717 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f265006b9e0 0x7f265006dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:26.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.948+0000 7f267216c640 1 --2- 172.21.15.47:0/295913717 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f265006b9e0 0x7f265006dea0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2668001780 tx=0x7f2668009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:26.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.950+0000 7f265effd640 1 -- 172.21.15.47:0/295913717 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f2660057510 con 0x7f266c152210 2024-04-01T23:01:26.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:26.960+0000 7f265effd640 1 -- 172.21.15.47:0/295913717 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f2660059470 con 0x7f266c152210 2024-04-01T23:01:27.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.143+0000 7f26743d0640 1 -- 172.21.15.47:0/295913717 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f266c0c9370 con 0x7f266c152210 2024-04-01T23:01:27.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.148+0000 7f265effd640 1 -- 172.21.15.47:0/295913717 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f266005d510 con 0x7f266c152210 2024-04-01T23:01:27.143 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-04-01T23:01:27.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.149+0000 7f26743d0640 1 -- 172.21.15.47:0/295913717 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f265006b9e0 msgr2=0x7f265006dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:27.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.149+0000 7f26743d0640 1 --2- 172.21.15.47:0/295913717 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f265006b9e0 0x7f265006dea0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2668001780 tx=0x7f2668009040 comp rx=0 tx=0).stop 2024-04-01T23:01:27.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.149+0000 7f26743d0640 1 -- 172.21.15.47:0/295913717 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f266c152210 msgr2=0x7f266c0cdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:27.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.149+0000 7f26743d0640 1 --2- 172.21.15.47:0/295913717 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f266c152210 0x7f266c0cdcd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f266000e880 tx=0x7f266000ed40 comp rx=0 tx=0).stop 2024-04-01T23:01:27.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.149+0000 7f26743d0640 1 -- 172.21.15.47:0/295913717 shutdown_connections 2024-04-01T23:01:27.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.149+0000 7f26743d0640 1 --2- 172.21.15.47:0/295913717 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f265006b9e0 0x7f265006dea0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:27.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.149+0000 7f26743d0640 1 --2- 172.21.15.47:0/295913717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f266c15bd80 0x7f266c0ce210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:27.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.149+0000 7f26743d0640 1 --2- 172.21.15.47:0/295913717 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f266c152210 0x7f266c0cdcd0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:27.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.149+0000 7f26743d0640 1 --2- 172.21.15.47:0/295913717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f266c0ca580 0x7f266c14f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:27.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.149+0000 7f26743d0640 1 -- 172.21.15.47:0/295913717 >> 172.21.15.47:0/295913717 conn(0x7f266c071310 msgr2=0x7f266c0b3970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:27.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.150+0000 7f26743d0640 1 -- 172.21.15.47:0/295913717 shutdown_connections 2024-04-01T23:01:27.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.150+0000 7f26743d0640 1 -- 172.21.15.47:0/295913717 wait complete. 2024-04-01T23:01:27.157 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-01T23:01:27.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.266+0000 7ffa0808f640 1 Processor -- start 2024-04-01T23:01:27.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.266+0000 7ffa0808f640 1 -- start start 2024-04-01T23:01:27.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.267+0000 7ffa0808f640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffa000c93f0 0x7ffa000cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:27.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.267+0000 7ffa0808f640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ffa0015afc0 0x7ffa0006c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:27.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.267+0000 7ffa0808f640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ffa0006c770 0x7ffa000cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:27.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.267+0000 7ffa0808f640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7ffa000cdae0 con 0x7ffa0006c770 2024-04-01T23:01:27.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.267+0000 7ffa0808f640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7ffa000c97d0 con 0x7ffa0015afc0 2024-04-01T23:01:27.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.267+0000 7ffa0808f640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7ffa000cdd80 con 0x7ffa000c93f0 2024-04-01T23:01:27.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.268+0000 7ffa0662c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ffa0006c770 0x7ffa000cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:27.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.268+0000 7ffa0562a640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ffa0015afc0 0x7ffa0006c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:27.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.268+0000 7ffa05e2b640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffa000c93f0 0x7ffa000cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:27.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.268+0000 7ffa05e2b640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffa000c93f0 0x7ffa000cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:52994/0 (socket says 172.21.15.47:52994) 2024-04-01T23:01:27.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.268+0000 7ffa05e2b640 1 -- 172.21.15.47:0/1135908154 learned_addr learned my addr 172.21.15.47:0/1135908154 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:27.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.270+0000 7ffa0562a640 1 -- 172.21.15.47:0/1135908154 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffa000c93f0 msgr2=0x7ffa000cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:01:27.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.270+0000 7ffa0562a640 1 --2- 172.21.15.47:0/1135908154 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffa000c93f0 0x7ffa000cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:27.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.270+0000 7ffa0562a640 1 -- 172.21.15.47:0/1135908154 >> v2:172.21.15.47:3300/0 conn(0x7ffa0006c770 msgr2=0x7ffa000cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:01:27.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.270+0000 7ffa0562a640 1 --2- 172.21.15.47:0/1135908154 >> v2:172.21.15.47:3300/0 conn(0x7ffa0006c770 0x7ffa000cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:27.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.270+0000 7ffa0562a640 1 -- 172.21.15.47:0/1135908154 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa000ce060 con 0x7ffa0015afc0 2024-04-01T23:01:27.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.270+0000 7ffa05e2b640 1 --2- 172.21.15.47:0/1135908154 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffa000c93f0 0x7ffa000cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T23:01:27.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.272+0000 7ffa0562a640 1 --2- 172.21.15.47:0/1135908154 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa0015afc0 0x7ffa0006c230 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ffa0006b6d0 tx=0x7ff9f002b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=297cf713708f13fe server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:27.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.276+0000 7ffa04e29640 1 -- 172.21.15.47:0/1135908154 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f0038070 con 0x7ffa0015afc0 2024-04-01T23:01:27.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.276+0000 7ffa04e29640 1 -- 172.21.15.47:0/1135908154 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9f0031700 con 0x7ffa0015afc0 2024-04-01T23:01:27.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.276+0000 7ffa04e29640 1 -- 172.21.15.47:0/1135908154 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f0031ad0 con 0x7ffa0015afc0 2024-04-01T23:01:27.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.276+0000 7ffa0808f640 1 -- 172.21.15.47:0/1135908154 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa0015afc0 msgr2=0x7ffa0006c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:27.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.276+0000 7ffa0808f640 1 --2- 172.21.15.47:0/1135908154 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa0015afc0 0x7ffa0006c230 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ffa0006b6d0 tx=0x7ff9f002b7a0 comp rx=0 tx=0).stop 2024-04-01T23:01:27.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.277+0000 7ffa0808f640 1 -- 172.21.15.47:0/1135908154 shutdown_connections 2024-04-01T23:01:27.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.277+0000 7ffa0808f640 1 --2- 172.21.15.47:0/1135908154 >> v2:172.21.15.47:3300/0 conn(0x7ffa0006c770 0x7ffa000cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:27.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.277+0000 7ffa0808f640 1 --2- 172.21.15.47:0/1135908154 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa0015afc0 0x7ffa0006c230 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:27.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.277+0000 7ffa0808f640 1 --2- 172.21.15.47:0/1135908154 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffa000c93f0 0x7ffa000cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:27.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.277+0000 7ffa0808f640 1 -- 172.21.15.47:0/1135908154 >> 172.21.15.47:0/1135908154 conn(0x7ffa000cfdb0 msgr2=0x7ffa000d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:27.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.277+0000 7ffa0808f640 1 -- 172.21.15.47:0/1135908154 shutdown_connections 2024-04-01T23:01:27.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.277+0000 7ffa0808f640 1 -- 172.21.15.47:0/1135908154 wait complete. 2024-04-01T23:01:27.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.278+0000 7ffa0808f640 1 Processor -- start 2024-04-01T23:01:27.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.278+0000 7ffa0808f640 1 -- start start 2024-04-01T23:01:27.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.278+0000 7ffa0808f640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffa0006c770 0x7ffa000af030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:27.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.278+0000 7ffa0808f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa000c93f0 0x7ffa000ad6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:27.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.278+0000 7ffa0808f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa0015afc0 0x7ffa000c3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:27.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.278+0000 7ffa0808f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ffa0015b400 con 0x7ffa000c93f0 2024-04-01T23:01:27.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.278+0000 7ffa0808f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ffa000ce620 con 0x7ffa0015afc0 2024-04-01T23:01:27.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.278+0000 7ffa0808f640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7ffa000cf430 con 0x7ffa0006c770 2024-04-01T23:01:27.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.279+0000 7ffa0562a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa000c93f0 0x7ffa000ad6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:27.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.279+0000 7ffa05e2b640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffa0006c770 0x7ffa000af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:27.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.279+0000 7ffa0662c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa0015afc0 0x7ffa000c3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:27.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.279+0000 7ffa0562a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa000c93f0 0x7ffa000ad6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36980/0 (socket says 172.21.15.47:36980) 2024-04-01T23:01:27.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.279+0000 7ffa0562a640 1 -- 172.21.15.47:0/4003481254 learned_addr learned my addr 172.21.15.47:0/4003481254 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:27.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.283+0000 7ffa0662c640 1 -- 172.21.15.47:0/4003481254 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffa0006c770 msgr2=0x7ffa000af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:27.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.283+0000 7ffa0662c640 1 --2- 172.21.15.47:0/4003481254 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffa0006c770 0x7ffa000af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:27.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.283+0000 7ffa0662c640 1 -- 172.21.15.47:0/4003481254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa000c93f0 msgr2=0x7ffa000ad6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:27.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.283+0000 7ffa0662c640 1 --2- 172.21.15.47:0/4003481254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa000c93f0 0x7ffa000ad6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:27.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.283+0000 7ffa0662c640 1 -- 172.21.15.47:0/4003481254 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa001589d0 con 0x7ffa0015afc0 2024-04-01T23:01:27.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.283+0000 7ffa05e2b640 1 --2- 172.21.15.47:0/4003481254 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffa0006c770 0x7ffa000af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T23:01:27.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.283+0000 7ffa0562a640 1 --2- 172.21.15.47:0/4003481254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa000c93f0 0x7ffa000ad6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T23:01:27.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.285+0000 7ffa0662c640 1 --2- 172.21.15.47:0/4003481254 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa0015afc0 0x7ffa000c3700 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff9f800eed0 tx=0x7ff9f800b480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:27.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.287+0000 7ff9f67fc640 1 -- 172.21.15.47:0/4003481254 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f8018020 con 0x7ffa0015afc0 2024-04-01T23:01:27.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.287+0000 7ffa0808f640 1 -- 172.21.15.47:0/4003481254 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa00158cb0 con 0x7ffa0015afc0 2024-04-01T23:01:27.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.287+0000 7ffa0808f640 1 -- 172.21.15.47:0/4003481254 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa000acea0 con 0x7ffa0015afc0 2024-04-01T23:01:27.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.288+0000 7ffa0808f640 1 -- 172.21.15.47:0/4003481254 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa000c9b60 con 0x7ffa0015afc0 2024-04-01T23:01:27.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.531+0000 7ff9f67fc640 1 -- 172.21.15.47:0/4003481254 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9f8027480 con 0x7ffa0015afc0 2024-04-01T23:01:27.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.531+0000 7ff9f67fc640 1 -- 172.21.15.47:0/4003481254 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f8009e60 con 0x7ffa0015afc0 2024-04-01T23:01:27.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.532+0000 7ff9f67fc640 1 -- 172.21.15.47:0/4003481254 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7ff9f8005d10 con 0x7ffa0015afc0 2024-04-01T23:01:27.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.532+0000 7ff9f67fc640 1 --2- 172.21.15.47:0/4003481254 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff9e406b990 0x7ff9e406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:27.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.532+0000 7ffa05e2b640 1 --2- 172.21.15.47:0/4003481254 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff9e406b990 0x7ff9e406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:27.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.533+0000 7ffa05e2b640 1 --2- 172.21.15.47:0/4003481254 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff9e406b990 0x7ff9e406de50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc009630 tx=0x7ff9fc009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:27.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.536+0000 7ff9f67fc640 1 -- 172.21.15.47:0/4003481254 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7ff9f8057f90 con 0x7ffa0015afc0 2024-04-01T23:01:27.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.546+0000 7ff9f67fc640 1 -- 172.21.15.47:0/4003481254 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7ffa000c9b60 con 0x7ffa0015afc0 2024-04-01T23:01:27.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.816+0000 7ffa0808f640 1 -- 172.21.15.47:0/4003481254 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7ffa00068210 con 0x7ffa0015afc0 2024-04-01T23:01:27.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.822+0000 7ff9f67fc640 1 -- 172.21.15.47:0/4003481254 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7ff9f8022020 con 0x7ffa0015afc0 2024-04-01T23:01:27.818 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-01T23:01:27.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.824+0000 7ffa0808f640 1 -- 172.21.15.47:0/4003481254 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff9e406b990 msgr2=0x7ff9e406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:27.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.824+0000 7ffa0808f640 1 --2- 172.21.15.47:0/4003481254 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff9e406b990 0x7ff9e406de50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc009630 tx=0x7ff9fc009240 comp rx=0 tx=0).stop 2024-04-01T23:01:27.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.824+0000 7ffa0808f640 1 -- 172.21.15.47:0/4003481254 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa0015afc0 msgr2=0x7ffa000c3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:27.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.824+0000 7ffa0808f640 1 --2- 172.21.15.47:0/4003481254 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa0015afc0 0x7ffa000c3700 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff9f800eed0 tx=0x7ff9f800b480 comp rx=0 tx=0).stop 2024-04-01T23:01:27.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.824+0000 7ffa0808f640 1 -- 172.21.15.47:0/4003481254 shutdown_connections 2024-04-01T23:01:27.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.824+0000 7ffa0808f640 1 --2- 172.21.15.47:0/4003481254 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff9e406b990 0x7ff9e406de50 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:27.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.824+0000 7ffa0808f640 1 --2- 172.21.15.47:0/4003481254 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa0015afc0 0x7ffa000c3700 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:27.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.824+0000 7ffa0808f640 1 --2- 172.21.15.47:0/4003481254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa000c93f0 0x7ffa000ad6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:27.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.824+0000 7ffa0808f640 1 --2- 172.21.15.47:0/4003481254 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ffa0006c770 0x7ffa000af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:27.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.824+0000 7ffa0808f640 1 -- 172.21.15.47:0/4003481254 >> 172.21.15.47:0/4003481254 conn(0x7ffa000cfdb0 msgr2=0x7ffa000c6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:27.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.824+0000 7ffa0808f640 1 -- 172.21.15.47:0/4003481254 shutdown_connections 2024-04-01T23:01:27.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.824+0000 7ffa0808f640 1 -- 172.21.15.47:0/4003481254 wait complete. 2024-04-01T23:01:27.831 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-01T23:01:27.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.941+0000 7f0765c8f640 1 Processor -- start 2024-04-01T23:01:27.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.941+0000 7f0765c8f640 1 -- start start 2024-04-01T23:01:27.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.941+0000 7f0765c8f640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f07600c93f0 0x7f07600cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:27.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.941+0000 7f0765c8f640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f07600cc0d0 0x7f07600cc540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:27.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.941+0000 7f0765c8f640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07600cca80 con 0x7f076015afc0 2024-04-01T23:01:27.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.941+0000 7f0765c8f640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f07600cdae0 con 0x7f07600c93f0 2024-04-01T23:01:27.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.941+0000 7f0765c8f640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f07600c97d0 con 0x7f07600cc0d0 2024-04-01T23:01:27.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.942+0000 7f075f7fe640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f07600c93f0 0x7f07600cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:27.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.942+0000 7f075ffff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f07600cc0d0 0x7f07600cc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:27.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.942+0000 7f075f7fe640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f07600c93f0 0x7f07600cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36994/0 (socket says 172.21.15.47:36994) 2024-04-01T23:01:27.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.942+0000 7f075f7fe640 1 -- 172.21.15.47:0/372105555 learned_addr learned my addr 172.21.15.47:0/372105555 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:27.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.945+0000 7f075ffff640 1 -- 172.21.15.47:0/372105555 >> v2:172.21.15.47:3300/0 conn(0x7f07600c93f0 msgr2=0x7f07600cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:01:27.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.945+0000 7f075ffff640 1 --2- 172.21.15.47:0/372105555 >> v2:172.21.15.47:3300/0 conn(0x7f07600c93f0 0x7f07600cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:27.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.945+0000 7f075ffff640 1 -- 172.21.15.47:0/372105555 >> v1:172.21.15.47:6789/0 conn(0x7f076015afc0 legacy=0x7f076006c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:01:27.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.945+0000 7f075ffff640 1 -- 172.21.15.47:0/372105555 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07600cdd80 con 0x7f07600cc0d0 2024-04-01T23:01:27.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.945+0000 7f075f7fe640 1 --2- 172.21.15.47:0/372105555 >> v2:172.21.15.47:3300/0 conn(0x7f07600c93f0 0x7f07600cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T23:01:27.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.947+0000 7f075ffff640 1 --2- 172.21.15.47:0/372105555 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07600cc0d0 0x7f07600cc540 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f07600ca170 tx=0x7f075802bdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9da92b2da4017290 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:27.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.950+0000 7f075e7fc640 1 -- 172.21.15.47:0/372105555 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0758039070 con 0x7f07600cc0d0 2024-04-01T23:01:27.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.950+0000 7f075e7fc640 1 -- 172.21.15.47:0/372105555 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f075802cb60 con 0x7f07600cc0d0 2024-04-01T23:01:27.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.950+0000 7f075e7fc640 1 -- 172.21.15.47:0/372105555 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0758034440 con 0x7f07600cc0d0 2024-04-01T23:01:27.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.951+0000 7f0765c8f640 1 -- 172.21.15.47:0/372105555 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07600cc0d0 msgr2=0x7f07600cc540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:27.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.951+0000 7f0765c8f640 1 --2- 172.21.15.47:0/372105555 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07600cc0d0 0x7f07600cc540 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f07600ca170 tx=0x7f075802bdb0 comp rx=0 tx=0).stop 2024-04-01T23:01:27.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.951+0000 7f0765c8f640 1 -- 172.21.15.47:0/372105555 shutdown_connections 2024-04-01T23:01:27.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.951+0000 7f0765c8f640 1 --2- 172.21.15.47:0/372105555 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07600cc0d0 0x7f07600cc540 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:27.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.951+0000 7f0765c8f640 1 --2- 172.21.15.47:0/372105555 >> v2:172.21.15.47:3300/0 conn(0x7f07600c93f0 0x7f07600cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:27.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.951+0000 7f0765c8f640 1 -- 172.21.15.47:0/372105555 >> 172.21.15.47:0/372105555 conn(0x7f07600cfdb0 msgr2=0x7f07600d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:27.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.951+0000 7f0765c8f640 1 -- 172.21.15.47:0/372105555 shutdown_connections 2024-04-01T23:01:27.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.951+0000 7f0765c8f640 1 -- 172.21.15.47:0/372105555 wait complete. 2024-04-01T23:01:27.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.952+0000 7f0765c8f640 1 Processor -- start 2024-04-01T23:01:27.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.952+0000 7f0765c8f640 1 -- start start 2024-04-01T23:01:27.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.953+0000 7f0765c8f640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f07600c93f0 0x7f07600aec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:27.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.953+0000 7f0765c8f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07600cc0d0 0x7f076006c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:27.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.953+0000 7f0765c8f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f076015afc0 0x7f0760151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:27.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.953+0000 7f0765c8f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f07600ce620 con 0x7f07600cc0d0 2024-04-01T23:01:27.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.953+0000 7f0765c8f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f07600ce340 con 0x7f076015afc0 2024-04-01T23:01:27.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.953+0000 7f0765c8f640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f076015b400 con 0x7f07600c93f0 2024-04-01T23:01:27.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.954+0000 7f075effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07600cc0d0 0x7f076006c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:27.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.954+0000 7f075f7fe640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f07600c93f0 0x7f07600aec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:27.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.954+0000 7f075ffff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f076015afc0 0x7f0760151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:27.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.954+0000 7f075effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07600cc0d0 0x7f076006c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37008/0 (socket says 172.21.15.47:37008) 2024-04-01T23:01:27.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.954+0000 7f075effd640 1 -- 172.21.15.47:0/1649625765 learned_addr learned my addr 172.21.15.47:0/1649625765 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:27.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.958+0000 7f075effd640 1 -- 172.21.15.47:0/1649625765 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f07600c93f0 msgr2=0x7f07600aec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:27.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.958+0000 7f075effd640 1 --2- 172.21.15.47:0/1649625765 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f07600c93f0 0x7f07600aec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:27.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.958+0000 7f075effd640 1 -- 172.21.15.47:0/1649625765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f076015afc0 msgr2=0x7f0760151f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:27.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.958+0000 7f075effd640 1 --2- 172.21.15.47:0/1649625765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f076015afc0 0x7f0760151f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:27.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.958+0000 7f075effd640 1 -- 172.21.15.47:0/1649625765 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07600ab760 con 0x7f07600cc0d0 2024-04-01T23:01:27.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.958+0000 7f075ffff640 1 --2- 172.21.15.47:0/1649625765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f076015afc0 0x7f0760151f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T23:01:27.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.960+0000 7f075effd640 1 --2- 172.21.15.47:0/1649625765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07600cc0d0 0x7f076006c4a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f075400c470 tx=0x7f075400c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:27.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.964+0000 7f0747fff640 1 -- 172.21.15.47:0/1649625765 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0754017070 con 0x7f07600cc0d0 2024-04-01T23:01:27.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.964+0000 7f0747fff640 1 -- 172.21.15.47:0/1649625765 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07540035f0 con 0x7f07600cc0d0 2024-04-01T23:01:27.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.964+0000 7f0765c8f640 1 -- 172.21.15.47:0/1649625765 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07600abd20 con 0x7f07600cc0d0 2024-04-01T23:01:27.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.964+0000 7f0747fff640 1 -- 172.21.15.47:0/1649625765 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07540039e0 con 0x7f07600cc0d0 2024-04-01T23:01:27.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.964+0000 7f0765c8f640 1 -- 172.21.15.47:0/1649625765 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07600ac2a0 con 0x7f07600cc0d0 2024-04-01T23:01:27.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:27.965+0000 7f0765c8f640 1 -- 172.21.15.47:0/1649625765 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f076006cf00 con 0x7f07600cc0d0 2024-04-01T23:01:28.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.266+0000 7f0747fff640 1 -- 172.21.15.47:0/1649625765 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f075401a070 con 0x7f07600cc0d0 2024-04-01T23:01:28.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.267+0000 7f0747fff640 1 --2- 172.21.15.47:0/1649625765 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f074c06b9e0 0x7f074c06dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:28.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.267+0000 7f075f7fe640 1 --2- 172.21.15.47:0/1649625765 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f074c06b9e0 0x7f074c06dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:28.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.267+0000 7f075f7fe640 1 --2- 172.21.15.47:0/1649625765 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f074c06b9e0 0x7f074c06dea0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0750006ca0 tx=0x7f0750009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:28.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.281+0000 7f0747fff640 1 -- 172.21.15.47:0/1649625765 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f07540566b0 con 0x7f07600cc0d0 2024-04-01T23:01:28.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.282+0000 7f0747fff640 1 -- 172.21.15.47:0/1649625765 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f0754021020 con 0x7f07600cc0d0 2024-04-01T23:01:28.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.477+0000 7f0765c8f640 1 -- 172.21.15.47:0/1649625765 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f07600cf7b0 con 0x7f07600cc0d0 2024-04-01T23:01:28.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.481+0000 7f0747fff640 1 -- 172.21.15.47:0/1649625765 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f07540010c0 con 0x7f07600cc0d0 2024-04-01T23:01:28.477 INFO:teuthology.orchestra.run.smithi047.stderr:listed 0 entries 2024-04-01T23:01:28.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.483+0000 7f0765c8f640 1 -- 172.21.15.47:0/1649625765 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f074c06b9e0 msgr2=0x7f074c06dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:28.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.483+0000 7f0765c8f640 1 --2- 172.21.15.47:0/1649625765 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f074c06b9e0 0x7f074c06dea0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0750006ca0 tx=0x7f0750009240 comp rx=0 tx=0).stop 2024-04-01T23:01:28.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.483+0000 7f0765c8f640 1 -- 172.21.15.47:0/1649625765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07600cc0d0 msgr2=0x7f076006c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:28.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.483+0000 7f0765c8f640 1 --2- 172.21.15.47:0/1649625765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07600cc0d0 0x7f076006c4a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f075400c470 tx=0x7f075400c930 comp rx=0 tx=0).stop 2024-04-01T23:01:28.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.483+0000 7f0765c8f640 1 -- 172.21.15.47:0/1649625765 shutdown_connections 2024-04-01T23:01:28.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.483+0000 7f0765c8f640 1 --2- 172.21.15.47:0/1649625765 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f074c06b9e0 0x7f074c06dea0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:28.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.483+0000 7f0765c8f640 1 --2- 172.21.15.47:0/1649625765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f076015afc0 0x7f0760151f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:28.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.483+0000 7f0765c8f640 1 --2- 172.21.15.47:0/1649625765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07600cc0d0 0x7f076006c4a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:28.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.483+0000 7f0765c8f640 1 --2- 172.21.15.47:0/1649625765 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f07600c93f0 0x7f07600aec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:28.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.483+0000 7f0765c8f640 1 -- 172.21.15.47:0/1649625765 >> 172.21.15.47:0/1649625765 conn(0x7f07600cfdb0 msgr2=0x7f07600b0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:28.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.484+0000 7f0765c8f640 1 -- 172.21.15.47:0/1649625765 shutdown_connections 2024-04-01T23:01:28.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.484+0000 7f0765c8f640 1 -- 172.21.15.47:0/1649625765 wait complete. 2024-04-01T23:01:28.491 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-01T23:01:28.491 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-01T23:01:28.506 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T23:01:28.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.652+0000 7fb9e8fd0640 1 Processor -- start 2024-04-01T23:01:28.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.652+0000 7fb9e8fd0640 1 -- start start 2024-04-01T23:01:28.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.652+0000 7fb9e8fd0640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb9e415aec0 0x7fb9e406c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:28.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.652+0000 7fb9e8fd0640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9e4154b70 con 0x7fb9e415bb20 2024-04-01T23:01:28.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.652+0000 7fb9e8fd0640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9e40cdac0 con 0x7fb9e406c250 2024-04-01T23:01:28.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.652+0000 7fb9e8fd0640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fb9e40ce990 con 0x7fb9e415aec0 2024-04-01T23:01:28.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.653+0000 7fb9e2d9d640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fb9e415bb20 0x7fb9e415bf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:43140/0 (socket says 172.21.15.47:43140) 2024-04-01T23:01:28.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.653+0000 7fb9e2d9d640 1 -- 172.21.15.47:0/4055404846 learned_addr learned my addr 172.21.15.47:0/4055404846 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T23:01:28.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.653+0000 7fb9dbfff640 1 --2- 172.21.15.47:0/4055404846 >> v2:172.21.15.181:3300/0 conn(0x7fb9e415aec0 0x7fb9e406c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:28.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.656+0000 7fb9e1d9b640 1 -- 172.21.15.47:0/4055404846 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3426336990 0 0) 0x7fb9e4154b70 con 0x7fb9e415bb20 2024-04-01T23:01:28.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.656+0000 7fb9e1d9b640 1 -- 172.21.15.47:0/4055404846 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb9d0003520 con 0x7fb9e415bb20 2024-04-01T23:01:28.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.658+0000 7fb9dbfff640 1 -- 172.21.15.47:0/4055404846 >> v1:172.21.15.181:6789/0 conn(0x7fb9e406c250 legacy=0x7fb9e40ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:28.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.658+0000 7fb9dbfff640 1 -- 172.21.15.47:0/4055404846 >> v1:172.21.15.47:6789/0 conn(0x7fb9e415bb20 legacy=0x7fb9e415bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:28.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.658+0000 7fb9dbfff640 1 -- 172.21.15.47:0/4055404846 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9e40cf2a0 con 0x7fb9e415aec0 2024-04-01T23:01:28.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.662+0000 7fb9dbfff640 1 --2- 172.21.15.47:0/4055404846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb9e415aec0 0x7fb9e406c630 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0097a0 tx=0x7fb9cc02b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa4a7042d0f93696 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:28.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.666+0000 7fb9e1d9b640 1 -- 172.21.15.47:0/4055404846 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc02f810 con 0x7fb9e415aec0 2024-04-01T23:01:28.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.666+0000 7fb9e1d9b640 1 -- 172.21.15.47:0/4055404846 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9cc02f9b0 con 0x7fb9e415aec0 2024-04-01T23:01:28.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.666+0000 7fb9e1d9b640 1 -- 172.21.15.47:0/4055404846 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc02fd80 con 0x7fb9e415aec0 2024-04-01T23:01:28.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.666+0000 7fb9e8fd0640 1 -- 172.21.15.47:0/4055404846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb9e415aec0 msgr2=0x7fb9e406c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:28.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.666+0000 7fb9e8fd0640 1 --2- 172.21.15.47:0/4055404846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb9e415aec0 0x7fb9e406c630 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0097a0 tx=0x7fb9cc02b9f0 comp rx=0 tx=0).stop 2024-04-01T23:01:28.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.666+0000 7fb9e8fd0640 1 -- 172.21.15.47:0/4055404846 shutdown_connections 2024-04-01T23:01:28.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.666+0000 7fb9e8fd0640 1 --2- 172.21.15.47:0/4055404846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb9e415aec0 0x7fb9e406c630 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:28.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.666+0000 7fb9e8fd0640 1 -- 172.21.15.47:0/4055404846 >> 172.21.15.47:0/4055404846 conn(0x7fb9e40cfdb0 msgr2=0x7fb9e40d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:28.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.667+0000 7fb9e8fd0640 1 -- 172.21.15.47:0/4055404846 shutdown_connections 2024-04-01T23:01:28.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.667+0000 7fb9e8fd0640 1 -- 172.21.15.47:0/4055404846 wait complete. 2024-04-01T23:01:28.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.668+0000 7fb9e8fd0640 1 Processor -- start 2024-04-01T23:01:28.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.669+0000 7fb9e8fd0640 1 -- start start 2024-04-01T23:01:28.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.670+0000 7fb9e8fd0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9e406c250 0x7fb9e41f3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:28.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.670+0000 7fb9e8fd0640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9e415aec0 0x7fb9e41f17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:28.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.670+0000 7fb9e8fd0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb9e415bb20 0x7fb9e41f1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:28.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.670+0000 7fb9e8fd0640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e40ce340 con 0x7fb9e406c250 2024-04-01T23:01:28.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.670+0000 7fb9e8fd0640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e40ce060 con 0x7fb9e415bb20 2024-04-01T23:01:28.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.670+0000 7fb9e8fd0640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb9e40ce620 con 0x7fb9e415aec0 2024-04-01T23:01:28.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.670+0000 7fb9dbfff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9e415aec0 0x7fb9e41f17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:28.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.671+0000 7fb9e2d9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb9e415bb20 0x7fb9e41f1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:28.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.671+0000 7fb9dbfff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9e415aec0 0x7fb9e41f17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:53010/0 (socket says 172.21.15.47:53010) 2024-04-01T23:01:28.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.671+0000 7fb9dbfff640 1 -- 172.21.15.47:0/533191276 learned_addr learned my addr 172.21.15.47:0/533191276 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:28.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.671+0000 7fb9e259c640 1 --2- 172.21.15.47:0/533191276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9e406c250 0x7fb9e41f3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:28.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.674+0000 7fb9dbfff640 1 -- 172.21.15.47:0/533191276 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb9e415bb20 msgr2=0x7fb9e41f1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:28.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.674+0000 7fb9dbfff640 1 --2- 172.21.15.47:0/533191276 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb9e415bb20 0x7fb9e41f1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:28.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.674+0000 7fb9dbfff640 1 -- 172.21.15.47:0/533191276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9e406c250 msgr2=0x7fb9e41f3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:28.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.674+0000 7fb9dbfff640 1 --2- 172.21.15.47:0/533191276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9e406c250 0x7fb9e41f3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:28.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.674+0000 7fb9dbfff640 1 -- 172.21.15.47:0/533191276 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9e41f44e0 con 0x7fb9e415aec0 2024-04-01T23:01:28.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.678+0000 7fb9dbfff640 1 --2- 172.21.15.47:0/533191276 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9e415aec0 0x7fb9e41f17d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc009890 tx=0x7fb9cc004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:28.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.681+0000 7fb9daffd640 1 -- 172.21.15.47:0/533191276 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc046070 con 0x7fb9e415aec0 2024-04-01T23:01:28.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.682+0000 7fb9daffd640 1 -- 172.21.15.47:0/533191276 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9cc0378f0 con 0x7fb9e415aec0 2024-04-01T23:01:28.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.682+0000 7fb9daffd640 1 -- 172.21.15.47:0/533191276 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc037ce0 con 0x7fb9e415aec0 2024-04-01T23:01:28.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.682+0000 7fb9e8fd0640 1 -- 172.21.15.47:0/533191276 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9e40c6990 con 0x7fb9e415aec0 2024-04-01T23:01:28.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.682+0000 7fb9e8fd0640 1 -- 172.21.15.47:0/533191276 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9e4151210 con 0x7fb9e415aec0 2024-04-01T23:01:28.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.682+0000 7fb9e8fd0640 1 -- 172.21.15.47:0/533191276 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9e4068210 con 0x7fb9e415aec0 2024-04-01T23:01:28.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.934+0000 7fb9daffd640 1 -- 172.21.15.47:0/533191276 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7fb9cc049070 con 0x7fb9e415aec0 2024-04-01T23:01:28.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.934+0000 7fb9daffd640 1 --2- 172.21.15.47:0/533191276 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fb9c406b9e0 0x7fb9c406dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:28.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.935+0000 7fb9e259c640 1 --2- 172.21.15.47:0/533191276 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fb9c406b9e0 0x7fb9c406dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:28.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.935+0000 7fb9e259c640 1 --2- 172.21.15.47:0/533191276 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fb9c406b9e0 0x7fb9c406dea0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4001780 tx=0x7fb9d4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:28.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.939+0000 7fb9daffd640 1 -- 172.21.15.47:0/533191276 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fb9cc078960 con 0x7fb9e415aec0 2024-04-01T23:01:28.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:28.949+0000 7fb9daffd640 1 -- 172.21.15.47:0/533191276 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fb9cc033030 con 0x7fb9e415aec0 2024-04-01T23:01:29.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.154+0000 7fb9e8fd0640 1 -- 172.21.15.47:0/533191276 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb9e40b5b50 con 0x7fb9e415aec0 2024-04-01T23:01:29.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.193+0000 7fb9daffd640 1 -- 172.21.15.47:0/533191276 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18914 (secure 0 0 0) 0x7fb9cc07a8c0 con 0x7fb9e415aec0 2024-04-01T23:01:29.189 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T23:01:29.190 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":27,"fsid":"a6998a48-38bc-4e42-b0d9-04f2fb5c3c87","created":"2024-04-01T22:32:57.112033+0000","modified":"2024-04-01T22:34:04.850029+0000","last_up_change":"2024-04-01T22:33:11.141073+0000","last_in_change":"2024-04-01T22:33:02.650459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T22:33:13.356568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T22:33:25.309421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T22:33:26.268050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-01T22:33:30.588103+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7bd3f25d-e3a5-4932-b381-53dcbb464dde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6811","nonce":3827395709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6813","nonce":3827395709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6817","nonce":3827395709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6815","nonce":3827395709}]},"public_addr":"172.21.15.47:6811/3827395709","cluster_addr":"172.21.15.47:6813/3827395709","heartbeat_back_addr":"172.21.15.47:6817/3827395709","heartbeat_front_addr":"172.21.15.47:6815/3827395709","state":["exists","up"]},{"osd":1,"uuid":"2aa60ba2-67ff-43c7-96c4-82ae2f3855ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6827","nonce":3152157503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6829","nonce":3152157503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6833","nonce":3152157503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6831","nonce":3152157503}]},"public_addr":"172.21.15.47:6827/3152157503","cluster_addr":"172.21.15.47:6829/3152157503","heartbeat_back_addr":"172.21.15.47:6833/3152157503","heartbeat_front_addr":"172.21.15.47:6831/3152157503","state":["exists","up"]},{"osd":2,"uuid":"d83f8a98-6db8-42b7-9ef6-5b16eb9a3492","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6803","nonce":1003968856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6805","nonce":1003968856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6809","nonce":1003968856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6807","nonce":1003968856}]},"public_addr":"172.21.15.47:6803/1003968856","cluster_addr":"172.21.15.47:6805/1003968856","heartbeat_back_addr":"172.21.15.47:6809/1003968856","heartbeat_front_addr":"172.21.15.47:6807/1003968856","state":["exists","up"]},{"osd":3,"uuid":"edc02ed5-d25c-4dc9-a0c3-7a26f20fae07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6819","nonce":2845699561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6821","nonce":2845699561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6825","nonce":2845699561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6823","nonce":2845699561}]},"public_addr":"172.21.15.47:6819/2845699561","cluster_addr":"172.21.15.47:6821/2845699561","heartbeat_back_addr":"172.21.15.47:6825/2845699561","heartbeat_front_addr":"172.21.15.47:6823/2845699561","state":["exists","up"]},{"osd":4,"uuid":"b3d67e74-f51e-4474-9c62-dd0daa60c728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6809","nonce":2961538461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6811","nonce":2961538461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6815","nonce":2961538461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6813","nonce":2961538461}]},"public_addr":"172.21.15.181:6809/2961538461","cluster_addr":"172.21.15.181:6811/2961538461","heartbeat_back_addr":"172.21.15.181:6815/2961538461","heartbeat_front_addr":"172.21.15.181:6813/2961538461","state":["exists","up"]},{"osd":5,"uuid":"d86e8f7a-99f4-4457-9949-cf2cb853e79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6817","nonce":2161566540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6819","nonce":2161566540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6823","nonce":2161566540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6821","nonce":2161566540}]},"public_addr":"172.21.15.181:6817/2161566540","cluster_addr":"172.21.15.181:6819/2161566540","heartbeat_back_addr":"172.21.15.181:6823/2161566540","heartbeat_front_addr":"172.21.15.181:6821/2161566540","state":["exists","up"]},{"osd":6,"uuid":"aa08266c-1719-4abd-afb9-e7e8ac593658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6801","nonce":3792144865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6803","nonce":3792144865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6807","nonce":3792144865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6805","nonce":3792144865}]},"public_addr":"172.21.15.181:6801/3792144865","cluster_addr":"172.21.15.181:6803/3792144865","heartbeat_back_addr":"172.21.15.181:6807/3792144865","heartbeat_front_addr":"172.21.15.181:6805/3792144865","state":["exists","up"]},{"osd":7,"uuid":"6e509762-24c8-46c3-93a1-4c50b11ebcf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6825","nonce":1760995885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6827","nonce":1760995885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6831","nonce":1760995885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6829","nonce":1760995885}]},"public_addr":"172.21.15.181:6825/1760995885","cluster_addr":"172.21.15.181:6827/1760995885","heartbeat_back_addr":"172.21.15.181:6831/1760995885","heartbeat_front_addr":"172.21.15.181:6829/1760995885","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.202426+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.255318+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.170288+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.290065+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.214871+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.176432+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.139940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.299546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.15","mappings":[{"from":7,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T23:01:29.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.195+0000 7fb9e8fd0640 1 -- 172.21.15.47:0/533191276 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fb9c406b9e0 msgr2=0x7fb9c406dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:29.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.195+0000 7fb9e8fd0640 1 --2- 172.21.15.47:0/533191276 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fb9c406b9e0 0x7fb9c406dea0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4001780 tx=0x7fb9d4009040 comp rx=0 tx=0).stop 2024-04-01T23:01:29.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.195+0000 7fb9e8fd0640 1 -- 172.21.15.47:0/533191276 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9e415aec0 msgr2=0x7fb9e41f17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:29.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.195+0000 7fb9e8fd0640 1 --2- 172.21.15.47:0/533191276 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9e415aec0 0x7fb9e41f17d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc009890 tx=0x7fb9cc004730 comp rx=0 tx=0).stop 2024-04-01T23:01:29.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.195+0000 7fb9e8fd0640 1 -- 172.21.15.47:0/533191276 shutdown_connections 2024-04-01T23:01:29.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.195+0000 7fb9e8fd0640 1 --2- 172.21.15.47:0/533191276 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fb9c406b9e0 0x7fb9c406dea0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:29.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.195+0000 7fb9e8fd0640 1 --2- 172.21.15.47:0/533191276 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb9e415bb20 0x7fb9e41f1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:29.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.195+0000 7fb9e8fd0640 1 --2- 172.21.15.47:0/533191276 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb9e415aec0 0x7fb9e41f17d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:29.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.195+0000 7fb9e8fd0640 1 --2- 172.21.15.47:0/533191276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9e406c250 0x7fb9e41f3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:29.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.195+0000 7fb9e8fd0640 1 -- 172.21.15.47:0/533191276 >> 172.21.15.47:0/533191276 conn(0x7fb9e40cfdb0 msgr2=0x7fb9e4158be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:29.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.195+0000 7fb9e8fd0640 1 -- 172.21.15.47:0/533191276 shutdown_connections 2024-04-01T23:01:29.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.195+0000 7fb9e8fd0640 1 -- 172.21.15.47:0/533191276 wait complete. 2024-04-01T23:01:29.204 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-01T22:33:13.356568+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-01T22:33:25.309421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-01T22:33:26.268050+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-01T22:33:30.588103+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-01T23:01:29.204 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-01T23:01:29.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.317+0000 7ff94b356640 1 Processor -- start 2024-04-01T23:01:29.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.317+0000 7ff94b356640 1 -- start start 2024-04-01T23:01:29.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.318+0000 7ff94b356640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff944070450 0x7ff9440c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:29.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.318+0000 7ff94b356640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff94406bb80 0x7ff944154060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:29.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.318+0000 7ff94b356640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9440ca350 con 0x7ff944070830 2024-04-01T23:01:29.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.318+0000 7ff94b356640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7ff94415e2a0 con 0x7ff94406bb80 2024-04-01T23:01:29.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.318+0000 7ff94b356640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7ff9440c7ae0 con 0x7ff944070450 2024-04-01T23:01:29.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.319+0000 7ff9498f3640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff94406bb80 0x7ff944154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:29.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.319+0000 7ff9488f1640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7ff944070830 0x7ff9440c73d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.47:37278/0 (socket says 172.21.15.47:37278) 2024-04-01T23:01:29.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.319+0000 7ff9488f1640 1 -- 172.21.15.47:0/3992205126 learned_addr learned my addr 172.21.15.47:0/3992205126 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T23:01:29.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.319+0000 7ff9490f2640 1 --2- 172.21.15.47:0/3992205126 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff944070450 0x7ff9440c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:29.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.321+0000 7ff93bfff640 1 -- 172.21.15.47:0/3992205126 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 806740027 0 0) 0x7ff9440ca350 con 0x7ff944070830 2024-04-01T23:01:29.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.322+0000 7ff93bfff640 1 -- 172.21.15.47:0/3992205126 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff930003520 con 0x7ff944070830 2024-04-01T23:01:29.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.322+0000 7ff9490f2640 1 -- 172.21.15.47:0/3992205126 >> v2:172.21.15.47:3300/0 conn(0x7ff94406bb80 msgr2=0x7ff944154060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:01:29.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.322+0000 7ff9490f2640 1 --2- 172.21.15.47:0/3992205126 >> v2:172.21.15.47:3300/0 conn(0x7ff94406bb80 0x7ff944154060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:29.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.322+0000 7ff9490f2640 1 -- 172.21.15.47:0/3992205126 >> v1:172.21.15.181:6789/0 conn(0x7ff944070830 legacy=0x7ff9440c73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:29.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.322+0000 7ff9490f2640 1 -- 172.21.15.47:0/3992205126 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff94415af50 con 0x7ff944070450 2024-04-01T23:01:29.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.324+0000 7ff9490f2640 1 --2- 172.21.15.47:0/3992205126 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff944070450 0x7ff9440c9e10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff9400097a0 tx=0x7ff94002b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45cf605f4c43c6aa server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:29.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.328+0000 7ff93bfff640 1 -- 172.21.15.47:0/3992205126 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff940034070 con 0x7ff944070450 2024-04-01T23:01:29.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.328+0000 7ff93bfff640 1 -- 172.21.15.47:0/3992205126 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff940030610 con 0x7ff944070450 2024-04-01T23:01:29.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.328+0000 7ff93bfff640 1 -- 172.21.15.47:0/3992205126 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9400309e0 con 0x7ff944070450 2024-04-01T23:01:29.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.328+0000 7ff94b356640 1 -- 172.21.15.47:0/3992205126 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff944070450 msgr2=0x7ff9440c9e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:29.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.328+0000 7ff94b356640 1 --2- 172.21.15.47:0/3992205126 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff944070450 0x7ff9440c9e10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff9400097a0 tx=0x7ff94002b960 comp rx=0 tx=0).stop 2024-04-01T23:01:29.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.328+0000 7ff94b356640 1 -- 172.21.15.47:0/3992205126 shutdown_connections 2024-04-01T23:01:29.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.328+0000 7ff94b356640 1 --2- 172.21.15.47:0/3992205126 >> v2:172.21.15.47:3300/0 conn(0x7ff94406bb80 0x7ff944154060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:29.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.328+0000 7ff94b356640 1 --2- 172.21.15.47:0/3992205126 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff944070450 0x7ff9440c9e10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:29.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.328+0000 7ff94b356640 1 -- 172.21.15.47:0/3992205126 >> 172.21.15.47:0/3992205126 conn(0x7ff944072a10 msgr2=0x7ff94406e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:29.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.329+0000 7ff94b356640 1 -- 172.21.15.47:0/3992205126 shutdown_connections 2024-04-01T23:01:29.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.329+0000 7ff94b356640 1 -- 172.21.15.47:0/3992205126 wait complete. 2024-04-01T23:01:29.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.330+0000 7ff94b356640 1 Processor -- start 2024-04-01T23:01:29.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.330+0000 7ff94b356640 1 -- start start 2024-04-01T23:01:29.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.330+0000 7ff94b356640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff94406bb80 0x7ff94415d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:29.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.330+0000 7ff94b356640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff944070450 0x7ff9441537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:29.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.330+0000 7ff94b356640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff944070830 0x7ff9441f05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:29.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.330+0000 7ff94b356640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff94415dc50 con 0x7ff944070830 2024-04-01T23:01:29.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.330+0000 7ff94b356640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff94415d970 con 0x7ff94406bb80 2024-04-01T23:01:29.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.330+0000 7ff94b356640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7ff94415df30 con 0x7ff944070450 2024-04-01T23:01:29.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.331+0000 7ff9498f3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff944070830 0x7ff9441f05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:29.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.331+0000 7ff9490f2640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff94406bb80 0x7ff94415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:29.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.331+0000 7ff9488f1640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff944070450 0x7ff9441537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:29.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.331+0000 7ff9488f1640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff944070450 0x7ff9441537d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:53022/0 (socket says 172.21.15.47:53022) 2024-04-01T23:01:29.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.331+0000 7ff9488f1640 1 -- 172.21.15.47:0/404230904 learned_addr learned my addr 172.21.15.47:0/404230904 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:29.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.335+0000 7ff9488f1640 1 -- 172.21.15.47:0/404230904 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff94406bb80 msgr2=0x7ff94415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:29.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.335+0000 7ff9488f1640 1 --2- 172.21.15.47:0/404230904 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff94406bb80 0x7ff94415d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:29.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.335+0000 7ff9488f1640 1 -- 172.21.15.47:0/404230904 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff944070830 msgr2=0x7ff9441f05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:29.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.335+0000 7ff9488f1640 1 --2- 172.21.15.47:0/404230904 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff944070830 0x7ff9441f05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:29.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.335+0000 7ff9488f1640 1 -- 172.21.15.47:0/404230904 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9441f32c0 con 0x7ff944070450 2024-04-01T23:01:29.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.337+0000 7ff9488f1640 1 --2- 172.21.15.47:0/404230904 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff944070450 0x7ff9441537d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff93400c390 tx=0x7ff93400c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:29.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.341+0000 7ff939ffb640 1 -- 172.21.15.47:0/404230904 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff934017070 con 0x7ff944070450 2024-04-01T23:01:29.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.341+0000 7ff939ffb640 1 -- 172.21.15.47:0/404230904 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff934005ce0 con 0x7ff944070450 2024-04-01T23:01:29.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.341+0000 7ff94b356640 1 -- 172.21.15.47:0/404230904 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9441f3560 con 0x7ff944070450 2024-04-01T23:01:29.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.341+0000 7ff939ffb640 1 -- 172.21.15.47:0/404230904 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9340072f0 con 0x7ff944070450 2024-04-01T23:01:29.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.341+0000 7ff94b356640 1 -- 172.21.15.47:0/404230904 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9441f3b00 con 0x7ff944070450 2024-04-01T23:01:29.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.342+0000 7ff94b356640 1 -- 172.21.15.47:0/404230904 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff944068920 con 0x7ff944070450 2024-04-01T23:01:29.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.586+0000 7ff939ffb640 1 -- 172.21.15.47:0/404230904 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7ff93401a070 con 0x7ff944070450 2024-04-01T23:01:29.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.587+0000 7ff939ffb640 1 --2- 172.21.15.47:0/404230904 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff92806b9e0 0x7ff92806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:29.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.587+0000 7ff9490f2640 1 --2- 172.21.15.47:0/404230904 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff92806b9e0 0x7ff92806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:29.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.587+0000 7ff9490f2640 1 --2- 172.21.15.47:0/404230904 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff92806b9e0 0x7ff92806dea0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff940036000 tx=0x7ff94003b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:29.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.589+0000 7ff939ffb640 1 -- 172.21.15.47:0/404230904 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7ff934056650 con 0x7ff944070450 2024-04-01T23:01:29.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.613+0000 7ff939ffb640 1 -- 172.21.15.47:0/404230904 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7ff934021020 con 0x7ff944070450 2024-04-01T23:01:29.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.804+0000 7ff94b356640 1 -- 172.21.15.47:0/404230904 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff94406ec80 con 0x7ff944070450 2024-04-01T23:01:29.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.866+0000 7ff939ffb640 1 -- 172.21.15.47:0/404230904 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7ff9340585b0 con 0x7ff944070450 2024-04-01T23:01:29.863 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-01T23:01:29.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.869+0000 7ff94b356640 1 -- 172.21.15.47:0/404230904 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff92806b9e0 msgr2=0x7ff92806dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:29.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.869+0000 7ff94b356640 1 --2- 172.21.15.47:0/404230904 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff92806b9e0 0x7ff92806dea0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff940036000 tx=0x7ff94003b040 comp rx=0 tx=0).stop 2024-04-01T23:01:29.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.869+0000 7ff94b356640 1 -- 172.21.15.47:0/404230904 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff944070450 msgr2=0x7ff9441537d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:29.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.869+0000 7ff94b356640 1 --2- 172.21.15.47:0/404230904 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff944070450 0x7ff9441537d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff93400c390 tx=0x7ff93400c850 comp rx=0 tx=0).stop 2024-04-01T23:01:29.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.869+0000 7ff94b356640 1 -- 172.21.15.47:0/404230904 shutdown_connections 2024-04-01T23:01:29.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.869+0000 7ff94b356640 1 --2- 172.21.15.47:0/404230904 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff92806b9e0 0x7ff92806dea0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:29.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.869+0000 7ff94b356640 1 --2- 172.21.15.47:0/404230904 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff944070830 0x7ff9441f05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:29.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.869+0000 7ff94b356640 1 --2- 172.21.15.47:0/404230904 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff944070450 0x7ff9441537d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:29.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.869+0000 7ff94b356640 1 --2- 172.21.15.47:0/404230904 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff94406bb80 0x7ff94415d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:29.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.869+0000 7ff94b356640 1 -- 172.21.15.47:0/404230904 >> 172.21.15.47:0/404230904 conn(0x7ff944072a10 msgr2=0x7ff9440cb2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:29.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.869+0000 7ff94b356640 1 -- 172.21.15.47:0/404230904 shutdown_connections 2024-04-01T23:01:29.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.869+0000 7ff94b356640 1 -- 172.21.15.47:0/404230904 wait complete. 2024-04-01T23:01:29.876 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-01T23:01:29.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.989+0000 7f4683172640 1 Processor -- start 2024-04-01T23:01:29.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.990+0000 7f4683172640 1 -- start start 2024-04-01T23:01:29.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.990+0000 7f4683172640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f467c0cee30 0x7f467c15afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:29.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.990+0000 7f4683172640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f467c0cdae0 con 0x7f467c0c93f0 2024-04-01T23:01:29.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.990+0000 7f4683172640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f467c0c97d0 con 0x7f467c0cc0d0 2024-04-01T23:01:29.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.990+0000 7f4683172640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f467c15b500 con 0x7f467c0cee30 2024-04-01T23:01:29.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.991+0000 7f467bfff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f467c0cee30 0x7f467c15afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:29.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.991+0000 7f468170f640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f467c0cc0d0 0x7f467c0cc520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.47:60500/0 (socket says 172.21.15.47:60500) 2024-04-01T23:01:29.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.991+0000 7f468170f640 1 -- 172.21.15.47:0/209715433 learned_addr learned my addr 172.21.15.47:0/209715433 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T23:01:29.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.993+0000 7f467b7fe640 1 -- 172.21.15.47:0/209715433 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3092929568 0 0) 0x7f467c0c97d0 con 0x7f467c0cc0d0 2024-04-01T23:01:29.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.993+0000 7f467b7fe640 1 -- 172.21.15.47:0/209715433 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4668003520 con 0x7f467c0cc0d0 2024-04-01T23:01:29.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.994+0000 7f467bfff640 1 -- 172.21.15.47:0/209715433 >> v1:172.21.15.181:6789/0 conn(0x7f467c0cc0d0 legacy=0x7f467c0cc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:29.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.994+0000 7f467bfff640 1 -- 172.21.15.47:0/209715433 >> v1:172.21.15.47:6789/0 conn(0x7f467c0c93f0 legacy=0x7f467c06c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:29.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.994+0000 7f467bfff640 1 -- 172.21.15.47:0/209715433 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f467c0cdd80 con 0x7f467c0cee30 2024-04-01T23:01:29.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:29.998+0000 7f467bfff640 1 --2- 172.21.15.47:0/209715433 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f467c0cee30 0x7f467c15afc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f466c0097a0 tx=0x7f466c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc7d98720180787 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:29.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.001+0000 7f467b7fe640 1 -- 172.21.15.47:0/209715433 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466c035020 con 0x7f467c0cee30 2024-04-01T23:01:29.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.001+0000 7f467b7fe640 1 -- 172.21.15.47:0/209715433 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f466c031830 con 0x7f467c0cee30 2024-04-01T23:01:29.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.001+0000 7f467b7fe640 1 -- 172.21.15.47:0/209715433 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466c031c00 con 0x7f467c0cee30 2024-04-01T23:01:29.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.002+0000 7f4683172640 1 -- 172.21.15.47:0/209715433 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f467c0cee30 msgr2=0x7f467c15afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:29.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.002+0000 7f4683172640 1 --2- 172.21.15.47:0/209715433 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f467c0cee30 0x7f467c15afc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f466c0097a0 tx=0x7f466c02b8d0 comp rx=0 tx=0).stop 2024-04-01T23:01:29.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.002+0000 7f4683172640 1 -- 172.21.15.47:0/209715433 shutdown_connections 2024-04-01T23:01:29.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.002+0000 7f4683172640 1 --2- 172.21.15.47:0/209715433 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f467c0cee30 0x7f467c15afc0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:29.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.002+0000 7f4683172640 1 -- 172.21.15.47:0/209715433 >> 172.21.15.47:0/209715433 conn(0x7f467c0cfdb0 msgr2=0x7f467c0d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:29.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.002+0000 7f4683172640 1 -- 172.21.15.47:0/209715433 shutdown_connections 2024-04-01T23:01:30.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.002+0000 7f4683172640 1 -- 172.21.15.47:0/209715433 wait complete. 2024-04-01T23:01:30.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.003+0000 7f4683172640 1 Processor -- start 2024-04-01T23:01:30.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.003+0000 7f4683172640 1 -- start start 2024-04-01T23:01:30.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.004+0000 7f4683172640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f467c0c93f0 0x7f467c1e1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:30.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.004+0000 7f4683172640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f467c0cc0d0 0x7f467c0c3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:30.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.004+0000 7f4683172640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f467c0cee30 0x7f467c1f0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:30.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.004+0000 7f4683172640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f467c0ce620 con 0x7f467c0cc0d0 2024-04-01T23:01:30.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.004+0000 7f4683172640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f467c0ce340 con 0x7f467c0cee30 2024-04-01T23:01:30.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.004+0000 7f4683172640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f467c0cf430 con 0x7f467c0c93f0 2024-04-01T23:01:30.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.005+0000 7f468170f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f467c0cee30 0x7f467c1f0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:30.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.005+0000 7f468170f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f467c0cee30 0x7f467c1f0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:39440/0 (socket says 172.21.15.47:39440) 2024-04-01T23:01:30.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.005+0000 7f468170f640 1 -- 172.21.15.47:0/468732722 learned_addr learned my addr 172.21.15.47:0/468732722 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:30.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.006+0000 7f467bfff640 1 --2- 172.21.15.47:0/468732722 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f467c0cc0d0 0x7f467c0c3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:30.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.006+0000 7f4680f0e640 1 --2- 172.21.15.47:0/468732722 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f467c0c93f0 0x7f467c1e1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:30.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.009+0000 7f468170f640 1 -- 172.21.15.47:0/468732722 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f467c0c93f0 msgr2=0x7f467c1e1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:30.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.009+0000 7f468170f640 1 --2- 172.21.15.47:0/468732722 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f467c0c93f0 0x7f467c1e1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:30.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.009+0000 7f468170f640 1 -- 172.21.15.47:0/468732722 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f467c0cc0d0 msgr2=0x7f467c0c3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:30.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.009+0000 7f468170f640 1 --2- 172.21.15.47:0/468732722 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f467c0cc0d0 0x7f467c0c3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:30.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.009+0000 7f468170f640 1 -- 172.21.15.47:0/468732722 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f467c0cd0a0 con 0x7f467c0cee30 2024-04-01T23:01:30.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.012+0000 7f468170f640 1 --2- 172.21.15.47:0/468732722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f467c0cee30 0x7f467c1f0330 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f467400cb40 tx=0x7f467400a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:30.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.016+0000 7f46797fa640 1 -- 172.21.15.47:0/468732722 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4674017070 con 0x7f467c0cee30 2024-04-01T23:01:30.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.016+0000 7f46797fa640 1 -- 172.21.15.47:0/468732722 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f467400ac40 con 0x7f467c0cee30 2024-04-01T23:01:30.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.016+0000 7f46797fa640 1 -- 172.21.15.47:0/468732722 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4674012620 con 0x7f467c0cee30 2024-04-01T23:01:30.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.016+0000 7f4683172640 1 -- 172.21.15.47:0/468732722 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f467c0b52e0 con 0x7f467c0cee30 2024-04-01T23:01:30.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.016+0000 7f4683172640 1 -- 172.21.15.47:0/468732722 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f467c0c5ea0 con 0x7f467c0cee30 2024-04-01T23:01:30.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.017+0000 7f4683172640 1 -- 172.21.15.47:0/468732722 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f467c068210 con 0x7f467c0cee30 2024-04-01T23:01:30.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.259+0000 7f46797fa640 1 -- 172.21.15.47:0/468732722 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f467401a070 con 0x7f467c0cee30 2024-04-01T23:01:30.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.260+0000 7f46797fa640 1 --2- 172.21.15.47:0/468732722 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f465c06b9c0 0x7f465c06de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:30.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.260+0000 7f4680f0e640 1 --2- 172.21.15.47:0/468732722 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f465c06b9c0 0x7f465c06de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:30.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.260+0000 7f4680f0e640 1 --2- 172.21.15.47:0/468732722 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f465c06b9c0 0x7f465c06de80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4664001780 tx=0x7f4664009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:30.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.262+0000 7f46797fa640 1 -- 172.21.15.47:0/468732722 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f4674057040 con 0x7f467c0cee30 2024-04-01T23:01:30.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.272+0000 7f46797fa640 1 -- 172.21.15.47:0/468732722 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f4674021020 con 0x7f467c0cee30 2024-04-01T23:01:30.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.455+0000 7f4683172640 1 -- 172.21.15.47:0/468732722 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f467c06cf00 con 0x7f467c0cee30 2024-04-01T23:01:30.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.462+0000 7f46797fa640 1 -- 172.21.15.47:0/468732722 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f4674058fa0 con 0x7f467c0cee30 2024-04-01T23:01:30.458 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-01T23:01:30.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.465+0000 7f4683172640 1 -- 172.21.15.47:0/468732722 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f465c06b9c0 msgr2=0x7f465c06de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:30.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.465+0000 7f4683172640 1 --2- 172.21.15.47:0/468732722 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f465c06b9c0 0x7f465c06de80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4664001780 tx=0x7f4664009040 comp rx=0 tx=0).stop 2024-04-01T23:01:30.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.465+0000 7f4683172640 1 -- 172.21.15.47:0/468732722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f467c0cee30 msgr2=0x7f467c1f0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:30.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.465+0000 7f4683172640 1 --2- 172.21.15.47:0/468732722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f467c0cee30 0x7f467c1f0330 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f467400cb40 tx=0x7f467400a060 comp rx=0 tx=0).stop 2024-04-01T23:01:30.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.465+0000 7f4683172640 1 -- 172.21.15.47:0/468732722 shutdown_connections 2024-04-01T23:01:30.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.465+0000 7f4683172640 1 --2- 172.21.15.47:0/468732722 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f465c06b9c0 0x7f465c06de80 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:30.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.465+0000 7f4683172640 1 --2- 172.21.15.47:0/468732722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f467c0cee30 0x7f467c1f0330 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:30.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.465+0000 7f4683172640 1 --2- 172.21.15.47:0/468732722 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f467c0cc0d0 0x7f467c0c3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:30.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.465+0000 7f4683172640 1 --2- 172.21.15.47:0/468732722 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f467c0c93f0 0x7f467c1e1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:30.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.465+0000 7f4683172640 1 -- 172.21.15.47:0/468732722 >> 172.21.15.47:0/468732722 conn(0x7f467c0cfdb0 msgr2=0x7f467c0d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:30.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.465+0000 7f4683172640 1 -- 172.21.15.47:0/468732722 shutdown_connections 2024-04-01T23:01:30.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.465+0000 7f4683172640 1 -- 172.21.15.47:0/468732722 wait complete. 2024-04-01T23:01:30.472 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-01T23:01:30.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.585+0000 7f06eccc0640 1 Processor -- start 2024-04-01T23:01:30.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.586+0000 7f06eccc0640 1 -- start start 2024-04-01T23:01:30.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.586+0000 7f06eccc0640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f06e80cee30 0x7f06e815afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:30.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.586+0000 7f06eccc0640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f06e80cc0d0 0x7f06e80cc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:30.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.586+0000 7f06eccc0640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06e80cdae0 con 0x7f06e80c93f0 2024-04-01T23:01:30.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.586+0000 7f06eccc0640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f06e815b500 con 0x7f06e80cc0d0 2024-04-01T23:01:30.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.586+0000 7f06eccc0640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f06e80cca60 con 0x7f06e80cee30 2024-04-01T23:01:30.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.587+0000 7f06e6d9d640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f06e80cc0d0 0x7f06e80cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:30.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.587+0000 7f06dffff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f06e80cee30 0x7f06e815afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:30.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.587+0000 7f06dffff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f06e80cee30 0x7f06e815afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:39442/0 (socket says 172.21.15.47:39442) 2024-04-01T23:01:30.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.587+0000 7f06dffff640 1 -- 172.21.15.47:0/2751798253 learned_addr learned my addr 172.21.15.47:0/2751798253 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:30.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.589+0000 7f06e6d9d640 1 -- 172.21.15.47:0/2751798253 >> v2:172.21.15.181:3300/0 conn(0x7f06e80cee30 msgr2=0x7f06e815afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:01:30.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.589+0000 7f06e6d9d640 1 --2- 172.21.15.47:0/2751798253 >> v2:172.21.15.181:3300/0 conn(0x7f06e80cee30 0x7f06e815afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:30.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.589+0000 7f06e6d9d640 1 -- 172.21.15.47:0/2751798253 >> v1:172.21.15.181:6789/0 conn(0x7f06e80c93f0 legacy=0x7f06e806c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:30.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.589+0000 7f06e6d9d640 1 -- 172.21.15.47:0/2751798253 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e80c97d0 con 0x7f06e80cc0d0 2024-04-01T23:01:30.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.591+0000 7f06e6d9d640 1 --2- 172.21.15.47:0/2751798253 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06e80cc0d0 0x7f06e80cc520 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f06e808cd20 tx=0x7f06e002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1668c48a1705934 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:30.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.595+0000 7f06e5d9b640 1 -- 172.21.15.47:0/2751798253 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e0039070 con 0x7f06e80cc0d0 2024-04-01T23:01:30.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.595+0000 7f06e5d9b640 1 -- 172.21.15.47:0/2751798253 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e002cbf0 con 0x7f06e80cc0d0 2024-04-01T23:01:30.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.595+0000 7f06e5d9b640 1 -- 172.21.15.47:0/2751798253 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e0034440 con 0x7f06e80cc0d0 2024-04-01T23:01:30.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.596+0000 7f06eccc0640 1 -- 172.21.15.47:0/2751798253 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06e80cc0d0 msgr2=0x7f06e80cc520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:30.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.596+0000 7f06eccc0640 1 --2- 172.21.15.47:0/2751798253 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06e80cc0d0 0x7f06e80cc520 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f06e808cd20 tx=0x7f06e002be40 comp rx=0 tx=0).stop 2024-04-01T23:01:30.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.596+0000 7f06eccc0640 1 -- 172.21.15.47:0/2751798253 shutdown_connections 2024-04-01T23:01:30.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.596+0000 7f06eccc0640 1 --2- 172.21.15.47:0/2751798253 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06e80cc0d0 0x7f06e80cc520 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:30.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.596+0000 7f06eccc0640 1 --2- 172.21.15.47:0/2751798253 >> v2:172.21.15.181:3300/0 conn(0x7f06e80cee30 0x7f06e815afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:30.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.596+0000 7f06eccc0640 1 -- 172.21.15.47:0/2751798253 >> 172.21.15.47:0/2751798253 conn(0x7f06e80cfdb0 msgr2=0x7f06e80d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:30.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.596+0000 7f06eccc0640 1 -- 172.21.15.47:0/2751798253 shutdown_connections 2024-04-01T23:01:30.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.596+0000 7f06eccc0640 1 -- 172.21.15.47:0/2751798253 wait complete. 2024-04-01T23:01:30.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.598+0000 7f06eccc0640 1 Processor -- start 2024-04-01T23:01:30.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.598+0000 7f06eccc0640 1 -- start start 2024-04-01T23:01:30.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.599+0000 7f06eccc0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06e80c93f0 0x7f06e80c5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:30.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.599+0000 7f06eccc0640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f06e80cc0d0 0x7f06e81f3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:30.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.599+0000 7f06eccc0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06e80cee30 0x7f06e81f3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:30.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.599+0000 7f06eccc0640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f06e80ce340 con 0x7f06e80cee30 2024-04-01T23:01:30.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.599+0000 7f06eccc0640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f06e80ce060 con 0x7f06e80c93f0 2024-04-01T23:01:30.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.599+0000 7f06eccc0640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f06e80ce620 con 0x7f06e80cc0d0 2024-04-01T23:01:30.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.600+0000 7f06e6d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06e80cee30 0x7f06e81f3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:30.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.600+0000 7f06dffff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f06e80cc0d0 0x7f06e81f3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:30.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.600+0000 7f06e6d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06e80cee30 0x7f06e81f3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54304/0 (socket says 172.21.15.47:54304) 2024-04-01T23:01:30.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.600+0000 7f06e6d9d640 1 -- 172.21.15.47:0/2137433540 learned_addr learned my addr 172.21.15.47:0/2137433540 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:30.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.600+0000 7f06e659c640 1 --2- 172.21.15.47:0/2137433540 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06e80c93f0 0x7f06e80c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:30.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.604+0000 7f06e6d9d640 1 -- 172.21.15.47:0/2137433540 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f06e80cc0d0 msgr2=0x7f06e81f3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:30.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.604+0000 7f06e6d9d640 1 --2- 172.21.15.47:0/2137433540 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f06e80cc0d0 0x7f06e81f3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:30.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.604+0000 7f06e6d9d640 1 -- 172.21.15.47:0/2137433540 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06e80c93f0 msgr2=0x7f06e80c5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:30.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.604+0000 7f06e6d9d640 1 --2- 172.21.15.47:0/2137433540 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06e80c93f0 0x7f06e80c5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:30.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.604+0000 7f06e6d9d640 1 -- 172.21.15.47:0/2137433540 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e8158140 con 0x7f06e80cee30 2024-04-01T23:01:30.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.606+0000 7f06e6d9d640 1 --2- 172.21.15.47:0/2137433540 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06e80cee30 0x7f06e81f3f80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f06e0009e50 tx=0x7f06e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:30.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.609+0000 7f06deffd640 1 -- 172.21.15.47:0/2137433540 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e0044020 con 0x7f06e80cee30 2024-04-01T23:01:30.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.609+0000 7f06deffd640 1 -- 172.21.15.47:0/2137433540 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e003f470 con 0x7f06e80cee30 2024-04-01T23:01:30.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.609+0000 7f06eccc0640 1 -- 172.21.15.47:0/2137433540 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06e80c7490 con 0x7f06e80cee30 2024-04-01T23:01:30.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.610+0000 7f06deffd640 1 -- 172.21.15.47:0/2137433540 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e0039040 con 0x7f06e80cee30 2024-04-01T23:01:30.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.610+0000 7f06eccc0640 1 -- 172.21.15.47:0/2137433540 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06e8156c60 con 0x7f06e80cee30 2024-04-01T23:01:30.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.611+0000 7f06eccc0640 1 -- 172.21.15.47:0/2137433540 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06e8068210 con 0x7f06e80cee30 2024-04-01T23:01:30.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.630+0000 7f06deffd640 1 -- 172.21.15.47:0/2137433540 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f06e0047020 con 0x7f06e80cee30 2024-04-01T23:01:30.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.631+0000 7f06deffd640 1 --2- 172.21.15.47:0/2137433540 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f06c806b9e0 0x7f06c806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:30.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.631+0000 7f06e659c640 1 --2- 172.21.15.47:0/2137433540 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f06c806b9e0 0x7f06c806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:30.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.631+0000 7f06e659c640 1 --2- 172.21.15.47:0/2137433540 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f06c806b9e0 0x7f06c806dea0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f06d8000f60 tx=0x7f06d8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:30.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.890+0000 7f06deffd640 1 -- 172.21.15.47:0/2137433540 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f06e0079e10 con 0x7f06e80cee30 2024-04-01T23:01:30.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:30.890+0000 7f06deffd640 1 -- 172.21.15.47:0/2137433540 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f06e004e030 con 0x7f06e80cee30 2024-04-01T23:01:31.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.091+0000 7f06eccc0640 1 -- 172.21.15.47:0/2137433540 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f06e806cf00 con 0x7f06e80cee30 2024-04-01T23:01:31.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.096+0000 7f06deffd640 1 -- 172.21.15.47:0/2137433540 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f06e007bd70 con 0x7f06e80cee30 2024-04-01T23:01:31.092 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-04-01T23:01:31.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.098+0000 7f06eccc0640 1 -- 172.21.15.47:0/2137433540 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f06c806b9e0 msgr2=0x7f06c806dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:31.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.098+0000 7f06eccc0640 1 --2- 172.21.15.47:0/2137433540 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f06c806b9e0 0x7f06c806dea0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f06d8000f60 tx=0x7f06d8009040 comp rx=0 tx=0).stop 2024-04-01T23:01:31.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.098+0000 7f06eccc0640 1 -- 172.21.15.47:0/2137433540 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06e80cee30 msgr2=0x7f06e81f3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:31.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.098+0000 7f06eccc0640 1 --2- 172.21.15.47:0/2137433540 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06e80cee30 0x7f06e81f3f80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f06e0009e50 tx=0x7f06e0004a40 comp rx=0 tx=0).stop 2024-04-01T23:01:31.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.098+0000 7f06eccc0640 1 -- 172.21.15.47:0/2137433540 shutdown_connections 2024-04-01T23:01:31.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.098+0000 7f06eccc0640 1 --2- 172.21.15.47:0/2137433540 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f06c806b9e0 0x7f06c806dea0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:31.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.098+0000 7f06eccc0640 1 --2- 172.21.15.47:0/2137433540 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06e80cee30 0x7f06e81f3f80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:31.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.098+0000 7f06eccc0640 1 --2- 172.21.15.47:0/2137433540 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f06e80cc0d0 0x7f06e81f3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:31.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.098+0000 7f06eccc0640 1 --2- 172.21.15.47:0/2137433540 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06e80c93f0 0x7f06e80c5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:31.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.098+0000 7f06eccc0640 1 -- 172.21.15.47:0/2137433540 >> 172.21.15.47:0/2137433540 conn(0x7f06e80cfdb0 msgr2=0x7f06e8159dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:31.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.098+0000 7f06eccc0640 1 -- 172.21.15.47:0/2137433540 shutdown_connections 2024-04-01T23:01:31.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.098+0000 7f06eccc0640 1 -- 172.21.15.47:0/2137433540 wait complete. 2024-04-01T23:01:31.105 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-01T23:01:31.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.215+0000 7f51b565c640 1 Processor -- start 2024-04-01T23:01:31.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.215+0000 7f51b565c640 1 -- start start 2024-04-01T23:01:31.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.216+0000 7f51b565c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f51b0150f80 0x7f51b00cb680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:31.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.216+0000 7f51b565c640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f51b00cbbc0 0x7f51b01574b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:31.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.216+0000 7f51b565c640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51b0151360 con 0x7f51b01579f0 2024-04-01T23:01:31.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.216+0000 7f51b565c640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f51b00c4dd0 con 0x7f51b0150f80 2024-04-01T23:01:31.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.216+0000 7f51b565c640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f51b0157e40 con 0x7f51b00cbbc0 2024-04-01T23:01:31.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.216+0000 7f51aeffd640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f51b0150f80 0x7f51b00cb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:31.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.216+0000 7f51a7fff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f51b00cbbc0 0x7f51b01574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:31.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.217+0000 7f51aeffd640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f51b0150f80 0x7f51b00cb680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:39452/0 (socket says 172.21.15.47:39452) 2024-04-01T23:01:31.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.217+0000 7f51aeffd640 1 -- 172.21.15.47:0/2877568688 learned_addr learned my addr 172.21.15.47:0/2877568688 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:31.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.219+0000 7f51a7fff640 1 -- 172.21.15.47:0/2877568688 >> v2:172.21.15.181:3300/0 conn(0x7f51b0150f80 msgr2=0x7f51b00cb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:01:31.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.219+0000 7f51a7fff640 1 --2- 172.21.15.47:0/2877568688 >> v2:172.21.15.181:3300/0 conn(0x7f51b0150f80 0x7f51b00cb680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:31.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.219+0000 7f51a7fff640 1 -- 172.21.15.47:0/2877568688 >> v1:172.21.15.181:6789/0 conn(0x7f51b01579f0 legacy=0x7f51b00729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:31.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.219+0000 7f51a7fff640 1 -- 172.21.15.47:0/2877568688 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b00c5b80 con 0x7f51b00cbbc0 2024-04-01T23:01:31.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.221+0000 7f51a7fff640 1 --2- 172.21.15.47:0/2877568688 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f51b00cbbc0 0x7f51b01574b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f51980097a0 tx=0x7f519802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57713d3eb9145181 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:31.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.223+0000 7f51ae7fc640 1 -- 172.21.15.47:0/2877568688 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51980315a0 con 0x7f51b00cbbc0 2024-04-01T23:01:31.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.224+0000 7f51ae7fc640 1 -- 172.21.15.47:0/2877568688 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5198037070 con 0x7f51b00cbbc0 2024-04-01T23:01:31.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.225+0000 7f51b565c640 1 -- 172.21.15.47:0/2877568688 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f51b00cbbc0 msgr2=0x7f51b01574b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:31.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.225+0000 7f51b565c640 1 --2- 172.21.15.47:0/2877568688 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f51b00cbbc0 0x7f51b01574b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f51980097a0 tx=0x7f519802b840 comp rx=0 tx=0).stop 2024-04-01T23:01:31.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.225+0000 7f51b565c640 1 -- 172.21.15.47:0/2877568688 shutdown_connections 2024-04-01T23:01:31.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.225+0000 7f51b565c640 1 --2- 172.21.15.47:0/2877568688 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f51b00cbbc0 0x7f51b01574b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:31.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.225+0000 7f51b565c640 1 --2- 172.21.15.47:0/2877568688 >> v2:172.21.15.181:3300/0 conn(0x7f51b0150f80 0x7f51b00cb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:31.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.225+0000 7f51b565c640 1 -- 172.21.15.47:0/2877568688 >> 172.21.15.47:0/2877568688 conn(0x7f51b006b110 msgr2=0x7f51b006b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:31.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.225+0000 7f51b565c640 1 -- 172.21.15.47:0/2877568688 shutdown_connections 2024-04-01T23:01:31.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.225+0000 7f51b565c640 1 -- 172.21.15.47:0/2877568688 wait complete. 2024-04-01T23:01:31.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.226+0000 7f51b565c640 1 Processor -- start 2024-04-01T23:01:31.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.226+0000 7f51b565c640 1 -- start start 2024-04-01T23:01:31.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.226+0000 7f51b565c640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f51b00cbbc0 0x7f51b014c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:31.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.226+0000 7f51b565c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51b0150f80 0x7f51b0154f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:31.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.226+0000 7f51b565c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51b01579f0 0x7f51b0155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:31.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.227+0000 7f51b565c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f51b00c55c0 con 0x7f51b0150f80 2024-04-01T23:01:31.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.227+0000 7f51b565c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f51b00c52e0 con 0x7f51b01579f0 2024-04-01T23:01:31.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.227+0000 7f51b565c640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f51b00c58a0 con 0x7f51b00cbbc0 2024-04-01T23:01:31.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.227+0000 7f51af7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51b01579f0 0x7f51b0155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:31.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.227+0000 7f51a7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51b0150f80 0x7f51b0154f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:31.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.227+0000 7f51aeffd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f51b00cbbc0 0x7f51b014c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:31.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.228+0000 7f51aeffd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f51b00cbbc0 0x7f51b014c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:47900/0 (socket says 172.21.15.47:47900) 2024-04-01T23:01:31.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.228+0000 7f51af7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51b01579f0 0x7f51b0155490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:39458/0 (socket says 172.21.15.47:39458) 2024-04-01T23:01:31.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.228+0000 7f51aeffd640 1 -- 172.21.15.47:0/645317148 learned_addr learned my addr 172.21.15.47:0/645317148 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:31.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.231+0000 7f51aeffd640 1 -- 172.21.15.47:0/645317148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51b01579f0 msgr2=0x7f51b0155490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:31.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.231+0000 7f51aeffd640 1 --2- 172.21.15.47:0/645317148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51b01579f0 0x7f51b0155490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:31.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.231+0000 7f51aeffd640 1 -- 172.21.15.47:0/645317148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51b0150f80 msgr2=0x7f51b0154f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:31.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.231+0000 7f51aeffd640 1 --2- 172.21.15.47:0/645317148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51b0150f80 0x7f51b0154f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:31.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.231+0000 7f51aeffd640 1 -- 172.21.15.47:0/645317148 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b01edff0 con 0x7f51b00cbbc0 2024-04-01T23:01:31.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.233+0000 7f51aeffd640 1 --2- 172.21.15.47:0/645317148 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f51b00cbbc0 0x7f51b014c4c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f51a000e8b0 tx=0x7f51a000ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:31.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.235+0000 7f51a77fe640 1 -- 172.21.15.47:0/645317148 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a0017070 con 0x7f51b00cbbc0 2024-04-01T23:01:31.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.235+0000 7f51b565c640 1 -- 172.21.15.47:0/645317148 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51b01ee2d0 con 0x7f51b00cbbc0 2024-04-01T23:01:31.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.235+0000 7f51b565c640 1 -- 172.21.15.47:0/645317148 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f51b01ee890 con 0x7f51b00cbbc0 2024-04-01T23:01:31.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.236+0000 7f51b565c640 1 -- 172.21.15.47:0/645317148 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51b0154b90 con 0x7f51b00cbbc0 2024-04-01T23:01:31.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.236+0000 7f51a77fe640 1 -- 172.21.15.47:0/645317148 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51a0005990 con 0x7f51b00cbbc0 2024-04-01T23:01:31.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.236+0000 7f51a77fe640 1 -- 172.21.15.47:0/645317148 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a0021060 con 0x7f51b00cbbc0 2024-04-01T23:01:31.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.480+0000 7f51a77fe640 1 -- 172.21.15.47:0/645317148 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f51a001a070 con 0x7f51b00cbbc0 2024-04-01T23:01:31.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.480+0000 7f51a77fe640 1 --2- 172.21.15.47:0/645317148 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f519006b990 0x7f519006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:31.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.481+0000 7f51a7fff640 1 --2- 172.21.15.47:0/645317148 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f519006b990 0x7f519006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:31.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.481+0000 7f51a7fff640 1 --2- 172.21.15.47:0/645317148 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f519006b990 0x7f519006de50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5198036000 tx=0x7f5198008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:31.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.485+0000 7f51a77fe640 1 -- 172.21.15.47:0/645317148 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f51a0057560 con 0x7f51b00cbbc0 2024-04-01T23:01:31.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.496+0000 7f51a77fe640 1 -- 172.21.15.47:0/645317148 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f51a00594c0 con 0x7f51b00cbbc0 2024-04-01T23:01:31.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.679+0000 7f51b565c640 1 -- 172.21.15.47:0/645317148 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f51b0068210 con 0x7f51b00cbbc0 2024-04-01T23:01:31.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.684+0000 7f51a77fe640 1 -- 172.21.15.47:0/645317148 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f51a005d560 con 0x7f51b00cbbc0 2024-04-01T23:01:31.681 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-01T23:01:31.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.686+0000 7f51b565c640 1 -- 172.21.15.47:0/645317148 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f519006b990 msgr2=0x7f519006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:31.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.686+0000 7f51b565c640 1 --2- 172.21.15.47:0/645317148 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f519006b990 0x7f519006de50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5198036000 tx=0x7f5198008030 comp rx=0 tx=0).stop 2024-04-01T23:01:31.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.687+0000 7f51b565c640 1 -- 172.21.15.47:0/645317148 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f51b00cbbc0 msgr2=0x7f51b014c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:31.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.687+0000 7f51b565c640 1 --2- 172.21.15.47:0/645317148 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f51b00cbbc0 0x7f51b014c4c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f51a000e8b0 tx=0x7f51a000ed70 comp rx=0 tx=0).stop 2024-04-01T23:01:31.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.687+0000 7f51b565c640 1 -- 172.21.15.47:0/645317148 shutdown_connections 2024-04-01T23:01:31.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.687+0000 7f51b565c640 1 --2- 172.21.15.47:0/645317148 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f519006b990 0x7f519006de50 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:31.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.687+0000 7f51b565c640 1 --2- 172.21.15.47:0/645317148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51b01579f0 0x7f51b0155490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:31.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.687+0000 7f51b565c640 1 --2- 172.21.15.47:0/645317148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51b0150f80 0x7f51b0154f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:31.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.687+0000 7f51b565c640 1 --2- 172.21.15.47:0/645317148 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f51b00cbbc0 0x7f51b014c4c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:31.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.687+0000 7f51b565c640 1 -- 172.21.15.47:0/645317148 >> 172.21.15.47:0/645317148 conn(0x7f51b006b110 msgr2=0x7f51b0072aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:31.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.687+0000 7f51b565c640 1 -- 172.21.15.47:0/645317148 shutdown_connections 2024-04-01T23:01:31.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.687+0000 7f51b565c640 1 -- 172.21.15.47:0/645317148 wait complete. 2024-04-01T23:01:31.695 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-01T23:01:31.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.802+0000 7f84771ac640 1 Processor -- start 2024-04-01T23:01:31.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.802+0000 7f84771ac640 1 -- start start 2024-04-01T23:01:31.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.803+0000 7f84771ac640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f84700cee30 0x7f847015afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:31.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.803+0000 7f84771ac640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f84700cc0d0 0x7f84700cc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:31.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.803+0000 7f84771ac640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84700cdae0 con 0x7f84700c93f0 2024-04-01T23:01:31.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.803+0000 7f84771ac640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f847015b500 con 0x7f84700cc0d0 2024-04-01T23:01:31.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.803+0000 7f84771ac640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f84700cca60 con 0x7f84700cee30 2024-04-01T23:01:31.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.803+0000 7f8475749640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f84700cc0d0 0x7f84700cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:31.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.804+0000 7f846ffff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f84700cee30 0x7f847015afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:31.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.804+0000 7f8475749640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f84700cc0d0 0x7f84700cc520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54310/0 (socket says 172.21.15.47:54310) 2024-04-01T23:01:31.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.804+0000 7f8475749640 1 -- 172.21.15.47:0/2223736458 learned_addr learned my addr 172.21.15.47:0/2223736458 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:31.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.806+0000 7f8475749640 1 -- 172.21.15.47:0/2223736458 >> v2:172.21.15.181:3300/0 conn(0x7f84700cee30 msgr2=0x7f847015afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:01:31.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.806+0000 7f8475749640 1 --2- 172.21.15.47:0/2223736458 >> v2:172.21.15.181:3300/0 conn(0x7f84700cee30 0x7f847015afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:31.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.806+0000 7f8475749640 1 -- 172.21.15.47:0/2223736458 >> v1:172.21.15.181:6789/0 conn(0x7f84700c93f0 legacy=0x7f847006c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:31.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.806+0000 7f8475749640 1 -- 172.21.15.47:0/2223736458 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84700c97d0 con 0x7f84700cc0d0 2024-04-01T23:01:31.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.808+0000 7f8475749640 1 --2- 172.21.15.47:0/2223736458 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84700cc0d0 0x7f84700cc520 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f847008cd20 tx=0x7f846802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16c759f398a7f3e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:31.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.812+0000 7f846f7fe640 1 -- 172.21.15.47:0/2223736458 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f846802ca80 con 0x7f84700cc0d0 2024-04-01T23:01:31.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.812+0000 7f846f7fe640 1 -- 172.21.15.47:0/2223736458 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f846802cc20 con 0x7f84700cc0d0 2024-04-01T23:01:31.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.812+0000 7f846f7fe640 1 -- 172.21.15.47:0/2223736458 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84680343f0 con 0x7f84700cc0d0 2024-04-01T23:01:31.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.813+0000 7f84771ac640 1 -- 172.21.15.47:0/2223736458 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84700cc0d0 msgr2=0x7f84700cc520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:31.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.813+0000 7f84771ac640 1 --2- 172.21.15.47:0/2223736458 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84700cc0d0 0x7f84700cc520 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f847008cd20 tx=0x7f846802bee0 comp rx=0 tx=0).stop 2024-04-01T23:01:31.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.813+0000 7f84771ac640 1 -- 172.21.15.47:0/2223736458 shutdown_connections 2024-04-01T23:01:31.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.813+0000 7f84771ac640 1 --2- 172.21.15.47:0/2223736458 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84700cc0d0 0x7f84700cc520 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:31.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.813+0000 7f84771ac640 1 --2- 172.21.15.47:0/2223736458 >> v2:172.21.15.181:3300/0 conn(0x7f84700cee30 0x7f847015afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:31.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.813+0000 7f84771ac640 1 -- 172.21.15.47:0/2223736458 >> 172.21.15.47:0/2223736458 conn(0x7f84700cfdb0 msgr2=0x7f84700d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:31.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.813+0000 7f84771ac640 1 -- 172.21.15.47:0/2223736458 shutdown_connections 2024-04-01T23:01:31.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.813+0000 7f84771ac640 1 -- 172.21.15.47:0/2223736458 wait complete. 2024-04-01T23:01:31.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.814+0000 7f84771ac640 1 Processor -- start 2024-04-01T23:01:31.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.814+0000 7f84771ac640 1 -- start start 2024-04-01T23:01:31.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.815+0000 7f84771ac640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84700c93f0 0x7f84700ac5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:31.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.815+0000 7f84771ac640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84700cc0d0 0x7f84700ad5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:31.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.815+0000 7f84771ac640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f84700cee30 0x7f8470152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:31.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.815+0000 7f84771ac640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f84700ce340 con 0x7f84700cc0d0 2024-04-01T23:01:31.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.815+0000 7f84771ac640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f84700ce060 con 0x7f84700c93f0 2024-04-01T23:01:31.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.815+0000 7f84771ac640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f84700ce620 con 0x7f84700cee30 2024-04-01T23:01:31.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.816+0000 7f846ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84700cc0d0 0x7f84700ad5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:31.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.816+0000 7f8474f48640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84700c93f0 0x7f84700ac5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:31.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.816+0000 7f8475749640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f84700cee30 0x7f8470152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:31.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.816+0000 7f846ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84700cc0d0 0x7f84700ad5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54318/0 (socket says 172.21.15.47:54318) 2024-04-01T23:01:31.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.816+0000 7f846ffff640 1 -- 172.21.15.47:0/1100098818 learned_addr learned my addr 172.21.15.47:0/1100098818 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:31.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.819+0000 7f846ffff640 1 -- 172.21.15.47:0/1100098818 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f84700cee30 msgr2=0x7f8470152230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:31.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.819+0000 7f846ffff640 1 --2- 172.21.15.47:0/1100098818 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f84700cee30 0x7f8470152230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:31.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.819+0000 7f846ffff640 1 -- 172.21.15.47:0/1100098818 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84700c93f0 msgr2=0x7f84700ac5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:31.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.819+0000 7f846ffff640 1 --2- 172.21.15.47:0/1100098818 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84700c93f0 0x7f84700ac5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:31.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.819+0000 7f846ffff640 1 -- 172.21.15.47:0/1100098818 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84701f00a0 con 0x7f84700cc0d0 2024-04-01T23:01:31.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.822+0000 7f846ffff640 1 --2- 172.21.15.47:0/1100098818 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84700cc0d0 0x7f84700ad5d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f845c00e870 tx=0x7f845c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:31.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.824+0000 7f846d7fa640 1 -- 172.21.15.47:0/1100098818 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f845c017070 con 0x7f84700cc0d0 2024-04-01T23:01:31.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.824+0000 7f84771ac640 1 -- 172.21.15.47:0/1100098818 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84701f0380 con 0x7f84700cc0d0 2024-04-01T23:01:31.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.824+0000 7f84771ac640 1 -- 172.21.15.47:0/1100098818 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84701f0c20 con 0x7f84700cc0d0 2024-04-01T23:01:31.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.825+0000 7f84771ac640 1 -- 172.21.15.47:0/1100098818 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84701f0550 con 0x7f84700cc0d0 2024-04-01T23:01:31.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.826+0000 7f846d7fa640 1 -- 172.21.15.47:0/1100098818 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f845c00c940 con 0x7f84700cc0d0 2024-04-01T23:01:31.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:31.826+0000 7f846d7fa640 1 -- 172.21.15.47:0/1100098818 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f845c021060 con 0x7f84700cc0d0 2024-04-01T23:01:32.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:32.096+0000 7f846d7fa640 1 -- 172.21.15.47:0/1100098818 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f845c01a070 con 0x7f84700cc0d0 2024-04-01T23:01:32.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:32.096+0000 7f846d7fa640 1 --2- 172.21.15.47:0/1100098818 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f845406b990 0x7f845406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:32.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:32.096+0000 7f8474f48640 1 --2- 172.21.15.47:0/1100098818 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f845406b990 0x7f845406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:32.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:32.097+0000 7f8474f48640 1 --2- 172.21.15.47:0/1100098818 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f845406b990 0x7f845406de50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8464000f60 tx=0x7f8464009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:32.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:32.112+0000 7f846d7fa640 1 -- 172.21.15.47:0/1100098818 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f845c0574e0 con 0x7f84700cc0d0 2024-04-01T23:01:32.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:32.112+0000 7f846d7fa640 1 -- 172.21.15.47:0/1100098818 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f845c059440 con 0x7f84700cc0d0 2024-04-01T23:01:32.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:32.318+0000 7f84771ac640 1 -- 172.21.15.47:0/1100098818 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f84700ab9a0 con 0x7f84700cc0d0 2024-04-01T23:01:32.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:32.327+0000 7f846d7fa640 1 -- 172.21.15.47:0/1100098818 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f845c05d4e0 con 0x7f84700cc0d0 2024-04-01T23:01:32.323 INFO:teuthology.orchestra.run.smithi047.stderr:listed 0 entries 2024-04-01T23:01:32.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:32.329+0000 7f84771ac640 1 -- 172.21.15.47:0/1100098818 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f845406b990 msgr2=0x7f845406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:32.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:32.329+0000 7f84771ac640 1 --2- 172.21.15.47:0/1100098818 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f845406b990 0x7f845406de50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8464000f60 tx=0x7f8464009040 comp rx=0 tx=0).stop 2024-04-01T23:01:32.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:32.329+0000 7f84771ac640 1 -- 172.21.15.47:0/1100098818 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84700cc0d0 msgr2=0x7f84700ad5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:32.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:32.329+0000 7f84771ac640 1 --2- 172.21.15.47:0/1100098818 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84700cc0d0 0x7f84700ad5d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f845c00e870 tx=0x7f845c00ed30 comp rx=0 tx=0).stop 2024-04-01T23:01:32.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:32.329+0000 7f84771ac640 1 -- 172.21.15.47:0/1100098818 shutdown_connections 2024-04-01T23:01:32.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:32.329+0000 7f84771ac640 1 --2- 172.21.15.47:0/1100098818 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f845406b990 0x7f845406de50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:32.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:32.329+0000 7f84771ac640 1 --2- 172.21.15.47:0/1100098818 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f84700cee30 0x7f8470152230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:32.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:32.329+0000 7f84771ac640 1 --2- 172.21.15.47:0/1100098818 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84700cc0d0 0x7f84700ad5d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:32.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:32.329+0000 7f84771ac640 1 --2- 172.21.15.47:0/1100098818 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f84700c93f0 0x7f84700ac5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:32.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:32.329+0000 7f84771ac640 1 -- 172.21.15.47:0/1100098818 >> 172.21.15.47:0/1100098818 conn(0x7f84700cfdb0 msgr2=0x7f8470159dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:32.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:32.329+0000 7f84771ac640 1 -- 172.21.15.47:0/1100098818 shutdown_connections 2024-04-01T23:01:32.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:32.330+0000 7f84771ac640 1 -- 172.21.15.47:0/1100098818 wait complete. 2024-04-01T23:01:32.337 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi047.front.sepia.ceph.com... 2024-04-01T23:01:32.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T23:01:32.337 DEBUG:teuthology.orchestra.run.smithi047:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-01T23:01:32.365 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T23:01:32.389 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi047.stderr:ceph-fuse[45984]: fuse finished with error 0 and tester_r 0 2024-04-01T23:01:32.914 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi047.stderr:==00:00:27:09.501 45984== 2024-04-01T23:01:32.914 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi047.stderr:==00:00:27:09.501 45984== Exit program on first error (--exit-on-first-error=yes) 2024-04-01T23:01:33.108 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi047.stderr:daemon-helper: command failed with exit status 42 2024-04-01T23:01:38.468 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-04-01T23:01:38.468 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi047.front.sepia.ceph.com 2024-04-01T23:01:38.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T23:01:38.468 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-01T23:01:38.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T23:01:38.483 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-04-01T23:01:38.538 INFO:teuthology.orchestra.run.smithi047.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-01T23:01:38.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T23:01:38.539 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T23:01:38.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T23:01:38.607 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link delete ceph-brx 2024-04-01T23:01:38.699 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-01T23:01:38.710 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-01T23:01:38.710 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T23:01:38.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.819+0000 7f89a66df640 1 Processor -- start 2024-04-01T23:01:38.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.819+0000 7f89a66df640 1 -- start start 2024-04-01T23:01:38.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.820+0000 7f89a66df640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f89a0152460 0x7f89a0157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:38.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.820+0000 7f89a66df640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f89a015bef0 0x7f89a00c6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:38.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.820+0000 7f89a66df640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a01586f0 con 0x7f89a006ed60 2024-04-01T23:01:38.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.820+0000 7f89a66df640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f89a0158f90 con 0x7f89a0152460 2024-04-01T23:01:38.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.820+0000 7f89a66df640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f89a01589d0 con 0x7f89a015bef0 2024-04-01T23:01:38.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.821+0000 7f899ffff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f89a0152460 0x7f89a0157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:38.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.821+0000 7f899f7fe640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f89a015bef0 0x7f89a00c6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:38.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.821+0000 7f899ffff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f89a0152460 0x7f89a0157fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54326/0 (socket says 172.21.15.47:54326) 2024-04-01T23:01:38.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.821+0000 7f899ffff640 1 -- 172.21.15.47:0/3784138151 learned_addr learned my addr 172.21.15.47:0/3784138151 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:38.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.824+0000 7f899ffff640 1 -- 172.21.15.47:0/3784138151 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f89a015bef0 msgr2=0x7f89a00c6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:01:38.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.824+0000 7f899ffff640 1 --2- 172.21.15.47:0/3784138151 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f89a015bef0 0x7f89a00c6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:38.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.824+0000 7f899ffff640 1 -- 172.21.15.47:0/3784138151 >> v1:172.21.15.47:6789/0 conn(0x7f89a006ed60 legacy=0x7f89a00c7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:38.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.824+0000 7f899ffff640 1 -- 172.21.15.47:0/3784138151 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a0158cb0 con 0x7f89a0152460 2024-04-01T23:01:38.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.827+0000 7f899ffff640 1 --2- 172.21.15.47:0/3784138151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89a0152460 0x7f89a0157fd0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8988009870 tx=0x7f898802ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5afee158bb5efc server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:38.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.831+0000 7f899effd640 1 -- 172.21.15.47:0/3784138151 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898802f840 con 0x7f89a0152460 2024-04-01T23:01:38.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.831+0000 7f899effd640 1 -- 172.21.15.47:0/3784138151 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f898802f9e0 con 0x7f89a0152460 2024-04-01T23:01:38.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.831+0000 7f899effd640 1 -- 172.21.15.47:0/3784138151 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898802fdb0 con 0x7f89a0152460 2024-04-01T23:01:38.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.832+0000 7f89a66df640 1 -- 172.21.15.47:0/3784138151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89a0152460 msgr2=0x7f89a0157fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:38.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.832+0000 7f89a66df640 1 --2- 172.21.15.47:0/3784138151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89a0152460 0x7f89a0157fd0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8988009870 tx=0x7f898802ba20 comp rx=0 tx=0).stop 2024-04-01T23:01:38.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.832+0000 7f89a66df640 1 -- 172.21.15.47:0/3784138151 shutdown_connections 2024-04-01T23:01:38.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.832+0000 7f89a66df640 1 --2- 172.21.15.47:0/3784138151 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f89a015bef0 0x7f89a00c6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:38.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.832+0000 7f89a66df640 1 --2- 172.21.15.47:0/3784138151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89a0152460 0x7f89a0157fd0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:38.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.832+0000 7f89a66df640 1 -- 172.21.15.47:0/3784138151 >> 172.21.15.47:0/3784138151 conn(0x7f89a00cb740 msgr2=0x7f89a00cbb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:38.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.832+0000 7f89a66df640 1 -- 172.21.15.47:0/3784138151 shutdown_connections 2024-04-01T23:01:38.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.832+0000 7f89a66df640 1 -- 172.21.15.47:0/3784138151 wait complete. 2024-04-01T23:01:38.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.833+0000 7f89a66df640 1 Processor -- start 2024-04-01T23:01:38.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.833+0000 7f89a66df640 1 -- start start 2024-04-01T23:01:38.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.834+0000 7f89a66df640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89a006ed60 0x7f89a0152900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:38.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.834+0000 7f89a66df640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f89a0152460 0x7f89a00c2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:38.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.834+0000 7f89a66df640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89a015bef0 0x7f89a01e24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:38.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.834+0000 7f89a66df640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f89a006fa30 con 0x7f89a006ed60 2024-04-01T23:01:38.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.834+0000 7f89a66df640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f89a00c6e70 con 0x7f89a015bef0 2024-04-01T23:01:38.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.834+0000 7f89a66df640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f89a015c350 con 0x7f89a0152460 2024-04-01T23:01:38.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.834+0000 7f899ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89a006ed60 0x7f89a0152900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:38.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.835+0000 7f899f7fe640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f89a0152460 0x7f89a00c2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:38.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.835+0000 7f899ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89a006ed60 0x7f89a0152900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54336/0 (socket says 172.21.15.47:54336) 2024-04-01T23:01:38.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.835+0000 7f899ffff640 1 -- 172.21.15.47:0/3328720638 learned_addr learned my addr 172.21.15.47:0/3328720638 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:38.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.835+0000 7f89a4c7c640 1 --2- 172.21.15.47:0/3328720638 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89a015bef0 0x7f89a01e24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:38.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.838+0000 7f899ffff640 1 -- 172.21.15.47:0/3328720638 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f89a0152460 msgr2=0x7f89a00c2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:38.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.838+0000 7f899ffff640 1 --2- 172.21.15.47:0/3328720638 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f89a0152460 0x7f89a00c2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:38.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.838+0000 7f899ffff640 1 -- 172.21.15.47:0/3328720638 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89a015bef0 msgr2=0x7f89a01e24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:38.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.838+0000 7f899ffff640 1 --2- 172.21.15.47:0/3328720638 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89a015bef0 0x7f89a01e24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:38.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.838+0000 7f899ffff640 1 -- 172.21.15.47:0/3328720638 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a01eeae0 con 0x7f89a006ed60 2024-04-01T23:01:38.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.841+0000 7f899ffff640 1 --2- 172.21.15.47:0/3328720638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89a006ed60 0x7f89a0152900 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8988009990 tx=0x7f89880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:38.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.844+0000 7f899cff9640 1 -- 172.21.15.47:0/3328720638 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8988047070 con 0x7f89a006ed60 2024-04-01T23:01:38.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.844+0000 7f899cff9640 1 -- 172.21.15.47:0/3328720638 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8988037c40 con 0x7f89a006ed60 2024-04-01T23:01:38.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.844+0000 7f89a66df640 1 -- 172.21.15.47:0/3328720638 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89a0153250 con 0x7f89a006ed60 2024-04-01T23:01:38.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.844+0000 7f899cff9640 1 -- 172.21.15.47:0/3328720638 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8988042460 con 0x7f89a006ed60 2024-04-01T23:01:38.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.844+0000 7f89a66df640 1 -- 172.21.15.47:0/3328720638 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89a01edd20 con 0x7f89a006ed60 2024-04-01T23:01:38.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:38.846+0000 7f89a66df640 1 -- 172.21.15.47:0/3328720638 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89a0068210 con 0x7f89a006ed60 2024-04-01T23:01:39.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.115+0000 7f899cff9640 1 -- 172.21.15.47:0/3328720638 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f898804a070 con 0x7f89a006ed60 2024-04-01T23:01:39.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.115+0000 7f899cff9640 1 --2- 172.21.15.47:0/3328720638 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f898006ba10 0x7f898006ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:39.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.115+0000 7f899f7fe640 1 --2- 172.21.15.47:0/3328720638 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f898006ba10 0x7f898006ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:39.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.115+0000 7f899f7fe640 1 --2- 172.21.15.47:0/3328720638 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f898006ba10 0x7f898006ded0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f89a0150c20 tx=0x7f8990009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:39.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.136+0000 7f899cff9640 1 -- 172.21.15.47:0/3328720638 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f8988079610 con 0x7f89a006ed60 2024-04-01T23:01:39.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.136+0000 7f899cff9640 1 -- 172.21.15.47:0/3328720638 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f8988051020 con 0x7f89a006ed60 2024-04-01T23:01:39.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.332+0000 7f89a66df640 1 -- 172.21.15.47:0/3328720638 --> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f89a00c7180 con 0x7f898006ba10 2024-04-01T23:01:39.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.341+0000 7f899cff9640 1 -- 172.21.15.47:0/3328720638 <== mgr.4107 v2:172.21.15.47:6800/1257047371 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+333937 (secure 0 0 0) 0x7f89a00c7180 con 0x7f898006ba10 2024-04-01T23:01:39.343 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T23:01:39.346 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-01T23:01:39.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.344+0000 7f89a66df640 1 -- 172.21.15.47:0/3328720638 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f898006ba10 msgr2=0x7f898006ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:39.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.344+0000 7f89a66df640 1 --2- 172.21.15.47:0/3328720638 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f898006ba10 0x7f898006ded0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f89a0150c20 tx=0x7f8990009190 comp rx=0 tx=0).stop 2024-04-01T23:01:39.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.344+0000 7f89a66df640 1 -- 172.21.15.47:0/3328720638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89a006ed60 msgr2=0x7f89a0152900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:39.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.344+0000 7f89a66df640 1 --2- 172.21.15.47:0/3328720638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89a006ed60 0x7f89a0152900 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8988009990 tx=0x7f89880046c0 comp rx=0 tx=0).stop 2024-04-01T23:01:39.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.344+0000 7f89a66df640 1 -- 172.21.15.47:0/3328720638 shutdown_connections 2024-04-01T23:01:39.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.344+0000 7f89a66df640 1 --2- 172.21.15.47:0/3328720638 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f898006ba10 0x7f898006ded0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:39.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.344+0000 7f89a66df640 1 --2- 172.21.15.47:0/3328720638 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89a015bef0 0x7f89a01e24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:39.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.344+0000 7f89a66df640 1 --2- 172.21.15.47:0/3328720638 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f89a0152460 0x7f89a00c2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:39.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.344+0000 7f89a66df640 1 --2- 172.21.15.47:0/3328720638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89a006ed60 0x7f89a0152900 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:39.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.344+0000 7f89a66df640 1 -- 172.21.15.47:0/3328720638 >> 172.21.15.47:0/3328720638 conn(0x7f89a00cb740 msgr2=0x7f89a014f930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:39.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.344+0000 7f89a66df640 1 -- 172.21.15.47:0/3328720638 shutdown_connections 2024-04-01T23:01:39.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.344+0000 7f89a66df640 1 -- 172.21.15.47:0/3328720638 wait complete. 2024-04-01T23:01:39.352 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":875,"stamp":"2024-04-01T23:01:39.138750+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":37236956,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":932,"num_read_kb":976,"num_write":13954,"num_write_kb":334382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14562,"ondisk_log_size":14562,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":361328,"kb_used_data":49456,"kb_used_omap":12,"kb_used_meta":311795,"kb_avail":754613392,"statfs":{"total":773094113280,"available":772724113408,"internally_reserved":0,"allocated":50642944,"data_stored":75426104,"data_compressed":7309368,"data_compressed_allocated":11001856,"data_compressed_original":37232640,"omap_allocated":12751,"internal_metadata":319278641},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":97442,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8,"num_write":47,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002406"},"pg_stats":[{"pgid":"2.1f","version":"27'641","reported_seq":680,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:11.945740+0000","last_change":"2024-04-01T22:33:26.849312+0000","last_active":"2024-04-01T23:01:11.945740+0000","last_peered":"2024-04-01T23:01:11.945740+0000","last_clean":"2024-04-01T23:01:11.945740+0000","last_became_active":"2024-04-01T22:33:26.849009+0000","last_became_peered":"2024-04-01T22:33:26.849009+0000","last_unstale":"2024-04-01T23:01:11.945740+0000","last_undegraded":"2024-04-01T23:01:11.945740+0000","last_fullsized":"2024-04-01T23:01:11.945740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:58:40.837557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":638,"num_write_kb":4397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'23","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.707366+0000","last_change":"2024-04-01T22:33:27.919006+0000","last_active":"2024-04-01T23:01:32.707366+0000","last_peered":"2024-04-01T23:01:32.707366+0000","last_clean":"2024-04-01T23:01:32.707366+0000","last_became_active":"2024-04-01T22:33:27.918702+0000","last_became_peered":"2024-04-01T22:33:27.918702+0000","last_unstale":"2024-04-01T23:01:32.707366+0000","last_undegraded":"2024-04-01T23:01:32.707366+0000","last_fullsized":"2024-04-01T23:01:32.707366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:08:00.537270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'149","reported_seq":178,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.922398+0000","last_change":"2024-04-01T22:33:33.255162+0000","last_active":"2024-04-01T23:00:58.922398+0000","last_peered":"2024-04-01T23:00:58.922398+0000","last_clean":"2024-04-01T23:00:58.922398+0000","last_became_active":"2024-04-01T22:33:33.254187+0000","last_became_peered":"2024-04-01T22:33:33.254187+0000","last_unstale":"2024-04-01T23:00:58.922398+0000","last_undegraded":"2024-04-01T23:00:58.922398+0000","last_fullsized":"2024-04-01T23:00:58.922398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:57:12.343606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":7671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'717","reported_seq":757,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:09.146912+0000","last_change":"2024-04-01T22:33:26.855377+0000","last_active":"2024-04-01T23:01:09.146912+0000","last_peered":"2024-04-01T23:01:09.146912+0000","last_clean":"2024-04-01T23:01:09.146912+0000","last_became_active":"2024-04-01T22:33:26.855119+0000","last_became_peered":"2024-04-01T22:33:26.855119+0000","last_unstale":"2024-04-01T23:01:09.146912+0000","last_undegraded":"2024-04-01T23:01:09.146912+0000","last_fullsized":"2024-04-01T23:01:09.146912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:25:41.744696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":714,"num_write_kb":4525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'35","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.807686+0000","last_change":"2024-04-01T22:33:27.974175+0000","last_active":"2024-04-01T23:01:32.807686+0000","last_peered":"2024-04-01T23:01:32.807686+0000","last_clean":"2024-04-01T23:01:32.807686+0000","last_became_active":"2024-04-01T22:33:27.973915+0000","last_became_peered":"2024-04-01T22:33:27.973915+0000","last_unstale":"2024-04-01T23:01:32.807686+0000","last_undegraded":"2024-04-01T23:01:32.807686+0000","last_fullsized":"2024-04-01T23:01:32.807686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:43:03.166262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'127","reported_seq":156,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:00.657110+0000","last_change":"2024-04-01T22:33:32.853556+0000","last_active":"2024-04-01T23:01:00.657110+0000","last_peered":"2024-04-01T23:01:00.657110+0000","last_clean":"2024-04-01T23:01:00.657110+0000","last_became_active":"2024-04-01T22:33:32.853215+0000","last_became_peered":"2024-04-01T22:33:32.853215+0000","last_unstale":"2024-04-01T23:01:00.657110+0000","last_undegraded":"2024-04-01T23:01:00.657110+0000","last_fullsized":"2024-04-01T23:01:00.657110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:50:09.812910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":8638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'1188","reported_seq":1225,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:22.425341+0000","last_change":"2024-04-01T22:33:26.849967+0000","last_active":"2024-04-01T23:01:22.425341+0000","last_peered":"2024-04-01T23:01:22.425341+0000","last_clean":"2024-04-01T23:01:22.425341+0000","last_became_active":"2024-04-01T22:33:26.849432+0000","last_became_peered":"2024-04-01T22:33:26.849432+0000","last_unstale":"2024-04-01T23:01:22.425341+0000","last_undegraded":"2024-04-01T23:01:22.425341+0000","last_fullsized":"2024-04-01T23:01:22.425341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":1188,"log_dups_size":0,"ondisk_log_size":1188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:47:18.407469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1179,"num_write_kb":8891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'25","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.622804+0000","last_change":"2024-04-01T22:34:05.289795+0000","last_active":"2024-04-01T23:01:32.622804+0000","last_peered":"2024-04-01T23:01:32.622804+0000","last_clean":"2024-04-01T23:01:32.622804+0000","last_became_active":"2024-04-01T22:34:05.289454+0000","last_became_peered":"2024-04-01T22:34:05.289454+0000","last_unstale":"2024-04-01T23:01:32.622804+0000","last_undegraded":"2024-04-01T23:01:32.622804+0000","last_fullsized":"2024-04-01T23:01:32.622804+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:08:15.465415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"27'122","reported_seq":151,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:01.900227+0000","last_change":"2024-04-01T22:33:32.847230+0000","last_active":"2024-04-01T23:01:01.900227+0000","last_peered":"2024-04-01T23:01:01.900227+0000","last_clean":"2024-04-01T23:01:01.900227+0000","last_became_active":"2024-04-01T22:33:32.846382+0000","last_became_peered":"2024-04-01T22:33:32.846382+0000","last_unstale":"2024-04-01T23:01:01.900227+0000","last_undegraded":"2024-04-01T23:01:01.900227+0000","last_fullsized":"2024-04-01T23:01:01.900227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:41:50.766262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":10048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'7","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:16.444748+0000","last_change":"2024-04-01T22:33:26.852784+0000","last_active":"2024-04-01T23:01:16.444748+0000","last_peered":"2024-04-01T23:01:16.444748+0000","last_clean":"2024-04-01T23:01:16.444748+0000","last_became_active":"2024-04-01T22:33:26.852530+0000","last_became_peered":"2024-04-01T22:33:26.852530+0000","last_unstale":"2024-04-01T23:01:16.444748+0000","last_undegraded":"2024-04-01T23:01:16.444748+0000","last_fullsized":"2024-04-01T23:01:16.444748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:39:29.846272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'45","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.682061+0000","last_change":"2024-04-01T22:33:27.974358+0000","last_active":"2024-04-01T23:01:32.682061+0000","last_peered":"2024-04-01T23:01:32.682061+0000","last_clean":"2024-04-01T23:01:32.682061+0000","last_became_active":"2024-04-01T22:33:27.974117+0000","last_became_peered":"2024-04-01T22:33:27.974117+0000","last_unstale":"2024-04-01T23:01:32.682061+0000","last_undegraded":"2024-04-01T23:01:32.682061+0000","last_fullsized":"2024-04-01T23:01:32.682061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:39:28.692092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'133","reported_seq":162,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:59.670790+0000","last_change":"2024-04-01T22:33:32.844681+0000","last_active":"2024-04-01T23:00:59.670790+0000","last_peered":"2024-04-01T23:00:59.670790+0000","last_clean":"2024-04-01T23:00:59.670790+0000","last_became_active":"2024-04-01T22:33:32.844334+0000","last_became_peered":"2024-04-01T22:33:32.844334+0000","last_unstale":"2024-04-01T23:00:59.670790+0000","last_undegraded":"2024-04-01T23:00:59.670790+0000","last_fullsized":"2024-04-01T23:00:59.670790+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:56:30.852155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":7546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'27","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.682016+0000","last_change":"2024-04-01T22:33:27.918822+0000","last_active":"2024-04-01T23:01:32.682016+0000","last_peered":"2024-04-01T23:01:32.682016+0000","last_clean":"2024-04-01T23:01:32.682016+0000","last_became_active":"2024-04-01T22:33:27.918466+0000","last_became_peered":"2024-04-01T22:33:27.918466+0000","last_unstale":"2024-04-01T23:01:32.682016+0000","last_undegraded":"2024-04-01T23:01:32.682016+0000","last_fullsized":"2024-04-01T23:01:32.682016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:43:57.121738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'506","reported_seq":544,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:09.155923+0000","last_change":"2024-04-01T22:33:26.850443+0000","last_active":"2024-04-01T23:01:09.155923+0000","last_peered":"2024-04-01T23:01:09.155923+0000","last_clean":"2024-04-01T23:01:09.155923+0000","last_became_active":"2024-04-01T22:33:26.849954+0000","last_became_peered":"2024-04-01T22:33:26.849954+0000","last_unstale":"2024-04-01T23:01:09.155923+0000","last_undegraded":"2024-04-01T23:01:09.155923+0000","last_fullsized":"2024-04-01T23:01:09.155923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:49:51.408086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":502,"num_write_kb":4355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'101","reported_seq":131,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.525138+0000","last_change":"2024-04-01T22:33:32.853569+0000","last_active":"2024-04-01T23:00:58.525138+0000","last_peered":"2024-04-01T23:00:58.525138+0000","last_clean":"2024-04-01T23:00:58.525138+0000","last_became_active":"2024-04-01T22:33:32.853185+0000","last_became_peered":"2024-04-01T22:33:32.853185+0000","last_unstale":"2024-04-01T23:00:58.525138+0000","last_undegraded":"2024-04-01T23:00:58.525138+0000","last_fullsized":"2024-04-01T23:00:58.525138+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:19:25.147938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":9107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'34","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.707599+0000","last_change":"2024-04-01T22:33:27.949789+0000","last_active":"2024-04-01T23:01:32.707599+0000","last_peered":"2024-04-01T23:01:32.707599+0000","last_clean":"2024-04-01T23:01:32.707599+0000","last_became_active":"2024-04-01T22:33:27.949518+0000","last_became_peered":"2024-04-01T22:33:27.949518+0000","last_unstale":"2024-04-01T23:01:32.707599+0000","last_undegraded":"2024-04-01T23:01:32.707599+0000","last_fullsized":"2024-04-01T23:01:32.707599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:15:08.500466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:19.369124+0000","last_change":"2024-04-01T22:33:26.856856+0000","last_active":"2024-04-01T23:01:19.369124+0000","last_peered":"2024-04-01T23:01:19.369124+0000","last_clean":"2024-04-01T23:01:19.369124+0000","last_became_active":"2024-04-01T22:33:26.856591+0000","last_became_peered":"2024-04-01T22:33:26.856591+0000","last_unstale":"2024-04-01T23:01:19.369124+0000","last_undegraded":"2024-04-01T23:01:19.369124+0000","last_fullsized":"2024-04-01T23:01:19.369124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:38:14.576161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'141","reported_seq":171,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:55.230632+0000","last_change":"2024-04-01T22:33:32.847352+0000","last_active":"2024-04-01T23:00:55.230632+0000","last_peered":"2024-04-01T23:00:55.230632+0000","last_clean":"2024-04-01T23:00:55.230632+0000","last_became_active":"2024-04-01T22:33:32.846849+0000","last_became_peered":"2024-04-01T22:33:32.846849+0000","last_unstale":"2024-04-01T23:00:55.230632+0000","last_undegraded":"2024-04-01T23:00:55.230632+0000","last_fullsized":"2024-04-01T23:00:55.230632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:04:48.921372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":7884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'32","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.711128+0000","last_change":"2024-04-01T22:33:27.855387+0000","last_active":"2024-04-01T23:01:32.711128+0000","last_peered":"2024-04-01T23:01:32.711128+0000","last_clean":"2024-04-01T23:01:32.711128+0000","last_became_active":"2024-04-01T22:33:27.855123+0000","last_became_peered":"2024-04-01T22:33:27.855123+0000","last_unstale":"2024-04-01T23:01:32.711128+0000","last_undegraded":"2024-04-01T23:01:32.711128+0000","last_fullsized":"2024-04-01T23:01:32.711128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:16:58.889368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'1","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:14.096774+0000","last_change":"2024-04-01T22:33:26.848128+0000","last_active":"2024-04-01T23:01:14.096774+0000","last_peered":"2024-04-01T23:01:14.096774+0000","last_clean":"2024-04-01T23:01:14.096774+0000","last_became_active":"2024-04-01T22:33:26.847904+0000","last_became_peered":"2024-04-01T22:33:26.847904+0000","last_unstale":"2024-04-01T23:01:14.096774+0000","last_undegraded":"2024-04-01T23:01:14.096774+0000","last_fullsized":"2024-04-01T23:01:14.096774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:41:58.838710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'122","reported_seq":146,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.936244+0000","last_change":"2024-04-01T22:34:05.290215+0000","last_active":"2024-04-01T23:00:58.936244+0000","last_peered":"2024-04-01T23:00:58.936244+0000","last_clean":"2024-04-01T23:00:58.936244+0000","last_became_active":"2024-04-01T22:34:05.289769+0000","last_became_peered":"2024-04-01T22:34:05.289769+0000","last_unstale":"2024-04-01T23:00:58.936244+0000","last_undegraded":"2024-04-01T23:00:58.936244+0000","last_fullsized":"2024-04-01T23:00:58.936244+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:39:33.591520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":7582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,7],"acting":[2,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"27'32","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.632757+0000","last_change":"2024-04-01T22:33:27.868997+0000","last_active":"2024-04-01T23:01:32.632757+0000","last_peered":"2024-04-01T23:01:32.632757+0000","last_clean":"2024-04-01T23:01:32.632757+0000","last_became_active":"2024-04-01T22:33:27.868713+0000","last_became_peered":"2024-04-01T22:33:27.868713+0000","last_unstale":"2024-04-01T23:01:32.632757+0000","last_undegraded":"2024-04-01T23:01:32.632757+0000","last_fullsized":"2024-04-01T23:01:32.632757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:41:59.967183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'5","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:25.553755+0000","last_change":"2024-04-01T22:33:26.848037+0000","last_active":"2024-04-01T23:01:25.553755+0000","last_peered":"2024-04-01T23:01:25.553755+0000","last_clean":"2024-04-01T23:01:25.553755+0000","last_became_active":"2024-04-01T22:33:26.847736+0000","last_became_peered":"2024-04-01T22:33:26.847736+0000","last_unstale":"2024-04-01T23:01:25.553755+0000","last_undegraded":"2024-04-01T23:01:25.553755+0000","last_fullsized":"2024-04-01T23:01:25.553755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:56:04.675231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'108","reported_seq":138,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.933263+0000","last_change":"2024-04-01T22:33:32.847015+0000","last_active":"2024-04-01T23:00:58.933263+0000","last_peered":"2024-04-01T23:00:58.933263+0000","last_clean":"2024-04-01T23:00:58.933263+0000","last_became_active":"2024-04-01T22:33:32.846639+0000","last_became_peered":"2024-04-01T22:33:32.846639+0000","last_unstale":"2024-04-01T23:00:58.933263+0000","last_undegraded":"2024-04-01T23:00:58.933263+0000","last_fullsized":"2024-04-01T23:00:58.933263+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:47:09.903506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":8005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'39","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.807706+0000","last_change":"2024-04-01T22:33:27.948117+0000","last_active":"2024-04-01T23:01:32.807706+0000","last_peered":"2024-04-01T23:01:32.807706+0000","last_clean":"2024-04-01T23:01:32.807706+0000","last_became_active":"2024-04-01T22:33:27.947735+0000","last_became_peered":"2024-04-01T22:33:27.947735+0000","last_unstale":"2024-04-01T23:01:32.807706+0000","last_undegraded":"2024-04-01T23:01:32.807706+0000","last_fullsized":"2024-04-01T23:01:32.807706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:16:58.889368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'9","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:26.524501+0000","last_change":"2024-04-01T22:33:26.849404+0000","last_active":"2024-04-01T23:01:26.524501+0000","last_peered":"2024-04-01T23:01:26.524501+0000","last_clean":"2024-04-01T23:01:26.524501+0000","last_became_active":"2024-04-01T22:33:26.849086+0000","last_became_peered":"2024-04-01T22:33:26.849086+0000","last_unstale":"2024-04-01T23:01:26.524501+0000","last_undegraded":"2024-04-01T23:01:26.524501+0000","last_fullsized":"2024-04-01T23:01:26.524501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:41:58.838710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'117","reported_seq":148,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.933305+0000","last_change":"2024-04-01T22:33:33.249726+0000","last_active":"2024-04-01T23:00:58.933305+0000","last_peered":"2024-04-01T23:00:58.933305+0000","last_clean":"2024-04-01T23:00:58.933305+0000","last_became_active":"2024-04-01T22:33:33.249309+0000","last_became_peered":"2024-04-01T22:33:33.249309+0000","last_unstale":"2024-04-01T23:00:58.933305+0000","last_undegraded":"2024-04-01T23:00:58.933305+0000","last_fullsized":"2024-04-01T23:00:58.933305+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:08:20.364843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":13518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'31","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.707509+0000","last_change":"2024-04-01T22:33:27.879797+0000","last_active":"2024-04-01T23:01:32.707509+0000","last_peered":"2024-04-01T23:01:32.707509+0000","last_clean":"2024-04-01T23:01:32.707509+0000","last_became_active":"2024-04-01T22:33:27.879582+0000","last_became_peered":"2024-04-01T22:33:27.879582+0000","last_unstale":"2024-04-01T23:01:32.707509+0000","last_undegraded":"2024-04-01T23:01:32.707509+0000","last_fullsized":"2024-04-01T23:01:32.707509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:08:15.465415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'1318","reported_seq":1357,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:29.261176+0000","last_change":"2024-04-01T22:33:26.847504+0000","last_active":"2024-04-01T23:01:29.261176+0000","last_peered":"2024-04-01T23:01:29.261176+0000","last_clean":"2024-04-01T23:01:29.261176+0000","last_became_active":"2024-04-01T22:33:26.847333+0000","last_became_peered":"2024-04-01T22:33:26.847333+0000","last_unstale":"2024-04-01T23:01:29.261176+0000","last_undegraded":"2024-04-01T23:01:29.261176+0000","last_fullsized":"2024-04-01T23:01:29.261176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":1318,"log_dups_size":0,"ondisk_log_size":1318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:39:29.846272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3324,"num_write_kb":1182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'132","reported_seq":164,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.922776+0000","last_change":"2024-04-01T22:33:33.255030+0000","last_active":"2024-04-01T23:00:58.922776+0000","last_peered":"2024-04-01T23:00:58.922776+0000","last_clean":"2024-04-01T23:00:58.922776+0000","last_became_active":"2024-04-01T22:33:33.254621+0000","last_became_peered":"2024-04-01T22:33:33.254621+0000","last_unstale":"2024-04-01T23:00:58.922776+0000","last_undegraded":"2024-04-01T23:00:58.922776+0000","last_fullsized":"2024-04-01T23:00:58.922776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:19:44.325870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":7706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'30","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.628328+0000","last_change":"2024-04-01T22:33:27.855669+0000","last_active":"2024-04-01T23:01:32.628328+0000","last_peered":"2024-04-01T23:01:32.628328+0000","last_clean":"2024-04-01T23:01:32.628328+0000","last_became_active":"2024-04-01T22:33:27.855419+0000","last_became_peered":"2024-04-01T22:33:27.855419+0000","last_unstale":"2024-04-01T23:01:32.628328+0000","last_undegraded":"2024-04-01T23:01:32.628328+0000","last_fullsized":"2024-04-01T23:01:32.628328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:15:46.224658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:20.447485+0000","last_change":"2024-04-01T22:33:26.850176+0000","last_active":"2024-04-01T23:01:20.447485+0000","last_peered":"2024-04-01T23:01:20.447485+0000","last_clean":"2024-04-01T23:01:20.447485+0000","last_became_active":"2024-04-01T22:33:26.849717+0000","last_became_peered":"2024-04-01T22:33:26.849717+0000","last_unstale":"2024-04-01T23:01:20.447485+0000","last_undegraded":"2024-04-01T23:01:20.447485+0000","last_fullsized":"2024-04-01T23:01:20.447485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:18:55.842886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'123","reported_seq":154,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.513385+0000","last_change":"2024-04-01T22:33:33.249765+0000","last_active":"2024-04-01T23:00:58.513385+0000","last_peered":"2024-04-01T23:00:58.513385+0000","last_clean":"2024-04-01T23:00:58.513385+0000","last_became_active":"2024-04-01T22:33:33.249370+0000","last_became_peered":"2024-04-01T22:33:33.249370+0000","last_unstale":"2024-04-01T23:00:58.513385+0000","last_undegraded":"2024-04-01T23:00:58.513385+0000","last_fullsized":"2024-04-01T23:00:58.513385+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:41:50.766262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":9230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'30","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.673401+0000","last_change":"2024-04-01T22:33:27.979163+0000","last_active":"2024-04-01T23:01:32.673401+0000","last_peered":"2024-04-01T23:01:32.673401+0000","last_clean":"2024-04-01T23:01:32.673401+0000","last_became_active":"2024-04-01T22:33:27.978902+0000","last_became_peered":"2024-04-01T22:33:27.978902+0000","last_unstale":"2024-04-01T23:01:32.673401+0000","last_undegraded":"2024-04-01T23:01:32.673401+0000","last_fullsized":"2024-04-01T23:01:32.673401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:04:44.021944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'1","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:32.501046+0000","last_change":"2024-04-01T22:33:26.846575+0000","last_active":"2024-04-01T23:00:32.501046+0000","last_peered":"2024-04-01T23:00:32.501046+0000","last_clean":"2024-04-01T23:00:32.501046+0000","last_became_active":"2024-04-01T22:33:26.846265+0000","last_became_peered":"2024-04-01T22:33:26.846265+0000","last_unstale":"2024-04-01T23:00:32.501046+0000","last_undegraded":"2024-04-01T23:00:32.501046+0000","last_fullsized":"2024-04-01T23:00:32.501046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:56:04.675231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'159","reported_seq":190,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.943492+0000","last_change":"2024-04-01T22:33:32.850553+0000","last_active":"2024-04-01T23:00:58.943492+0000","last_peered":"2024-04-01T23:00:58.943492+0000","last_clean":"2024-04-01T23:00:58.943492+0000","last_became_active":"2024-04-01T22:33:32.849774+0000","last_became_peered":"2024-04-01T22:33:32.849774+0000","last_unstale":"2024-04-01T23:00:58.943492+0000","last_undegraded":"2024-04-01T23:00:58.943492+0000","last_fullsized":"2024-04-01T23:00:58.943492+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:04:48.921372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":7876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'30","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.632532+0000","last_change":"2024-04-01T22:33:27.949879+0000","last_active":"2024-04-01T23:01:32.632532+0000","last_peered":"2024-04-01T23:01:32.632532+0000","last_clean":"2024-04-01T23:01:32.632532+0000","last_became_active":"2024-04-01T22:33:27.949620+0000","last_became_peered":"2024-04-01T22:33:27.949620+0000","last_unstale":"2024-04-01T23:01:32.632532+0000","last_undegraded":"2024-04-01T23:01:32.632532+0000","last_fullsized":"2024-04-01T23:01:32.632532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:49:52.536559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'4","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:14.050511+0000","last_change":"2024-04-01T22:33:26.846346+0000","last_active":"2024-04-01T23:01:14.050511+0000","last_peered":"2024-04-01T23:01:14.050511+0000","last_clean":"2024-04-01T23:01:14.050511+0000","last_became_active":"2024-04-01T22:33:26.846052+0000","last_became_peered":"2024-04-01T22:33:26.846052+0000","last_unstale":"2024-04-01T23:01:14.050511+0000","last_undegraded":"2024-04-01T23:01:14.050511+0000","last_fullsized":"2024-04-01T23:01:14.050511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:41:58.838710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'111","reported_seq":142,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:59.673722+0000","last_change":"2024-04-01T22:33:32.846766+0000","last_active":"2024-04-01T23:00:59.673722+0000","last_peered":"2024-04-01T23:00:59.673722+0000","last_clean":"2024-04-01T23:00:59.673722+0000","last_became_active":"2024-04-01T22:33:32.846422+0000","last_became_peered":"2024-04-01T22:33:32.846422+0000","last_unstale":"2024-04-01T23:00:59.673722+0000","last_undegraded":"2024-04-01T23:00:59.673722+0000","last_fullsized":"2024-04-01T23:00:59.673722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:41:50.766262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":8847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'31","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.628334+0000","last_change":"2024-04-01T22:33:27.855299+0000","last_active":"2024-04-01T23:01:32.628334+0000","last_peered":"2024-04-01T23:01:32.628334+0000","last_clean":"2024-04-01T23:01:32.628334+0000","last_became_active":"2024-04-01T22:33:27.855035+0000","last_became_peered":"2024-04-01T22:33:27.855035+0000","last_unstale":"2024-04-01T23:01:32.628334+0000","last_undegraded":"2024-04-01T23:01:32.628334+0000","last_fullsized":"2024-04-01T23:01:32.628334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:48:53.083180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'821","reported_seq":1676,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:29.533240+0000","last_change":"2024-04-01T22:33:26.856300+0000","last_active":"2024-04-01T23:01:29.533240+0000","last_peered":"2024-04-01T23:01:29.533240+0000","last_clean":"2024-04-01T23:01:29.533240+0000","last_became_active":"2024-04-01T22:33:26.855864+0000","last_became_peered":"2024-04-01T22:33:26.855864+0000","last_unstale":"2024-04-01T23:01:29.533240+0000","last_undegraded":"2024-04-01T23:01:29.533240+0000","last_fullsized":"2024-04-01T23:01:29.533240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":821,"log_dups_size":0,"ondisk_log_size":821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:38:14.576161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188865,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":816,"num_read_kb":876,"num_write":818,"num_write_kb":878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'133","reported_seq":157,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:53.580097+0000","last_change":"2024-04-01T22:34:05.317101+0000","last_active":"2024-04-01T23:00:53.580097+0000","last_peered":"2024-04-01T23:00:53.580097+0000","last_clean":"2024-04-01T23:00:53.580097+0000","last_became_active":"2024-04-01T22:34:05.316665+0000","last_became_peered":"2024-04-01T22:34:05.316665+0000","last_unstale":"2024-04-01T23:00:53.580097+0000","last_undegraded":"2024-04-01T23:00:53.580097+0000","last_fullsized":"2024-04-01T23:00:53.580097+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:47:09.903506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":5930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"27'23","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.807554+0000","last_change":"2024-04-01T22:33:27.949013+0000","last_active":"2024-04-01T23:01:32.807554+0000","last_peered":"2024-04-01T23:01:32.807554+0000","last_clean":"2024-04-01T23:01:32.807554+0000","last_became_active":"2024-04-01T22:33:27.948687+0000","last_became_peered":"2024-04-01T22:33:27.948687+0000","last_unstale":"2024-04-01T23:01:32.807554+0000","last_undegraded":"2024-04-01T23:01:32.807554+0000","last_fullsized":"2024-04-01T23:01:32.807554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:50:54.852207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'280","reported_seq":320,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.906776+0000","last_change":"2024-04-01T22:33:26.848366+0000","last_active":"2024-04-01T23:01:32.906776+0000","last_peered":"2024-04-01T23:01:32.906776+0000","last_clean":"2024-04-01T23:01:32.906776+0000","last_became_active":"2024-04-01T22:33:26.848019+0000","last_became_peered":"2024-04-01T22:33:26.848019+0000","last_unstale":"2024-04-01T23:01:32.906776+0000","last_undegraded":"2024-04-01T23:01:32.906776+0000","last_fullsized":"2024-04-01T23:01:32.906776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:41:58.838710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2901821,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":275,"num_write_kb":2970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'118","reported_seq":148,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:56.100787+0000","last_change":"2024-04-01T22:33:33.253077+0000","last_active":"2024-04-01T23:00:56.100787+0000","last_peered":"2024-04-01T23:00:56.100787+0000","last_clean":"2024-04-01T23:00:56.100787+0000","last_became_active":"2024-04-01T22:33:33.252725+0000","last_became_peered":"2024-04-01T22:33:33.252725+0000","last_unstale":"2024-04-01T23:00:56.100787+0000","last_undegraded":"2024-04-01T23:00:56.100787+0000","last_fullsized":"2024-04-01T23:00:56.100787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:28:17.970808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":6978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'30","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.708903+0000","last_change":"2024-04-01T22:33:27.975039+0000","last_active":"2024-04-01T23:01:32.708903+0000","last_peered":"2024-04-01T23:01:32.708903+0000","last_clean":"2024-04-01T23:01:32.708903+0000","last_became_active":"2024-04-01T22:33:27.974751+0000","last_became_peered":"2024-04-01T22:33:27.974751+0000","last_unstale":"2024-04-01T23:01:32.708903+0000","last_undegraded":"2024-04-01T23:01:32.708903+0000","last_fullsized":"2024-04-01T23:01:32.708903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:43:03.166262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:16.445098+0000","last_change":"2024-04-01T22:33:26.831690+0000","last_active":"2024-04-01T23:01:16.445098+0000","last_peered":"2024-04-01T23:01:16.445098+0000","last_clean":"2024-04-01T23:01:16.445098+0000","last_became_active":"2024-04-01T22:33:26.831398+0000","last_became_peered":"2024-04-01T22:33:26.831398+0000","last_unstale":"2024-04-01T23:01:16.445098+0000","last_undegraded":"2024-04-01T23:01:16.445098+0000","last_fullsized":"2024-04-01T23:01:16.445098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:38:14.576161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":196,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:59:22.388655+0000","last_change":"2024-04-01T22:33:15.962585+0000","last_active":"2024-04-01T22:59:22.388655+0000","last_peered":"2024-04-01T22:59:22.388655+0000","last_clean":"2024-04-01T22:59:22.388655+0000","last_became_active":"2024-04-01T22:33:15.961762+0000","last_became_peered":"2024-04-01T22:33:15.961762+0000","last_unstale":"2024-04-01T22:59:22.388655+0000","last_undegraded":"2024-04-01T22:59:22.388655+0000","last_fullsized":"2024-04-01T22:59:22.388655+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:13.756389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:13.756389+0000","last_clean_scrub_stamp":"2024-04-01T22:33:13.756389+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:33:28.684533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'139","reported_seq":170,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.536776+0000","last_change":"2024-04-01T22:33:33.252863+0000","last_active":"2024-04-01T23:00:58.536776+0000","last_peered":"2024-04-01T23:00:58.536776+0000","last_clean":"2024-04-01T23:00:58.536776+0000","last_became_active":"2024-04-01T22:33:33.252494+0000","last_became_peered":"2024-04-01T22:33:33.252494+0000","last_unstale":"2024-04-01T23:00:58.536776+0000","last_undegraded":"2024-04-01T23:00:58.536776+0000","last_fullsized":"2024-04-01T23:00:58.536776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:47:09.903506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":7634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'31","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.782041+0000","last_change":"2024-04-01T22:34:04.937211+0000","last_active":"2024-04-01T23:01:32.782041+0000","last_peered":"2024-04-01T23:01:32.782041+0000","last_clean":"2024-04-01T23:01:32.782041+0000","last_became_active":"2024-04-01T22:34:04.936886+0000","last_became_peered":"2024-04-01T22:34:04.936886+0000","last_unstale":"2024-04-01T23:01:32.782041+0000","last_undegraded":"2024-04-01T23:01:32.782041+0000","last_fullsized":"2024-04-01T23:01:32.782041+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:53:33.542832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'6","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:22.420377+0000","last_change":"2024-04-01T22:33:26.832331+0000","last_active":"2024-04-01T23:01:22.420377+0000","last_peered":"2024-04-01T23:01:22.420377+0000","last_clean":"2024-04-01T23:01:22.420377+0000","last_became_active":"2024-04-01T22:33:26.832078+0000","last_became_peered":"2024-04-01T22:33:26.832078+0000","last_unstale":"2024-04-01T23:01:22.420377+0000","last_undegraded":"2024-04-01T23:01:22.420377+0000","last_fullsized":"2024-04-01T23:01:22.420377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:40:49.124240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'107","reported_seq":137,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:53.619717+0000","last_change":"2024-04-01T22:33:33.249696+0000","last_active":"2024-04-01T23:00:53.619717+0000","last_peered":"2024-04-01T23:00:53.619717+0000","last_clean":"2024-04-01T23:00:53.619717+0000","last_became_active":"2024-04-01T22:33:33.249313+0000","last_became_peered":"2024-04-01T22:33:33.249313+0000","last_unstale":"2024-04-01T23:00:53.619717+0000","last_undegraded":"2024-04-01T23:00:53.619717+0000","last_fullsized":"2024-04-01T23:00:53.619717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:39:33.591520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":3624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'31","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.640645+0000","last_change":"2024-04-01T22:33:27.971916+0000","last_active":"2024-04-01T23:01:32.640645+0000","last_peered":"2024-04-01T23:01:32.640645+0000","last_clean":"2024-04-01T23:01:32.640645+0000","last_became_active":"2024-04-01T22:33:27.971672+0000","last_became_peered":"2024-04-01T22:33:27.971672+0000","last_unstale":"2024-04-01T23:01:32.640645+0000","last_undegraded":"2024-04-01T23:01:32.640645+0000","last_fullsized":"2024-04-01T23:01:32.640645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:43:39.489075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:27.500628+0000","last_change":"2024-04-01T22:33:26.849350+0000","last_active":"2024-04-01T23:00:27.500628+0000","last_peered":"2024-04-01T23:00:27.500628+0000","last_clean":"2024-04-01T23:00:27.500628+0000","last_became_active":"2024-04-01T22:33:26.849098+0000","last_became_peered":"2024-04-01T22:33:26.849098+0000","last_unstale":"2024-04-01T23:00:27.500628+0000","last_undegraded":"2024-04-01T23:00:27.500628+0000","last_fullsized":"2024-04-01T23:00:27.500628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:47:18.407469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'171","reported_seq":201,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:56.100414+0000","last_change":"2024-04-01T22:33:32.847889+0000","last_active":"2024-04-01T23:00:56.100414+0000","last_peered":"2024-04-01T23:00:56.100414+0000","last_clean":"2024-04-01T23:00:56.100414+0000","last_became_active":"2024-04-01T22:33:32.847546+0000","last_became_peered":"2024-04-01T22:33:32.847546+0000","last_unstale":"2024-04-01T23:00:56.100414+0000","last_undegraded":"2024-04-01T23:00:56.100414+0000","last_fullsized":"2024-04-01T23:00:56.100414+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:57:05.158344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":10714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'32","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.781608+0000","last_change":"2024-04-01T22:33:27.881170+0000","last_active":"2024-04-01T23:01:32.781608+0000","last_peered":"2024-04-01T23:01:32.781608+0000","last_clean":"2024-04-01T23:01:32.781608+0000","last_became_active":"2024-04-01T22:33:27.880870+0000","last_became_peered":"2024-04-01T22:33:27.880870+0000","last_unstale":"2024-04-01T23:01:32.781608+0000","last_undegraded":"2024-04-01T23:01:32.781608+0000","last_fullsized":"2024-04-01T23:01:32.781608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:43:39.489075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'5","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:22.420216+0000","last_change":"2024-04-01T22:33:26.856069+0000","last_active":"2024-04-01T23:01:22.420216+0000","last_peered":"2024-04-01T23:01:22.420216+0000","last_clean":"2024-04-01T23:01:22.420216+0000","last_became_active":"2024-04-01T22:33:26.855705+0000","last_became_peered":"2024-04-01T22:33:26.855705+0000","last_unstale":"2024-04-01T23:01:22.420216+0000","last_undegraded":"2024-04-01T23:01:22.420216+0000","last_fullsized":"2024-04-01T23:01:22.420216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:56:04.675231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'124","reported_seq":154,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.930624+0000","last_change":"2024-04-01T22:33:33.249689+0000","last_active":"2024-04-01T23:00:58.930624+0000","last_peered":"2024-04-01T23:00:58.930624+0000","last_clean":"2024-04-01T23:00:58.930624+0000","last_became_active":"2024-04-01T22:33:33.249315+0000","last_became_peered":"2024-04-01T22:33:33.249315+0000","last_unstale":"2024-04-01T23:00:58.930624+0000","last_undegraded":"2024-04-01T23:00:58.930624+0000","last_fullsized":"2024-04-01T23:00:58.930624+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:19:44.325870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":11773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'20","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.779728+0000","last_change":"2024-04-01T22:33:27.881320+0000","last_active":"2024-04-01T23:01:32.779728+0000","last_peered":"2024-04-01T23:01:32.779728+0000","last_clean":"2024-04-01T23:01:32.779728+0000","last_became_active":"2024-04-01T22:33:27.880973+0000","last_became_peered":"2024-04-01T22:33:27.880973+0000","last_unstale":"2024-04-01T23:01:32.779728+0000","last_undegraded":"2024-04-01T23:01:32.779728+0000","last_fullsized":"2024-04-01T23:01:32.779728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:04:44.021944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:16.450936+0000","last_change":"2024-04-01T22:33:26.845121+0000","last_active":"2024-04-01T23:01:16.450936+0000","last_peered":"2024-04-01T23:01:16.450936+0000","last_clean":"2024-04-01T23:01:16.450936+0000","last_became_active":"2024-04-01T22:33:26.844852+0000","last_became_peered":"2024-04-01T22:33:26.844852+0000","last_unstale":"2024-04-01T23:01:16.450936+0000","last_undegraded":"2024-04-01T23:01:16.450936+0000","last_fullsized":"2024-04-01T23:01:16.450936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:58:40.837557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'146","reported_seq":176,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.525170+0000","last_change":"2024-04-01T22:33:32.846922+0000","last_active":"2024-04-01T23:00:58.525170+0000","last_peered":"2024-04-01T23:00:58.525170+0000","last_clean":"2024-04-01T23:00:58.525170+0000","last_became_active":"2024-04-01T22:33:32.846387+0000","last_became_peered":"2024-04-01T22:33:32.846387+0000","last_unstale":"2024-04-01T23:00:58.525170+0000","last_undegraded":"2024-04-01T23:00:58.525170+0000","last_fullsized":"2024-04-01T23:00:58.525170+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:08:05.436698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":12308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'32","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.775880+0000","last_change":"2024-04-01T22:33:27.884447+0000","last_active":"2024-04-01T23:01:32.775880+0000","last_peered":"2024-04-01T23:01:32.775880+0000","last_clean":"2024-04-01T23:01:32.775880+0000","last_became_active":"2024-04-01T22:33:27.884148+0000","last_became_peered":"2024-04-01T22:33:27.884148+0000","last_unstale":"2024-04-01T23:01:32.775880+0000","last_undegraded":"2024-04-01T23:01:32.775880+0000","last_fullsized":"2024-04-01T23:01:32.775880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:08:00.537270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'16","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:27.271938+0000","last_change":"2024-04-01T22:33:26.844884+0000","last_active":"2024-04-01T23:01:27.271938+0000","last_peered":"2024-04-01T23:01:27.271938+0000","last_clean":"2024-04-01T23:01:27.271938+0000","last_became_active":"2024-04-01T22:33:26.844583+0000","last_became_peered":"2024-04-01T22:33:26.844583+0000","last_unstale":"2024-04-01T23:01:27.271938+0000","last_undegraded":"2024-04-01T23:01:27.271938+0000","last_fullsized":"2024-04-01T23:01:27.271938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:25:41.744696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'120","reported_seq":149,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.510554+0000","last_change":"2024-04-01T22:33:32.845036+0000","last_active":"2024-04-01T23:00:58.510554+0000","last_peered":"2024-04-01T23:00:58.510554+0000","last_clean":"2024-04-01T23:00:58.510554+0000","last_became_active":"2024-04-01T22:33:32.844555+0000","last_became_peered":"2024-04-01T22:33:32.844555+0000","last_unstale":"2024-04-01T23:00:58.510554+0000","last_undegraded":"2024-04-01T23:00:58.510554+0000","last_fullsized":"2024-04-01T23:00:58.510554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:43:44.388503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":6363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'25","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.635084+0000","last_change":"2024-04-01T22:33:27.950227+0000","last_active":"2024-04-01T23:01:32.635084+0000","last_peered":"2024-04-01T23:01:32.635084+0000","last_clean":"2024-04-01T23:01:32.635084+0000","last_became_active":"2024-04-01T22:33:27.949366+0000","last_became_peered":"2024-04-01T22:33:27.949366+0000","last_unstale":"2024-04-01T23:01:32.635084+0000","last_undegraded":"2024-04-01T23:01:32.635084+0000","last_fullsized":"2024-04-01T23:01:32.635084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:16:58.889368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'3","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:16.386180+0000","last_change":"2024-04-01T22:33:26.830463+0000","last_active":"2024-04-01T23:01:16.386180+0000","last_peered":"2024-04-01T23:01:16.386180+0000","last_clean":"2024-04-01T23:01:16.386180+0000","last_became_active":"2024-04-01T22:33:26.830179+0000","last_became_peered":"2024-04-01T22:33:26.830179+0000","last_unstale":"2024-04-01T23:01:16.386180+0000","last_undegraded":"2024-04-01T23:01:16.386180+0000","last_fullsized":"2024-04-01T23:01:16.386180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:38:14.576161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'118","reported_seq":147,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:55.150889+0000","last_change":"2024-04-01T22:33:33.252812+0000","last_active":"2024-04-01T23:00:55.150889+0000","last_peered":"2024-04-01T23:00:55.150889+0000","last_clean":"2024-04-01T23:00:55.150889+0000","last_became_active":"2024-04-01T22:33:33.252412+0000","last_became_peered":"2024-04-01T22:33:33.252412+0000","last_unstale":"2024-04-01T23:00:55.150889+0000","last_undegraded":"2024-04-01T23:00:55.150889+0000","last_fullsized":"2024-04-01T23:00:55.150889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:53:38.442260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":10338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'44","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.782716+0000","last_change":"2024-04-01T22:33:27.880363+0000","last_active":"2024-04-01T23:01:32.782716+0000","last_peered":"2024-04-01T23:01:32.782716+0000","last_clean":"2024-04-01T23:01:32.782716+0000","last_became_active":"2024-04-01T22:33:27.880096+0000","last_became_peered":"2024-04-01T22:33:27.880096+0000","last_unstale":"2024-04-01T23:01:32.782716+0000","last_undegraded":"2024-04-01T23:01:32.782716+0000","last_fullsized":"2024-04-01T23:01:32.782716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:19:20.248510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'6","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:25.556353+0000","last_change":"2024-04-01T22:33:26.855823+0000","last_active":"2024-04-01T23:01:25.556353+0000","last_peered":"2024-04-01T23:01:25.556353+0000","last_clean":"2024-04-01T23:01:25.556353+0000","last_became_active":"2024-04-01T22:33:26.855475+0000","last_became_peered":"2024-04-01T22:33:26.855475+0000","last_unstale":"2024-04-01T23:01:25.556353+0000","last_undegraded":"2024-04-01T23:01:25.556353+0000","last_fullsized":"2024-04-01T23:01:25.556353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:39:29.846272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'90","reported_seq":120,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:00.654216+0000","last_change":"2024-04-01T22:33:33.249941+0000","last_active":"2024-04-01T23:01:00.654216+0000","last_peered":"2024-04-01T23:01:00.654216+0000","last_clean":"2024-04-01T23:01:00.654216+0000","last_became_active":"2024-04-01T22:33:33.249352+0000","last_became_peered":"2024-04-01T22:33:33.249352+0000","last_unstale":"2024-04-01T23:01:00.654216+0000","last_undegraded":"2024-04-01T23:01:00.654216+0000","last_fullsized":"2024-04-01T23:01:00.654216+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:36:10.226231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":8688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'34","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.805613+0000","last_change":"2024-04-01T22:33:27.948988+0000","last_active":"2024-04-01T23:01:32.805613+0000","last_peered":"2024-04-01T23:01:32.805613+0000","last_clean":"2024-04-01T23:01:32.805613+0000","last_became_active":"2024-04-01T22:33:27.948691+0000","last_became_peered":"2024-04-01T22:33:27.948691+0000","last_unstale":"2024-04-01T23:01:32.805613+0000","last_undegraded":"2024-04-01T23:01:32.805613+0000","last_fullsized":"2024-04-01T23:01:32.805613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:23:08.563134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'9","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:20.451103+0000","last_change":"2024-04-01T22:33:26.849911+0000","last_active":"2024-04-01T23:01:20.451103+0000","last_peered":"2024-04-01T23:01:20.451103+0000","last_clean":"2024-04-01T23:01:20.451103+0000","last_became_active":"2024-04-01T22:33:26.849646+0000","last_became_peered":"2024-04-01T22:33:26.849646+0000","last_unstale":"2024-04-01T23:01:20.451103+0000","last_undegraded":"2024-04-01T23:01:20.451103+0000","last_fullsized":"2024-04-01T23:01:20.451103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:29:59.992702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'119","reported_seq":148,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:00.657163+0000","last_change":"2024-04-01T22:33:33.250214+0000","last_active":"2024-04-01T23:01:00.657163+0000","last_peered":"2024-04-01T23:01:00.657163+0000","last_clean":"2024-04-01T23:01:00.657163+0000","last_became_active":"2024-04-01T22:33:33.249853+0000","last_became_peered":"2024-04-01T22:33:33.249853+0000","last_unstale":"2024-04-01T23:01:00.657163+0000","last_undegraded":"2024-04-01T23:01:00.657163+0000","last_fullsized":"2024-04-01T23:01:00.657163+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:57:12.343606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":9692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'28","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.618088+0000","last_change":"2024-04-01T22:34:04.898357+0000","last_active":"2024-04-01T23:01:32.618088+0000","last_peered":"2024-04-01T23:01:32.618088+0000","last_clean":"2024-04-01T23:01:32.618088+0000","last_became_active":"2024-04-01T22:34:04.898014+0000","last_became_peered":"2024-04-01T22:34:04.898014+0000","last_unstale":"2024-04-01T23:01:32.618088+0000","last_undegraded":"2024-04-01T23:01:32.618088+0000","last_fullsized":"2024-04-01T23:01:32.618088+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:56:25.952727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.14","version":"27'845","reported_seq":883,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:27.449649+0000","last_change":"2024-04-01T22:33:26.855687+0000","last_active":"2024-04-01T23:01:27.449649+0000","last_peered":"2024-04-01T23:01:27.449649+0000","last_clean":"2024-04-01T23:01:27.449649+0000","last_became_active":"2024-04-01T22:33:26.855400+0000","last_became_peered":"2024-04-01T22:33:26.855400+0000","last_unstale":"2024-04-01T23:01:27.449649+0000","last_undegraded":"2024-04-01T23:01:27.449649+0000","last_fullsized":"2024-04-01T23:01:27.449649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:39:29.846272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":842,"num_write_kb":4541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'128","reported_seq":158,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:59.671035+0000","last_change":"2024-04-01T22:33:32.846727+0000","last_active":"2024-04-01T23:00:59.671035+0000","last_peered":"2024-04-01T23:00:59.671035+0000","last_clean":"2024-04-01T23:00:59.671035+0000","last_became_active":"2024-04-01T22:33:32.846156+0000","last_became_peered":"2024-04-01T22:33:32.846156+0000","last_unstale":"2024-04-01T23:00:59.671035+0000","last_undegraded":"2024-04-01T23:00:59.671035+0000","last_fullsized":"2024-04-01T23:00:59.671035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:57:05.158344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":9107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'28","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.637662+0000","last_change":"2024-04-01T22:33:27.879445+0000","last_active":"2024-04-01T23:01:32.637662+0000","last_peered":"2024-04-01T23:01:32.637662+0000","last_clean":"2024-04-01T23:01:32.637662+0000","last_became_active":"2024-04-01T22:33:27.879165+0000","last_became_peered":"2024-04-01T22:33:27.879165+0000","last_unstale":"2024-04-01T23:01:32.637662+0000","last_undegraded":"2024-04-01T23:01:32.637662+0000","last_fullsized":"2024-04-01T23:01:32.637662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:18:56.971360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'573","reported_seq":610,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:26.527933+0000","last_change":"2024-04-01T22:33:26.851767+0000","last_active":"2024-04-01T23:01:26.527933+0000","last_peered":"2024-04-01T23:01:26.527933+0000","last_clean":"2024-04-01T23:01:26.527933+0000","last_became_active":"2024-04-01T22:33:26.851489+0000","last_became_peered":"2024-04-01T22:33:26.851489+0000","last_unstale":"2024-04-01T23:01:26.527933+0000","last_undegraded":"2024-04-01T23:01:26.527933+0000","last_fullsized":"2024-04-01T23:01:26.527933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":573,"log_dups_size":0,"ondisk_log_size":573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:49:51.408086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":569,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'166","reported_seq":196,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:00.657960+0000","last_change":"2024-04-01T22:33:32.846386+0000","last_active":"2024-04-01T23:01:00.657960+0000","last_peered":"2024-04-01T23:01:00.657960+0000","last_clean":"2024-04-01T23:01:00.657960+0000","last_became_active":"2024-04-01T22:33:32.846024+0000","last_became_peered":"2024-04-01T22:33:32.846024+0000","last_unstale":"2024-04-01T23:01:00.657960+0000","last_undegraded":"2024-04-01T23:01:00.657960+0000","last_fullsized":"2024-04-01T23:01:00.657960+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:39:33.591520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":22198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'35","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.807582+0000","last_change":"2024-04-01T22:33:27.974120+0000","last_active":"2024-04-01T23:01:32.807582+0000","last_peered":"2024-04-01T23:01:32.807582+0000","last_clean":"2024-04-01T23:01:32.807582+0000","last_became_active":"2024-04-01T22:33:27.973846+0000","last_became_peered":"2024-04-01T22:33:27.973846+0000","last_unstale":"2024-04-01T23:01:32.807582+0000","last_undegraded":"2024-04-01T23:01:32.807582+0000","last_fullsized":"2024-04-01T23:01:32.807582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:15:46.224658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'8","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:22.423540+0000","last_change":"2024-04-01T22:33:26.831927+0000","last_active":"2024-04-01T23:01:22.423540+0000","last_peered":"2024-04-01T23:01:22.423540+0000","last_clean":"2024-04-01T23:01:22.423540+0000","last_became_active":"2024-04-01T22:33:26.831676+0000","last_became_peered":"2024-04-01T22:33:26.831676+0000","last_unstale":"2024-04-01T23:01:22.423540+0000","last_undegraded":"2024-04-01T23:01:22.423540+0000","last_fullsized":"2024-04-01T23:01:22.423540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:40:49.124240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'96","reported_seq":126,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.522528+0000","last_change":"2024-04-01T22:33:32.849983+0000","last_active":"2024-04-01T23:00:58.522528+0000","last_peered":"2024-04-01T23:00:58.522528+0000","last_clean":"2024-04-01T23:00:58.522528+0000","last_became_active":"2024-04-01T22:33:32.849661+0000","last_became_peered":"2024-04-01T22:33:32.849661+0000","last_unstale":"2024-04-01T23:00:58.522528+0000","last_undegraded":"2024-04-01T23:00:58.522528+0000","last_fullsized":"2024-04-01T23:00:58.522528+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:41:40.370250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":9067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'37","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.685525+0000","last_change":"2024-04-01T22:33:27.972417+0000","last_active":"2024-04-01T23:01:32.685525+0000","last_peered":"2024-04-01T23:01:32.685525+0000","last_clean":"2024-04-01T23:01:32.685525+0000","last_became_active":"2024-04-01T22:33:27.972173+0000","last_became_peered":"2024-04-01T22:33:27.972173+0000","last_unstale":"2024-04-01T23:01:32.685525+0000","last_undegraded":"2024-04-01T23:01:32.685525+0000","last_fullsized":"2024-04-01T23:01:32.685525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:47:05.004078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:02.441408+0000","last_change":"2024-04-01T22:33:26.831934+0000","last_active":"2024-04-01T23:00:02.441408+0000","last_peered":"2024-04-01T23:00:02.441408+0000","last_clean":"2024-04-01T23:00:02.441408+0000","last_became_active":"2024-04-01T22:33:26.831702+0000","last_became_peered":"2024-04-01T22:33:26.831702+0000","last_unstale":"2024-04-01T23:00:02.441408+0000","last_undegraded":"2024-04-01T23:00:02.441408+0000","last_fullsized":"2024-04-01T23:00:02.441408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:56:04.675231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'144","reported_seq":174,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:00.655446+0000","last_change":"2024-04-01T22:33:33.254394+0000","last_active":"2024-04-01T23:01:00.655446+0000","last_peered":"2024-04-01T23:01:00.655446+0000","last_clean":"2024-04-01T23:01:00.655446+0000","last_became_active":"2024-04-01T22:33:33.253993+0000","last_became_peered":"2024-04-01T22:33:33.253993+0000","last_unstale":"2024-04-01T23:01:00.655446+0000","last_undegraded":"2024-04-01T23:01:00.655446+0000","last_fullsized":"2024-04-01T23:01:00.655446+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:11:05.243371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":10480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'142","reported_seq":174,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:56.101446+0000","last_change":"2024-04-01T22:33:33.253062+0000","last_active":"2024-04-01T23:00:56.101446+0000","last_peered":"2024-04-01T23:00:56.101446+0000","last_clean":"2024-04-01T23:00:56.101446+0000","last_became_active":"2024-04-01T22:33:33.252690+0000","last_became_peered":"2024-04-01T22:33:33.252690+0000","last_unstale":"2024-04-01T23:00:56.101446+0000","last_undegraded":"2024-04-01T23:00:56.101446+0000","last_fullsized":"2024-04-01T23:00:56.101446+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:04:48.921372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":7949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'40","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.629951+0000","last_change":"2024-04-01T22:33:27.855871+0000","last_active":"2024-04-01T23:01:32.629951+0000","last_peered":"2024-04-01T23:01:32.629951+0000","last_clean":"2024-04-01T23:01:32.629951+0000","last_became_active":"2024-04-01T22:33:27.855609+0000","last_became_peered":"2024-04-01T22:33:27.855609+0000","last_unstale":"2024-04-01T23:01:32.629951+0000","last_undegraded":"2024-04-01T23:01:32.629951+0000","last_fullsized":"2024-04-01T23:01:32.629951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:43:03.166262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:09.911428+0000","last_change":"2024-04-01T22:33:26.831819+0000","last_active":"2024-04-01T23:00:09.911428+0000","last_peered":"2024-04-01T23:00:09.911428+0000","last_clean":"2024-04-01T23:00:09.911428+0000","last_became_active":"2024-04-01T22:33:26.831554+0000","last_became_peered":"2024-04-01T22:33:26.831554+0000","last_unstale":"2024-04-01T23:00:09.911428+0000","last_undegraded":"2024-04-01T23:00:09.911428+0000","last_fullsized":"2024-04-01T23:00:09.911428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:56:04.675231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'135","reported_seq":166,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:56.419481+0000","last_change":"2024-04-01T22:33:32.849917+0000","last_active":"2024-04-01T23:00:56.419481+0000","last_peered":"2024-04-01T23:00:56.419481+0000","last_clean":"2024-04-01T23:00:56.419481+0000","last_became_active":"2024-04-01T22:33:32.849536+0000","last_became_peered":"2024-04-01T22:33:32.849536+0000","last_unstale":"2024-04-01T23:00:56.419481+0000","last_undegraded":"2024-04-01T23:00:56.419481+0000","last_fullsized":"2024-04-01T23:00:56.419481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:41:50.766262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":12020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'41","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.710686+0000","last_change":"2024-04-01T22:33:27.950424+0000","last_active":"2024-04-01T23:01:32.710686+0000","last_peered":"2024-04-01T23:01:32.710686+0000","last_clean":"2024-04-01T23:01:32.710686+0000","last_became_active":"2024-04-01T22:33:27.950148+0000","last_became_peered":"2024-04-01T22:33:27.950148+0000","last_unstale":"2024-04-01T23:01:32.710686+0000","last_undegraded":"2024-04-01T23:01:32.710686+0000","last_fullsized":"2024-04-01T23:01:32.710686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:50:04.913482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'1","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:07.398877+0000","last_change":"2024-04-01T22:33:26.855715+0000","last_active":"2024-04-01T23:00:07.398877+0000","last_peered":"2024-04-01T23:00:07.398877+0000","last_clean":"2024-04-01T23:00:07.398877+0000","last_became_active":"2024-04-01T22:33:26.855136+0000","last_became_peered":"2024-04-01T22:33:26.855136+0000","last_unstale":"2024-04-01T23:00:07.398877+0000","last_undegraded":"2024-04-01T23:00:07.398877+0000","last_fullsized":"2024-04-01T23:00:07.398877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:19:52.712250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'613","reported_seq":650,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:14.104867+0000","last_change":"2024-04-01T22:33:26.830837+0000","last_active":"2024-04-01T23:01:14.104867+0000","last_peered":"2024-04-01T23:01:14.104867+0000","last_clean":"2024-04-01T23:01:14.104867+0000","last_became_active":"2024-04-01T22:33:26.830563+0000","last_became_peered":"2024-04-01T22:33:26.830563+0000","last_unstale":"2024-04-01T23:01:14.104867+0000","last_undegraded":"2024-04-01T23:01:14.104867+0000","last_fullsized":"2024-04-01T23:01:14.104867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:40:49.124240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":609,"num_write_kb":4438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'35","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.807951+0000","last_change":"2024-04-01T22:33:27.951393+0000","last_active":"2024-04-01T23:01:32.807951+0000","last_peered":"2024-04-01T23:01:32.807951+0000","last_clean":"2024-04-01T23:01:32.807951+0000","last_became_active":"2024-04-01T22:33:27.951103+0000","last_became_peered":"2024-04-01T22:33:27.951103+0000","last_unstale":"2024-04-01T23:01:32.807951+0000","last_undegraded":"2024-04-01T23:01:32.807951+0000","last_fullsized":"2024-04-01T23:01:32.807951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:43:57.121738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'96","reported_seq":125,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:51.560205+0000","last_change":"2024-04-01T22:33:32.846734+0000","last_active":"2024-04-01T23:00:51.560205+0000","last_peered":"2024-04-01T23:00:51.560205+0000","last_clean":"2024-04-01T23:00:51.560205+0000","last_became_active":"2024-04-01T22:33:32.846376+0000","last_became_peered":"2024-04-01T22:33:32.846376+0000","last_unstale":"2024-04-01T23:00:51.560205+0000","last_undegraded":"2024-04-01T23:00:51.560205+0000","last_fullsized":"2024-04-01T23:00:51.560205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:50:41.471405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":4400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'650","reported_seq":687,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:20.438640+0000","last_change":"2024-04-01T22:33:26.855529+0000","last_active":"2024-04-01T23:01:20.438640+0000","last_peered":"2024-04-01T23:01:20.438640+0000","last_clean":"2024-04-01T23:01:20.438640+0000","last_became_active":"2024-04-01T22:33:26.855101+0000","last_became_peered":"2024-04-01T22:33:26.855101+0000","last_unstale":"2024-04-01T23:01:20.438640+0000","last_undegraded":"2024-04-01T23:01:20.438640+0000","last_fullsized":"2024-04-01T23:01:20.438640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:40:49.124240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":645,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'30","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.633452+0000","last_change":"2024-04-01T22:33:27.868702+0000","last_active":"2024-04-01T23:01:32.633452+0000","last_peered":"2024-04-01T23:01:32.633452+0000","last_clean":"2024-04-01T23:01:32.633452+0000","last_became_active":"2024-04-01T22:33:27.868297+0000","last_became_peered":"2024-04-01T22:33:27.868297+0000","last_unstale":"2024-04-01T23:01:32.633452+0000","last_undegraded":"2024-04-01T23:01:32.633452+0000","last_fullsized":"2024-04-01T23:01:32.633452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:39:30.974746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'127","reported_seq":163,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.922474+0000","last_change":"2024-04-01T22:34:05.319978+0000","last_active":"2024-04-01T23:00:58.922474+0000","last_peered":"2024-04-01T23:00:58.922474+0000","last_clean":"2024-04-01T23:00:58.922474+0000","last_became_active":"2024-04-01T22:34:05.319550+0000","last_became_peered":"2024-04-01T22:34:05.319550+0000","last_unstale":"2024-04-01T23:00:58.922474+0000","last_undegraded":"2024-04-01T23:00:58.922474+0000","last_fullsized":"2024-04-01T23:00:58.922474+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:34:03.139988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":7877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'45","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.672541+0000","last_change":"2024-04-01T22:33:27.950106+0000","last_active":"2024-04-01T23:01:32.672541+0000","last_peered":"2024-04-01T23:01:32.672541+0000","last_clean":"2024-04-01T23:01:32.672541+0000","last_became_active":"2024-04-01T22:33:27.949843+0000","last_became_peered":"2024-04-01T22:33:27.949843+0000","last_unstale":"2024-04-01T23:01:32.672541+0000","last_undegraded":"2024-04-01T23:01:32.672541+0000","last_fullsized":"2024-04-01T23:01:32.672541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:23:08.563134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'43","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.628992+0000","last_change":"2024-04-01T22:33:27.974409+0000","last_active":"2024-04-01T23:01:32.628992+0000","last_peered":"2024-04-01T23:01:32.628992+0000","last_clean":"2024-04-01T23:01:32.628992+0000","last_became_active":"2024-04-01T22:33:27.974128+0000","last_became_peered":"2024-04-01T22:33:27.974128+0000","last_unstale":"2024-04-01T23:01:32.628992+0000","last_undegraded":"2024-04-01T23:01:32.628992+0000","last_fullsized":"2024-04-01T23:01:32.628992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:49:52.536559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'42","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.640581+0000","last_change":"2024-04-01T22:33:27.974885+0000","last_active":"2024-04-01T23:01:32.640581+0000","last_peered":"2024-04-01T23:01:32.640581+0000","last_clean":"2024-04-01T23:01:32.640581+0000","last_became_active":"2024-04-01T22:33:27.973988+0000","last_became_peered":"2024-04-01T22:33:27.973988+0000","last_unstale":"2024-04-01T23:01:32.640581+0000","last_undegraded":"2024-04-01T23:01:32.640581+0000","last_fullsized":"2024-04-01T23:01:32.640581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:56:25.952727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'29","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.806818+0000","last_change":"2024-04-01T22:33:27.950817+0000","last_active":"2024-04-01T23:01:32.806818+0000","last_peered":"2024-04-01T23:01:32.806818+0000","last_clean":"2024-04-01T23:01:32.806818+0000","last_became_active":"2024-04-01T22:33:27.950515+0000","last_became_peered":"2024-04-01T22:33:27.950515+0000","last_unstale":"2024-04-01T23:01:32.806818+0000","last_undegraded":"2024-04-01T23:01:32.806818+0000","last_fullsized":"2024-04-01T23:01:32.806818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:48:53.083180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'25","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.709118+0000","last_change":"2024-04-01T22:33:27.869385+0000","last_active":"2024-04-01T23:01:32.709118+0000","last_peered":"2024-04-01T23:01:32.709118+0000","last_clean":"2024-04-01T23:01:32.709118+0000","last_became_active":"2024-04-01T22:33:27.869102+0000","last_became_peered":"2024-04-01T22:33:27.869102+0000","last_unstale":"2024-04-01T23:01:32.709118+0000","last_undegraded":"2024-04-01T23:01:32.709118+0000","last_fullsized":"2024-04-01T23:01:32.709118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:43:57.121738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'26","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.629389+0000","last_change":"2024-04-01T22:33:27.856463+0000","last_active":"2024-04-01T23:01:32.629389+0000","last_peered":"2024-04-01T23:01:32.629389+0000","last_clean":"2024-04-01T23:01:32.629389+0000","last_became_active":"2024-04-01T22:33:27.856213+0000","last_became_peered":"2024-04-01T22:33:27.856213+0000","last_unstale":"2024-04-01T23:01:32.629389+0000","last_undegraded":"2024-04-01T23:01:32.629389+0000","last_fullsized":"2024-04-01T23:01:32.629389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:43:57.121738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'41","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.676975+0000","last_change":"2024-04-01T22:33:27.921487+0000","last_active":"2024-04-01T23:01:32.676975+0000","last_peered":"2024-04-01T23:01:32.676975+0000","last_clean":"2024-04-01T23:01:32.676975+0000","last_became_active":"2024-04-01T22:33:27.921229+0000","last_became_peered":"2024-04-01T22:33:27.921229+0000","last_unstale":"2024-04-01T23:01:32.676975+0000","last_undegraded":"2024-04-01T23:01:32.676975+0000","last_fullsized":"2024-04-01T23:01:32.676975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:43:03.166262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'30","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.708707+0000","last_change":"2024-04-01T22:33:27.868732+0000","last_active":"2024-04-01T23:01:32.708707+0000","last_peered":"2024-04-01T23:01:32.708707+0000","last_clean":"2024-04-01T23:01:32.708707+0000","last_became_active":"2024-04-01T22:33:27.868496+0000","last_became_peered":"2024-04-01T22:33:27.868496+0000","last_unstale":"2024-04-01T23:01:32.708707+0000","last_undegraded":"2024-04-01T23:01:32.708707+0000","last_fullsized":"2024-04-01T23:01:32.708707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:56:25.952727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'30","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.671962+0000","last_change":"2024-04-01T22:33:27.974270+0000","last_active":"2024-04-01T23:01:32.671962+0000","last_peered":"2024-04-01T23:01:32.671962+0000","last_clean":"2024-04-01T23:01:32.671962+0000","last_became_active":"2024-04-01T22:33:27.973851+0000","last_became_peered":"2024-04-01T22:33:27.973851+0000","last_unstale":"2024-04-01T23:01:32.671962+0000","last_undegraded":"2024-04-01T23:01:32.671962+0000","last_fullsized":"2024-04-01T23:01:32.671962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:43:57.121738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'42","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.624517+0000","last_change":"2024-04-01T22:34:05.290057+0000","last_active":"2024-04-01T23:01:32.624517+0000","last_peered":"2024-04-01T23:01:32.624517+0000","last_clean":"2024-04-01T23:01:32.624517+0000","last_became_active":"2024-04-01T22:34:05.289755+0000","last_became_peered":"2024-04-01T22:34:05.289755+0000","last_unstale":"2024-04-01T23:01:32.624517+0000","last_undegraded":"2024-04-01T23:01:32.624517+0000","last_fullsized":"2024-04-01T23:01:32.624517+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:19:20.248510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"27'35","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.682011+0000","last_change":"2024-04-01T22:33:27.979380+0000","last_active":"2024-04-01T23:01:32.682011+0000","last_peered":"2024-04-01T23:01:32.682011+0000","last_clean":"2024-04-01T23:01:32.682011+0000","last_became_active":"2024-04-01T22:33:27.979108+0000","last_became_peered":"2024-04-01T22:33:27.979108+0000","last_unstale":"2024-04-01T23:01:32.682011+0000","last_undegraded":"2024-04-01T23:01:32.682011+0000","last_fullsized":"2024-04-01T23:01:32.682011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:50:04.913482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'48","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.808007+0000","last_change":"2024-04-01T22:33:27.953950+0000","last_active":"2024-04-01T23:01:32.808007+0000","last_peered":"2024-04-01T23:01:32.808007+0000","last_clean":"2024-04-01T23:01:32.808007+0000","last_became_active":"2024-04-01T22:33:27.953674+0000","last_became_peered":"2024-04-01T22:33:27.953674+0000","last_unstale":"2024-04-01T23:01:32.808007+0000","last_undegraded":"2024-04-01T23:01:32.808007+0000","last_fullsized":"2024-04-01T23:01:32.808007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:01:14.826403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'37","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.672896+0000","last_change":"2024-04-01T22:33:27.919041+0000","last_active":"2024-04-01T23:01:32.672896+0000","last_peered":"2024-04-01T23:01:32.672896+0000","last_clean":"2024-04-01T23:01:32.672896+0000","last_became_active":"2024-04-01T22:33:27.918815+0000","last_became_peered":"2024-04-01T22:33:27.918815+0000","last_unstale":"2024-04-01T23:01:32.672896+0000","last_undegraded":"2024-04-01T23:01:32.672896+0000","last_fullsized":"2024-04-01T23:01:32.672896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:15:08.500466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'34","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.703645+0000","last_change":"2024-04-01T22:33:27.881613+0000","last_active":"2024-04-01T23:01:32.703645+0000","last_peered":"2024-04-01T23:01:32.703645+0000","last_clean":"2024-04-01T23:01:32.703645+0000","last_became_active":"2024-04-01T22:33:27.881372+0000","last_became_peered":"2024-04-01T22:33:27.881372+0000","last_unstale":"2024-04-01T23:01:32.703645+0000","last_undegraded":"2024-04-01T23:01:32.703645+0000","last_fullsized":"2024-04-01T23:01:32.703645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:28:13.071380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"27'43","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.628635+0000","last_change":"2024-04-01T22:33:27.919025+0000","last_active":"2024-04-01T23:01:32.628635+0000","last_peered":"2024-04-01T23:01:32.628635+0000","last_clean":"2024-04-01T23:01:32.628635+0000","last_became_active":"2024-04-01T22:33:27.918749+0000","last_became_peered":"2024-04-01T22:33:27.918749+0000","last_unstale":"2024-04-01T23:01:32.628635+0000","last_undegraded":"2024-04-01T23:01:32.628635+0000","last_fullsized":"2024-04-01T23:01:32.628635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:47:19.535942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'36","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.649018+0000","last_change":"2024-04-01T22:33:27.979289+0000","last_active":"2024-04-01T23:01:32.649018+0000","last_peered":"2024-04-01T23:01:32.649018+0000","last_clean":"2024-04-01T23:01:32.649018+0000","last_became_active":"2024-04-01T22:33:27.979036+0000","last_became_peered":"2024-04-01T22:33:27.979036+0000","last_unstale":"2024-04-01T23:01:32.649018+0000","last_undegraded":"2024-04-01T23:01:32.649018+0000","last_fullsized":"2024-04-01T23:01:32.649018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:19:20.248510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"27'35","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.674355+0000","last_change":"2024-04-01T22:33:27.974214+0000","last_active":"2024-04-01T23:01:32.674355+0000","last_peered":"2024-04-01T23:01:32.674355+0000","last_clean":"2024-04-01T23:01:32.674355+0000","last_became_active":"2024-04-01T22:33:27.973962+0000","last_became_peered":"2024-04-01T22:33:27.973962+0000","last_unstale":"2024-04-01T23:01:32.674355+0000","last_undegraded":"2024-04-01T23:01:32.674355+0000","last_fullsized":"2024-04-01T23:01:32.674355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:15:08.500466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"27'37","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.628813+0000","last_change":"2024-04-01T22:33:27.869600+0000","last_active":"2024-04-01T23:01:32.628813+0000","last_peered":"2024-04-01T23:01:32.628813+0000","last_clean":"2024-04-01T23:01:32.628813+0000","last_became_active":"2024-04-01T22:33:27.869279+0000","last_became_peered":"2024-04-01T22:33:27.869279+0000","last_unstale":"2024-04-01T23:01:32.628813+0000","last_undegraded":"2024-04-01T23:01:32.628813+0000","last_fullsized":"2024-04-01T23:01:32.628813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:16:58.889368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'36","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.806471+0000","last_change":"2024-04-01T22:33:27.948313+0000","last_active":"2024-04-01T23:01:32.806471+0000","last_peered":"2024-04-01T23:01:32.806471+0000","last_clean":"2024-04-01T23:01:32.806471+0000","last_became_active":"2024-04-01T22:33:27.947834+0000","last_became_peered":"2024-04-01T22:33:27.947834+0000","last_unstale":"2024-04-01T23:01:32.806471+0000","last_undegraded":"2024-04-01T23:01:32.806471+0000","last_fullsized":"2024-04-01T23:01:32.806471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:50:36.571977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'35","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.708867+0000","last_change":"2024-04-01T22:33:27.915571+0000","last_active":"2024-04-01T23:01:32.708867+0000","last_peered":"2024-04-01T23:01:32.708867+0000","last_clean":"2024-04-01T23:01:32.708867+0000","last_became_active":"2024-04-01T22:33:27.915372+0000","last_became_peered":"2024-04-01T22:33:27.915372+0000","last_unstale":"2024-04-01T23:01:32.708867+0000","last_undegraded":"2024-04-01T23:01:32.708867+0000","last_fullsized":"2024-04-01T23:01:32.708867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:15:46.224658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'26","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.635273+0000","last_change":"2024-04-01T22:33:27.915752+0000","last_active":"2024-04-01T23:01:32.635273+0000","last_peered":"2024-04-01T23:01:32.635273+0000","last_clean":"2024-04-01T23:01:32.635273+0000","last_became_active":"2024-04-01T22:33:27.915515+0000","last_became_peered":"2024-04-01T22:33:27.915515+0000","last_unstale":"2024-04-01T23:01:32.635273+0000","last_undegraded":"2024-04-01T23:01:32.635273+0000","last_fullsized":"2024-04-01T23:01:32.635273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:47:19.535942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'29","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.649629+0000","last_change":"2024-04-01T22:33:27.974798+0000","last_active":"2024-04-01T23:01:32.649629+0000","last_peered":"2024-04-01T23:01:32.649629+0000","last_clean":"2024-04-01T23:01:32.649629+0000","last_became_active":"2024-04-01T22:33:27.974558+0000","last_became_peered":"2024-04-01T22:33:27.974558+0000","last_unstale":"2024-04-01T23:01:32.649629+0000","last_undegraded":"2024-04-01T23:01:32.649629+0000","last_fullsized":"2024-04-01T23:01:32.649629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:15:46.224658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'40","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.679257+0000","last_change":"2024-04-01T22:33:27.974420+0000","last_active":"2024-04-01T23:01:32.679257+0000","last_peered":"2024-04-01T23:01:32.679257+0000","last_clean":"2024-04-01T23:01:32.679257+0000","last_became_active":"2024-04-01T22:33:27.974139+0000","last_became_peered":"2024-04-01T22:33:27.974139+0000","last_unstale":"2024-04-01T23:01:32.679257+0000","last_undegraded":"2024-04-01T23:01:32.679257+0000","last_fullsized":"2024-04-01T23:01:32.679257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:48:53.083180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'41","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.781493+0000","last_change":"2024-04-01T22:33:27.972053+0000","last_active":"2024-04-01T23:01:32.781493+0000","last_peered":"2024-04-01T23:01:32.781493+0000","last_clean":"2024-04-01T23:01:32.781493+0000","last_became_active":"2024-04-01T22:33:27.971803+0000","last_became_peered":"2024-04-01T22:33:27.971803+0000","last_unstale":"2024-04-01T23:01:32.781493+0000","last_undegraded":"2024-04-01T23:01:32.781493+0000","last_fullsized":"2024-04-01T23:01:32.781493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:41:45.866834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'27","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.710773+0000","last_change":"2024-04-01T22:33:27.974447+0000","last_active":"2024-04-01T23:01:32.710773+0000","last_peered":"2024-04-01T23:01:32.710773+0000","last_clean":"2024-04-01T23:01:32.710773+0000","last_became_active":"2024-04-01T22:33:27.974205+0000","last_became_peered":"2024-04-01T22:33:27.974205+0000","last_unstale":"2024-04-01T23:01:32.710773+0000","last_undegraded":"2024-04-01T23:01:32.710773+0000","last_fullsized":"2024-04-01T23:01:32.710773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:23:08.563134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'34","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.695541+0000","last_change":"2024-04-01T22:33:27.949226+0000","last_active":"2024-04-01T23:01:32.695541+0000","last_peered":"2024-04-01T23:01:32.695541+0000","last_clean":"2024-04-01T23:01:32.695541+0000","last_became_active":"2024-04-01T22:33:27.948929+0000","last_became_peered":"2024-04-01T22:33:27.948929+0000","last_unstale":"2024-04-01T23:01:32.695541+0000","last_undegraded":"2024-04-01T23:01:32.695541+0000","last_fullsized":"2024-04-01T23:01:32.695541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:50:04.913482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'34","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.672893+0000","last_change":"2024-04-01T22:33:27.974650+0000","last_active":"2024-04-01T23:01:32.672893+0000","last_peered":"2024-04-01T23:01:32.672893+0000","last_clean":"2024-04-01T23:01:32.672893+0000","last_became_active":"2024-04-01T22:33:27.973891+0000","last_became_peered":"2024-04-01T22:33:27.973891+0000","last_unstale":"2024-04-01T23:01:32.672893+0000","last_undegraded":"2024-04-01T23:01:32.672893+0000","last_fullsized":"2024-04-01T23:01:32.672893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:08:00.537270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'27","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.774173+0000","last_change":"2024-04-01T22:33:27.879045+0000","last_active":"2024-04-01T23:01:32.774173+0000","last_peered":"2024-04-01T23:01:32.774173+0000","last_clean":"2024-04-01T23:01:32.774173+0000","last_became_active":"2024-04-01T22:33:27.878782+0000","last_became_peered":"2024-04-01T22:33:27.878782+0000","last_unstale":"2024-04-01T23:01:32.774173+0000","last_undegraded":"2024-04-01T23:01:32.774173+0000","last_fullsized":"2024-04-01T23:01:32.774173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:56:25.952727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'23","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.685801+0000","last_change":"2024-04-01T22:33:27.974592+0000","last_active":"2024-04-01T23:01:32.685801+0000","last_peered":"2024-04-01T23:01:32.685801+0000","last_clean":"2024-04-01T23:01:32.685801+0000","last_became_active":"2024-04-01T22:33:27.973592+0000","last_became_peered":"2024-04-01T22:33:27.973592+0000","last_unstale":"2024-04-01T23:01:32.685801+0000","last_undegraded":"2024-04-01T23:01:32.685801+0000","last_fullsized":"2024-04-01T23:01:32.685801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:08:15.465415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'38","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.807778+0000","last_change":"2024-04-01T22:33:27.948715+0000","last_active":"2024-04-01T23:01:32.807778+0000","last_peered":"2024-04-01T23:01:32.807778+0000","last_clean":"2024-04-01T23:01:32.807778+0000","last_became_active":"2024-04-01T22:33:27.948371+0000","last_became_peered":"2024-04-01T22:33:27.948371+0000","last_unstale":"2024-04-01T23:01:32.807778+0000","last_undegraded":"2024-04-01T23:01:32.807778+0000","last_fullsized":"2024-04-01T23:01:32.807778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:19:48.595176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'33","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.626201+0000","last_change":"2024-04-01T22:33:27.949784+0000","last_active":"2024-04-01T23:01:32.626201+0000","last_peered":"2024-04-01T23:01:32.626201+0000","last_clean":"2024-04-01T23:01:32.626201+0000","last_became_active":"2024-04-01T22:33:27.949522+0000","last_became_peered":"2024-04-01T22:33:27.949522+0000","last_unstale":"2024-04-01T23:01:32.626201+0000","last_undegraded":"2024-04-01T23:01:32.626201+0000","last_fullsized":"2024-04-01T23:01:32.626201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:15:08.500466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'27","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.774104+0000","last_change":"2024-04-01T22:33:27.915533+0000","last_active":"2024-04-01T23:01:32.774104+0000","last_peered":"2024-04-01T23:01:32.774104+0000","last_clean":"2024-04-01T23:01:32.774104+0000","last_became_active":"2024-04-01T22:33:27.915245+0000","last_became_peered":"2024-04-01T22:33:27.915245+0000","last_unstale":"2024-04-01T23:01:32.774104+0000","last_undegraded":"2024-04-01T23:01:32.774104+0000","last_fullsized":"2024-04-01T23:01:32.774104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:39:28.692092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3654,"num_write_kb":290798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4064,"ondisk_log_size":4064,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2128,"ondisk_log_size":2128,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":36646588,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":816,"num_read_kb":876,"num_write":10141,"num_write_kb":41168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":48185344,"data_stored":73293176,"data_compressed":7244306,"data_compressed_allocated":10911744,"data_compressed_original":36085760,"omap_allocated":0,"internal_metadata":0},"log_size":8253,"ondisk_log_size":8253,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65062,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575193,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72588,"kb_used_data":15044,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94299252,"statfs":{"total":96636764160,"available":96562434048,"internally_reserved":0,"allocated":15405056,"data_stored":24583315,"data_compressed":2540462,"data_compressed_allocated":3739648,"data_compressed_original":13099008,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575193,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56068,"kb_used_data":11004,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94315772,"statfs":{"total":96636764160,"available":96579350528,"internally_reserved":0,"allocated":11268096,"data_stored":16896912,"data_compressed":1639374,"data_compressed_allocated":2478080,"data_compressed_original":8286208,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575192,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":119114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575193,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36636,"kb_used_data":5460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335204,"statfs":{"total":96636764160,"available":96599248896,"internally_reserved":0,"allocated":5591040,"data_stored":8507758,"data_compressed":911578,"data_compressed_allocated":1363968,"data_compressed_original":4464640,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575193,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58728,"kb_used_data":9504,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94313112,"statfs":{"total":96636764160,"available":96576626688,"internally_reserved":0,"allocated":9732096,"data_stored":12891473,"data_compressed":1012016,"data_compressed_allocated":1646592,"data_compressed_original":4988928,"omap_allocated":1592,"internal_metadata":50395592},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575193,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":483328,"data_stored":307889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575192,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41316,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330524,"statfs":{"total":96636764160,"available":96594456576,"internally_reserved":0,"allocated":1863680,"data_stored":3021005,"data_compressed":393957,"data_compressed_allocated":561152,"data_compressed_original":1900544,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575193,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41200,"kb_used_data":5864,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330640,"statfs":{"total":96636764160,"available":96594575360,"internally_reserved":0,"allocated":6004736,"data_stored":9098638,"data_compressed":811981,"data_compressed_allocated":1212416,"data_compressed_original":4493312,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32531,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32531,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5648384,"data_stored":8389246,"data_compressed":779450,"data_compressed_allocated":1167360,"data_compressed_original":3919872,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1572864,"data_stored":2901981,"data_compressed":393957,"data_compressed_allocated":561152,"data_compressed_original":1900544,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":192512,"data_stored":188865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9441280,"data_stored":12772449,"data_compressed":1012016,"data_compressed_allocated":1646592,"data_compressed_original":4988928,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5300224,"data_stored":8388734,"data_compressed":911578,"data_compressed_allocated":1363968,"data_compressed_original":4464640,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10977280,"data_stored":16777888,"data_compressed":1639374,"data_compressed_allocated":2478080,"data_compressed_original":8286208,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15048704,"data_stored":23873923,"data_compressed":2507931,"data_compressed_allocated":3694592,"data_compressed_original":12525568,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T23:01:39.358 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T23:01:39.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.499+0000 7f7ac27a1640 1 Processor -- start 2024-04-01T23:01:39.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.499+0000 7f7ac27a1640 1 -- start start 2024-04-01T23:01:39.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.500+0000 7f7ac27a1640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7abc06c250 0x7f7abc15aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:39.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.500+0000 7f7ac27a1640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7abc06c630 0x7f7abc0ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:39.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.500+0000 7f7ac27a1640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7abc154b70 con 0x7f7abc0cf0d0 2024-04-01T23:01:39.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.500+0000 7f7ac27a1640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f7abc0ce990 con 0x7f7abc06c630 2024-04-01T23:01:39.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.500+0000 7f7ac27a1640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f7abc0cdac0 con 0x7f7abc06c250 2024-04-01T23:01:39.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.500+0000 7f7abbfff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7abc06c250 0x7f7abc15aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:39.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.501+0000 7f7abbfff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7abc06c250 0x7f7abc15aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:39502/0 (socket says 172.21.15.47:39502) 2024-04-01T23:01:39.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.501+0000 7f7abbfff640 1 -- 172.21.15.47:0/2267724842 learned_addr learned my addr 172.21.15.47:0/2267724842 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:39.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.504+0000 7f7abbfff640 1 -- 172.21.15.47:0/2267724842 >> v2:172.21.15.47:3300/0 conn(0x7f7abc06c630 msgr2=0x7f7abc0ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:01:39.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.504+0000 7f7abbfff640 1 --2- 172.21.15.47:0/2267724842 >> v2:172.21.15.47:3300/0 conn(0x7f7abc06c630 0x7f7abc0ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:39.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.504+0000 7f7abbfff640 1 -- 172.21.15.47:0/2267724842 >> v1:172.21.15.181:6789/0 conn(0x7f7abc0cf0d0 legacy=0x7f7abc15bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:01:39.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.504+0000 7f7abbfff640 1 -- 172.21.15.47:0/2267724842 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7abc0cdd80 con 0x7f7abc06c250 2024-04-01T23:01:39.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.507+0000 7f7abbfff640 1 --2- 172.21.15.47:0/2267724842 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7abc06c250 0x7f7abc15aec0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7abc06b660 tx=0x7f7aac02b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8fe07823749624b server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:39.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.511+0000 7f7abaffd640 1 -- 172.21.15.47:0/2267724842 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aac034070 con 0x7f7abc06c250 2024-04-01T23:01:39.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.511+0000 7f7abaffd640 1 -- 172.21.15.47:0/2267724842 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aac030860 con 0x7f7abc06c250 2024-04-01T23:01:39.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.511+0000 7f7abaffd640 1 -- 172.21.15.47:0/2267724842 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aac030c30 con 0x7f7abc06c250 2024-04-01T23:01:39.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.511+0000 7f7ac27a1640 1 -- 172.21.15.47:0/2267724842 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7abc06c250 msgr2=0x7f7abc15aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:39.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.511+0000 7f7ac27a1640 1 --2- 172.21.15.47:0/2267724842 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7abc06c250 0x7f7abc15aec0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7abc06b660 tx=0x7f7aac02b9a0 comp rx=0 tx=0).stop 2024-04-01T23:01:39.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.511+0000 7f7ac27a1640 1 -- 172.21.15.47:0/2267724842 shutdown_connections 2024-04-01T23:01:39.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.511+0000 7f7ac27a1640 1 --2- 172.21.15.47:0/2267724842 >> v2:172.21.15.47:3300/0 conn(0x7f7abc06c630 0x7f7abc0ceb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:39.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.511+0000 7f7ac27a1640 1 --2- 172.21.15.47:0/2267724842 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7abc06c250 0x7f7abc15aec0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:39.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.511+0000 7f7ac27a1640 1 -- 172.21.15.47:0/2267724842 >> 172.21.15.47:0/2267724842 conn(0x7f7abc0cfdb0 msgr2=0x7f7abc0d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:39.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.511+0000 7f7ac27a1640 1 -- 172.21.15.47:0/2267724842 shutdown_connections 2024-04-01T23:01:39.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.511+0000 7f7ac27a1640 1 -- 172.21.15.47:0/2267724842 wait complete. 2024-04-01T23:01:39.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.513+0000 7f7ac27a1640 1 Processor -- start 2024-04-01T23:01:39.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.513+0000 7f7ac27a1640 1 -- start start 2024-04-01T23:01:39.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.513+0000 7f7ac27a1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7abc06c250 0x7f7abc0b0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:39.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.513+0000 7f7ac27a1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7abc06c630 0x7f7abc0b1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:39.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.513+0000 7f7ac27a1640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7abc0b1f00 0x7f7abc0b2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:39.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.513+0000 7f7ac27a1640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7abc0ce620 con 0x7f7abc06c630 2024-04-01T23:01:39.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.513+0000 7f7ac27a1640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7abc0ce340 con 0x7f7abc06c250 2024-04-01T23:01:39.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.513+0000 7f7ac27a1640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f7abc06ca60 con 0x7f7abc0b1f00 2024-04-01T23:01:39.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.514+0000 7f7abbfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7abc06c250 0x7f7abc0b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:39.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.514+0000 7f7ac0d3e640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7abc0b1f00 0x7f7abc0b2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:39.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.514+0000 7f7abbfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7abc06c250 0x7f7abc0b0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:39506/0 (socket says 172.21.15.47:39506) 2024-04-01T23:01:39.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.514+0000 7f7abbfff640 1 -- 172.21.15.47:0/3435659379 learned_addr learned my addr 172.21.15.47:0/3435659379 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:39.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.518+0000 7f7abb7fe640 1 --2- 172.21.15.47:0/3435659379 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7abc06c630 0x7f7abc0b1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:39.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.518+0000 7f7abbfff640 1 -- 172.21.15.47:0/3435659379 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7abc0b1f00 msgr2=0x7f7abc0b2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:39.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.518+0000 7f7abbfff640 1 --2- 172.21.15.47:0/3435659379 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7abc0b1f00 0x7f7abc0b2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:39.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.518+0000 7f7abbfff640 1 -- 172.21.15.47:0/3435659379 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7abc06c630 msgr2=0x7f7abc0b1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:39.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.518+0000 7f7abbfff640 1 --2- 172.21.15.47:0/3435659379 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7abc06c630 0x7f7abc0b1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:39.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.518+0000 7f7abbfff640 1 -- 172.21.15.47:0/3435659379 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7abc1f0c70 con 0x7f7abc06c250 2024-04-01T23:01:39.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.521+0000 7f7abbfff640 1 --2- 172.21.15.47:0/3435659379 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7abc06c250 0x7f7abc0b0440 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7aac000c00 tx=0x7f7aac004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:39.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.525+0000 7f7ab8ff9640 1 -- 172.21.15.47:0/3435659379 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aac048070 con 0x7f7abc06c250 2024-04-01T23:01:39.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.525+0000 7f7ab8ff9640 1 -- 172.21.15.47:0/3435659379 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aac039d90 con 0x7f7abc06c250 2024-04-01T23:01:39.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.525+0000 7f7ac27a1640 1 -- 172.21.15.47:0/3435659379 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7abc0cc360 con 0x7f7abc06c250 2024-04-01T23:01:39.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.525+0000 7f7ab8ff9640 1 -- 172.21.15.47:0/3435659379 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aac034040 con 0x7f7abc06c250 2024-04-01T23:01:39.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.525+0000 7f7ac27a1640 1 -- 172.21.15.47:0/3435659379 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7abc0afe60 con 0x7f7abc06c250 2024-04-01T23:01:39.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.526+0000 7f7ac27a1640 1 -- 172.21.15.47:0/3435659379 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7abc068210 con 0x7f7abc06c250 2024-04-01T23:01:39.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.768+0000 7f7ab8ff9640 1 -- 172.21.15.47:0/3435659379 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f7aac04b070 con 0x7f7abc06c250 2024-04-01T23:01:39.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.768+0000 7f7ab8ff9640 1 --2- 172.21.15.47:0/3435659379 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f7aa806b990 0x7f7aa806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:39.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.768+0000 7f7abb7fe640 1 --2- 172.21.15.47:0/3435659379 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f7aa806b990 0x7f7aa806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:39.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.769+0000 7f7abb7fe640 1 --2- 172.21.15.47:0/3435659379 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f7aa806b990 0x7f7aa806de50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7abc0afc50 tx=0x7f7ab0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:39.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.771+0000 7f7ab8ff9640 1 -- 172.21.15.47:0/3435659379 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f7aac0793b0 con 0x7f7abc06c250 2024-04-01T23:01:39.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.781+0000 7f7ab8ff9640 1 -- 172.21.15.47:0/3435659379 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f7aac07b310 con 0x7f7abc06c250 2024-04-01T23:01:39.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.960+0000 7f7ac27a1640 1 -- 172.21.15.47:0/3435659379 --> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7abc0b5b50 con 0x7f7aa806b990 2024-04-01T23:01:39.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.968+0000 7f7ab8ff9640 1 -- 172.21.15.47:0/3435659379 <== mgr.4107 v2:172.21.15.47:6800/1257047371 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+333937 (secure 0 0 0) 0x7f7abc0b5b50 con 0x7f7aa806b990 2024-04-01T23:01:39.969 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T23:01:39.972 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-01T23:01:39.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.971+0000 7f7ac27a1640 1 -- 172.21.15.47:0/3435659379 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f7aa806b990 msgr2=0x7f7aa806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:39.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.971+0000 7f7ac27a1640 1 --2- 172.21.15.47:0/3435659379 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f7aa806b990 0x7f7aa806de50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7abc0afc50 tx=0x7f7ab0008040 comp rx=0 tx=0).stop 2024-04-01T23:01:39.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.971+0000 7f7ac27a1640 1 -- 172.21.15.47:0/3435659379 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7abc06c250 msgr2=0x7f7abc0b0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:39.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.971+0000 7f7ac27a1640 1 --2- 172.21.15.47:0/3435659379 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7abc06c250 0x7f7abc0b0440 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7aac000c00 tx=0x7f7aac004730 comp rx=0 tx=0).stop 2024-04-01T23:01:39.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.971+0000 7f7ac27a1640 1 -- 172.21.15.47:0/3435659379 shutdown_connections 2024-04-01T23:01:39.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.971+0000 7f7ac27a1640 1 --2- 172.21.15.47:0/3435659379 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f7aa806b990 0x7f7aa806de50 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:39.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.971+0000 7f7ac27a1640 1 --2- 172.21.15.47:0/3435659379 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7abc0b1f00 0x7f7abc0b2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:39.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.971+0000 7f7ac27a1640 1 --2- 172.21.15.47:0/3435659379 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7abc06c630 0x7f7abc0b1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:39.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.971+0000 7f7ac27a1640 1 --2- 172.21.15.47:0/3435659379 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7abc06c250 0x7f7abc0b0440 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:39.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.971+0000 7f7ac27a1640 1 -- 172.21.15.47:0/3435659379 >> 172.21.15.47:0/3435659379 conn(0x7f7abc0cfdb0 msgr2=0x7f7abc154040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:39.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.971+0000 7f7ac27a1640 1 -- 172.21.15.47:0/3435659379 shutdown_connections 2024-04-01T23:01:39.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:39.971+0000 7f7ac27a1640 1 -- 172.21.15.47:0/3435659379 wait complete. 2024-04-01T23:01:39.979 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":875,"stamp":"2024-04-01T23:01:39.138750+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":37236956,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":932,"num_read_kb":976,"num_write":13954,"num_write_kb":334382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14562,"ondisk_log_size":14562,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":361328,"kb_used_data":49456,"kb_used_omap":12,"kb_used_meta":311795,"kb_avail":754613392,"statfs":{"total":773094113280,"available":772724113408,"internally_reserved":0,"allocated":50642944,"data_stored":75426104,"data_compressed":7309368,"data_compressed_allocated":11001856,"data_compressed_original":37232640,"omap_allocated":12751,"internal_metadata":319278641},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":97442,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8,"num_write":47,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002406"},"pg_stats":[{"pgid":"2.1f","version":"27'641","reported_seq":680,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:11.945740+0000","last_change":"2024-04-01T22:33:26.849312+0000","last_active":"2024-04-01T23:01:11.945740+0000","last_peered":"2024-04-01T23:01:11.945740+0000","last_clean":"2024-04-01T23:01:11.945740+0000","last_became_active":"2024-04-01T22:33:26.849009+0000","last_became_peered":"2024-04-01T22:33:26.849009+0000","last_unstale":"2024-04-01T23:01:11.945740+0000","last_undegraded":"2024-04-01T23:01:11.945740+0000","last_fullsized":"2024-04-01T23:01:11.945740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:58:40.837557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":638,"num_write_kb":4397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'23","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.707366+0000","last_change":"2024-04-01T22:33:27.919006+0000","last_active":"2024-04-01T23:01:32.707366+0000","last_peered":"2024-04-01T23:01:32.707366+0000","last_clean":"2024-04-01T23:01:32.707366+0000","last_became_active":"2024-04-01T22:33:27.918702+0000","last_became_peered":"2024-04-01T22:33:27.918702+0000","last_unstale":"2024-04-01T23:01:32.707366+0000","last_undegraded":"2024-04-01T23:01:32.707366+0000","last_fullsized":"2024-04-01T23:01:32.707366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:08:00.537270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'149","reported_seq":178,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.922398+0000","last_change":"2024-04-01T22:33:33.255162+0000","last_active":"2024-04-01T23:00:58.922398+0000","last_peered":"2024-04-01T23:00:58.922398+0000","last_clean":"2024-04-01T23:00:58.922398+0000","last_became_active":"2024-04-01T22:33:33.254187+0000","last_became_peered":"2024-04-01T22:33:33.254187+0000","last_unstale":"2024-04-01T23:00:58.922398+0000","last_undegraded":"2024-04-01T23:00:58.922398+0000","last_fullsized":"2024-04-01T23:00:58.922398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:57:12.343606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":7671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'717","reported_seq":757,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:09.146912+0000","last_change":"2024-04-01T22:33:26.855377+0000","last_active":"2024-04-01T23:01:09.146912+0000","last_peered":"2024-04-01T23:01:09.146912+0000","last_clean":"2024-04-01T23:01:09.146912+0000","last_became_active":"2024-04-01T22:33:26.855119+0000","last_became_peered":"2024-04-01T22:33:26.855119+0000","last_unstale":"2024-04-01T23:01:09.146912+0000","last_undegraded":"2024-04-01T23:01:09.146912+0000","last_fullsized":"2024-04-01T23:01:09.146912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:25:41.744696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":714,"num_write_kb":4525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'35","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.807686+0000","last_change":"2024-04-01T22:33:27.974175+0000","last_active":"2024-04-01T23:01:32.807686+0000","last_peered":"2024-04-01T23:01:32.807686+0000","last_clean":"2024-04-01T23:01:32.807686+0000","last_became_active":"2024-04-01T22:33:27.973915+0000","last_became_peered":"2024-04-01T22:33:27.973915+0000","last_unstale":"2024-04-01T23:01:32.807686+0000","last_undegraded":"2024-04-01T23:01:32.807686+0000","last_fullsized":"2024-04-01T23:01:32.807686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:43:03.166262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'127","reported_seq":156,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:00.657110+0000","last_change":"2024-04-01T22:33:32.853556+0000","last_active":"2024-04-01T23:01:00.657110+0000","last_peered":"2024-04-01T23:01:00.657110+0000","last_clean":"2024-04-01T23:01:00.657110+0000","last_became_active":"2024-04-01T22:33:32.853215+0000","last_became_peered":"2024-04-01T22:33:32.853215+0000","last_unstale":"2024-04-01T23:01:00.657110+0000","last_undegraded":"2024-04-01T23:01:00.657110+0000","last_fullsized":"2024-04-01T23:01:00.657110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:50:09.812910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":8638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'1188","reported_seq":1225,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:22.425341+0000","last_change":"2024-04-01T22:33:26.849967+0000","last_active":"2024-04-01T23:01:22.425341+0000","last_peered":"2024-04-01T23:01:22.425341+0000","last_clean":"2024-04-01T23:01:22.425341+0000","last_became_active":"2024-04-01T22:33:26.849432+0000","last_became_peered":"2024-04-01T22:33:26.849432+0000","last_unstale":"2024-04-01T23:01:22.425341+0000","last_undegraded":"2024-04-01T23:01:22.425341+0000","last_fullsized":"2024-04-01T23:01:22.425341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":1188,"log_dups_size":0,"ondisk_log_size":1188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:47:18.407469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1179,"num_write_kb":8891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'25","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.622804+0000","last_change":"2024-04-01T22:34:05.289795+0000","last_active":"2024-04-01T23:01:32.622804+0000","last_peered":"2024-04-01T23:01:32.622804+0000","last_clean":"2024-04-01T23:01:32.622804+0000","last_became_active":"2024-04-01T22:34:05.289454+0000","last_became_peered":"2024-04-01T22:34:05.289454+0000","last_unstale":"2024-04-01T23:01:32.622804+0000","last_undegraded":"2024-04-01T23:01:32.622804+0000","last_fullsized":"2024-04-01T23:01:32.622804+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:08:15.465415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"27'122","reported_seq":151,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:01.900227+0000","last_change":"2024-04-01T22:33:32.847230+0000","last_active":"2024-04-01T23:01:01.900227+0000","last_peered":"2024-04-01T23:01:01.900227+0000","last_clean":"2024-04-01T23:01:01.900227+0000","last_became_active":"2024-04-01T22:33:32.846382+0000","last_became_peered":"2024-04-01T22:33:32.846382+0000","last_unstale":"2024-04-01T23:01:01.900227+0000","last_undegraded":"2024-04-01T23:01:01.900227+0000","last_fullsized":"2024-04-01T23:01:01.900227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:41:50.766262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":10048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'7","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:16.444748+0000","last_change":"2024-04-01T22:33:26.852784+0000","last_active":"2024-04-01T23:01:16.444748+0000","last_peered":"2024-04-01T23:01:16.444748+0000","last_clean":"2024-04-01T23:01:16.444748+0000","last_became_active":"2024-04-01T22:33:26.852530+0000","last_became_peered":"2024-04-01T22:33:26.852530+0000","last_unstale":"2024-04-01T23:01:16.444748+0000","last_undegraded":"2024-04-01T23:01:16.444748+0000","last_fullsized":"2024-04-01T23:01:16.444748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:39:29.846272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'45","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.682061+0000","last_change":"2024-04-01T22:33:27.974358+0000","last_active":"2024-04-01T23:01:32.682061+0000","last_peered":"2024-04-01T23:01:32.682061+0000","last_clean":"2024-04-01T23:01:32.682061+0000","last_became_active":"2024-04-01T22:33:27.974117+0000","last_became_peered":"2024-04-01T22:33:27.974117+0000","last_unstale":"2024-04-01T23:01:32.682061+0000","last_undegraded":"2024-04-01T23:01:32.682061+0000","last_fullsized":"2024-04-01T23:01:32.682061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:39:28.692092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'133","reported_seq":162,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:59.670790+0000","last_change":"2024-04-01T22:33:32.844681+0000","last_active":"2024-04-01T23:00:59.670790+0000","last_peered":"2024-04-01T23:00:59.670790+0000","last_clean":"2024-04-01T23:00:59.670790+0000","last_became_active":"2024-04-01T22:33:32.844334+0000","last_became_peered":"2024-04-01T22:33:32.844334+0000","last_unstale":"2024-04-01T23:00:59.670790+0000","last_undegraded":"2024-04-01T23:00:59.670790+0000","last_fullsized":"2024-04-01T23:00:59.670790+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:56:30.852155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":7546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'27","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.682016+0000","last_change":"2024-04-01T22:33:27.918822+0000","last_active":"2024-04-01T23:01:32.682016+0000","last_peered":"2024-04-01T23:01:32.682016+0000","last_clean":"2024-04-01T23:01:32.682016+0000","last_became_active":"2024-04-01T22:33:27.918466+0000","last_became_peered":"2024-04-01T22:33:27.918466+0000","last_unstale":"2024-04-01T23:01:32.682016+0000","last_undegraded":"2024-04-01T23:01:32.682016+0000","last_fullsized":"2024-04-01T23:01:32.682016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:43:57.121738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'506","reported_seq":544,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:09.155923+0000","last_change":"2024-04-01T22:33:26.850443+0000","last_active":"2024-04-01T23:01:09.155923+0000","last_peered":"2024-04-01T23:01:09.155923+0000","last_clean":"2024-04-01T23:01:09.155923+0000","last_became_active":"2024-04-01T22:33:26.849954+0000","last_became_peered":"2024-04-01T22:33:26.849954+0000","last_unstale":"2024-04-01T23:01:09.155923+0000","last_undegraded":"2024-04-01T23:01:09.155923+0000","last_fullsized":"2024-04-01T23:01:09.155923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:49:51.408086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":502,"num_write_kb":4355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'101","reported_seq":131,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.525138+0000","last_change":"2024-04-01T22:33:32.853569+0000","last_active":"2024-04-01T23:00:58.525138+0000","last_peered":"2024-04-01T23:00:58.525138+0000","last_clean":"2024-04-01T23:00:58.525138+0000","last_became_active":"2024-04-01T22:33:32.853185+0000","last_became_peered":"2024-04-01T22:33:32.853185+0000","last_unstale":"2024-04-01T23:00:58.525138+0000","last_undegraded":"2024-04-01T23:00:58.525138+0000","last_fullsized":"2024-04-01T23:00:58.525138+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:19:25.147938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":9107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'34","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.707599+0000","last_change":"2024-04-01T22:33:27.949789+0000","last_active":"2024-04-01T23:01:32.707599+0000","last_peered":"2024-04-01T23:01:32.707599+0000","last_clean":"2024-04-01T23:01:32.707599+0000","last_became_active":"2024-04-01T22:33:27.949518+0000","last_became_peered":"2024-04-01T22:33:27.949518+0000","last_unstale":"2024-04-01T23:01:32.707599+0000","last_undegraded":"2024-04-01T23:01:32.707599+0000","last_fullsized":"2024-04-01T23:01:32.707599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:15:08.500466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:19.369124+0000","last_change":"2024-04-01T22:33:26.856856+0000","last_active":"2024-04-01T23:01:19.369124+0000","last_peered":"2024-04-01T23:01:19.369124+0000","last_clean":"2024-04-01T23:01:19.369124+0000","last_became_active":"2024-04-01T22:33:26.856591+0000","last_became_peered":"2024-04-01T22:33:26.856591+0000","last_unstale":"2024-04-01T23:01:19.369124+0000","last_undegraded":"2024-04-01T23:01:19.369124+0000","last_fullsized":"2024-04-01T23:01:19.369124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:38:14.576161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'141","reported_seq":171,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:55.230632+0000","last_change":"2024-04-01T22:33:32.847352+0000","last_active":"2024-04-01T23:00:55.230632+0000","last_peered":"2024-04-01T23:00:55.230632+0000","last_clean":"2024-04-01T23:00:55.230632+0000","last_became_active":"2024-04-01T22:33:32.846849+0000","last_became_peered":"2024-04-01T22:33:32.846849+0000","last_unstale":"2024-04-01T23:00:55.230632+0000","last_undegraded":"2024-04-01T23:00:55.230632+0000","last_fullsized":"2024-04-01T23:00:55.230632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:04:48.921372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":7884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'32","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.711128+0000","last_change":"2024-04-01T22:33:27.855387+0000","last_active":"2024-04-01T23:01:32.711128+0000","last_peered":"2024-04-01T23:01:32.711128+0000","last_clean":"2024-04-01T23:01:32.711128+0000","last_became_active":"2024-04-01T22:33:27.855123+0000","last_became_peered":"2024-04-01T22:33:27.855123+0000","last_unstale":"2024-04-01T23:01:32.711128+0000","last_undegraded":"2024-04-01T23:01:32.711128+0000","last_fullsized":"2024-04-01T23:01:32.711128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:16:58.889368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'1","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:14.096774+0000","last_change":"2024-04-01T22:33:26.848128+0000","last_active":"2024-04-01T23:01:14.096774+0000","last_peered":"2024-04-01T23:01:14.096774+0000","last_clean":"2024-04-01T23:01:14.096774+0000","last_became_active":"2024-04-01T22:33:26.847904+0000","last_became_peered":"2024-04-01T22:33:26.847904+0000","last_unstale":"2024-04-01T23:01:14.096774+0000","last_undegraded":"2024-04-01T23:01:14.096774+0000","last_fullsized":"2024-04-01T23:01:14.096774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:41:58.838710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'122","reported_seq":146,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.936244+0000","last_change":"2024-04-01T22:34:05.290215+0000","last_active":"2024-04-01T23:00:58.936244+0000","last_peered":"2024-04-01T23:00:58.936244+0000","last_clean":"2024-04-01T23:00:58.936244+0000","last_became_active":"2024-04-01T22:34:05.289769+0000","last_became_peered":"2024-04-01T22:34:05.289769+0000","last_unstale":"2024-04-01T23:00:58.936244+0000","last_undegraded":"2024-04-01T23:00:58.936244+0000","last_fullsized":"2024-04-01T23:00:58.936244+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:39:33.591520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":7582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,7],"acting":[2,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"27'32","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.632757+0000","last_change":"2024-04-01T22:33:27.868997+0000","last_active":"2024-04-01T23:01:32.632757+0000","last_peered":"2024-04-01T23:01:32.632757+0000","last_clean":"2024-04-01T23:01:32.632757+0000","last_became_active":"2024-04-01T22:33:27.868713+0000","last_became_peered":"2024-04-01T22:33:27.868713+0000","last_unstale":"2024-04-01T23:01:32.632757+0000","last_undegraded":"2024-04-01T23:01:32.632757+0000","last_fullsized":"2024-04-01T23:01:32.632757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:41:59.967183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'5","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:25.553755+0000","last_change":"2024-04-01T22:33:26.848037+0000","last_active":"2024-04-01T23:01:25.553755+0000","last_peered":"2024-04-01T23:01:25.553755+0000","last_clean":"2024-04-01T23:01:25.553755+0000","last_became_active":"2024-04-01T22:33:26.847736+0000","last_became_peered":"2024-04-01T22:33:26.847736+0000","last_unstale":"2024-04-01T23:01:25.553755+0000","last_undegraded":"2024-04-01T23:01:25.553755+0000","last_fullsized":"2024-04-01T23:01:25.553755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:56:04.675231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'108","reported_seq":138,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.933263+0000","last_change":"2024-04-01T22:33:32.847015+0000","last_active":"2024-04-01T23:00:58.933263+0000","last_peered":"2024-04-01T23:00:58.933263+0000","last_clean":"2024-04-01T23:00:58.933263+0000","last_became_active":"2024-04-01T22:33:32.846639+0000","last_became_peered":"2024-04-01T22:33:32.846639+0000","last_unstale":"2024-04-01T23:00:58.933263+0000","last_undegraded":"2024-04-01T23:00:58.933263+0000","last_fullsized":"2024-04-01T23:00:58.933263+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:47:09.903506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":8005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'39","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.807706+0000","last_change":"2024-04-01T22:33:27.948117+0000","last_active":"2024-04-01T23:01:32.807706+0000","last_peered":"2024-04-01T23:01:32.807706+0000","last_clean":"2024-04-01T23:01:32.807706+0000","last_became_active":"2024-04-01T22:33:27.947735+0000","last_became_peered":"2024-04-01T22:33:27.947735+0000","last_unstale":"2024-04-01T23:01:32.807706+0000","last_undegraded":"2024-04-01T23:01:32.807706+0000","last_fullsized":"2024-04-01T23:01:32.807706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:16:58.889368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'9","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:26.524501+0000","last_change":"2024-04-01T22:33:26.849404+0000","last_active":"2024-04-01T23:01:26.524501+0000","last_peered":"2024-04-01T23:01:26.524501+0000","last_clean":"2024-04-01T23:01:26.524501+0000","last_became_active":"2024-04-01T22:33:26.849086+0000","last_became_peered":"2024-04-01T22:33:26.849086+0000","last_unstale":"2024-04-01T23:01:26.524501+0000","last_undegraded":"2024-04-01T23:01:26.524501+0000","last_fullsized":"2024-04-01T23:01:26.524501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:41:58.838710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'117","reported_seq":148,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.933305+0000","last_change":"2024-04-01T22:33:33.249726+0000","last_active":"2024-04-01T23:00:58.933305+0000","last_peered":"2024-04-01T23:00:58.933305+0000","last_clean":"2024-04-01T23:00:58.933305+0000","last_became_active":"2024-04-01T22:33:33.249309+0000","last_became_peered":"2024-04-01T22:33:33.249309+0000","last_unstale":"2024-04-01T23:00:58.933305+0000","last_undegraded":"2024-04-01T23:00:58.933305+0000","last_fullsized":"2024-04-01T23:00:58.933305+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:08:20.364843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":13518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'31","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.707509+0000","last_change":"2024-04-01T22:33:27.879797+0000","last_active":"2024-04-01T23:01:32.707509+0000","last_peered":"2024-04-01T23:01:32.707509+0000","last_clean":"2024-04-01T23:01:32.707509+0000","last_became_active":"2024-04-01T22:33:27.879582+0000","last_became_peered":"2024-04-01T22:33:27.879582+0000","last_unstale":"2024-04-01T23:01:32.707509+0000","last_undegraded":"2024-04-01T23:01:32.707509+0000","last_fullsized":"2024-04-01T23:01:32.707509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:08:15.465415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'1318","reported_seq":1357,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:29.261176+0000","last_change":"2024-04-01T22:33:26.847504+0000","last_active":"2024-04-01T23:01:29.261176+0000","last_peered":"2024-04-01T23:01:29.261176+0000","last_clean":"2024-04-01T23:01:29.261176+0000","last_became_active":"2024-04-01T22:33:26.847333+0000","last_became_peered":"2024-04-01T22:33:26.847333+0000","last_unstale":"2024-04-01T23:01:29.261176+0000","last_undegraded":"2024-04-01T23:01:29.261176+0000","last_fullsized":"2024-04-01T23:01:29.261176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":1318,"log_dups_size":0,"ondisk_log_size":1318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:39:29.846272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3324,"num_write_kb":1182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'132","reported_seq":164,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.922776+0000","last_change":"2024-04-01T22:33:33.255030+0000","last_active":"2024-04-01T23:00:58.922776+0000","last_peered":"2024-04-01T23:00:58.922776+0000","last_clean":"2024-04-01T23:00:58.922776+0000","last_became_active":"2024-04-01T22:33:33.254621+0000","last_became_peered":"2024-04-01T22:33:33.254621+0000","last_unstale":"2024-04-01T23:00:58.922776+0000","last_undegraded":"2024-04-01T23:00:58.922776+0000","last_fullsized":"2024-04-01T23:00:58.922776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:19:44.325870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":7706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'30","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.628328+0000","last_change":"2024-04-01T22:33:27.855669+0000","last_active":"2024-04-01T23:01:32.628328+0000","last_peered":"2024-04-01T23:01:32.628328+0000","last_clean":"2024-04-01T23:01:32.628328+0000","last_became_active":"2024-04-01T22:33:27.855419+0000","last_became_peered":"2024-04-01T22:33:27.855419+0000","last_unstale":"2024-04-01T23:01:32.628328+0000","last_undegraded":"2024-04-01T23:01:32.628328+0000","last_fullsized":"2024-04-01T23:01:32.628328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:15:46.224658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:20.447485+0000","last_change":"2024-04-01T22:33:26.850176+0000","last_active":"2024-04-01T23:01:20.447485+0000","last_peered":"2024-04-01T23:01:20.447485+0000","last_clean":"2024-04-01T23:01:20.447485+0000","last_became_active":"2024-04-01T22:33:26.849717+0000","last_became_peered":"2024-04-01T22:33:26.849717+0000","last_unstale":"2024-04-01T23:01:20.447485+0000","last_undegraded":"2024-04-01T23:01:20.447485+0000","last_fullsized":"2024-04-01T23:01:20.447485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:18:55.842886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'123","reported_seq":154,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.513385+0000","last_change":"2024-04-01T22:33:33.249765+0000","last_active":"2024-04-01T23:00:58.513385+0000","last_peered":"2024-04-01T23:00:58.513385+0000","last_clean":"2024-04-01T23:00:58.513385+0000","last_became_active":"2024-04-01T22:33:33.249370+0000","last_became_peered":"2024-04-01T22:33:33.249370+0000","last_unstale":"2024-04-01T23:00:58.513385+0000","last_undegraded":"2024-04-01T23:00:58.513385+0000","last_fullsized":"2024-04-01T23:00:58.513385+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:41:50.766262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":9230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'30","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.673401+0000","last_change":"2024-04-01T22:33:27.979163+0000","last_active":"2024-04-01T23:01:32.673401+0000","last_peered":"2024-04-01T23:01:32.673401+0000","last_clean":"2024-04-01T23:01:32.673401+0000","last_became_active":"2024-04-01T22:33:27.978902+0000","last_became_peered":"2024-04-01T22:33:27.978902+0000","last_unstale":"2024-04-01T23:01:32.673401+0000","last_undegraded":"2024-04-01T23:01:32.673401+0000","last_fullsized":"2024-04-01T23:01:32.673401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:04:44.021944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'1","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:32.501046+0000","last_change":"2024-04-01T22:33:26.846575+0000","last_active":"2024-04-01T23:00:32.501046+0000","last_peered":"2024-04-01T23:00:32.501046+0000","last_clean":"2024-04-01T23:00:32.501046+0000","last_became_active":"2024-04-01T22:33:26.846265+0000","last_became_peered":"2024-04-01T22:33:26.846265+0000","last_unstale":"2024-04-01T23:00:32.501046+0000","last_undegraded":"2024-04-01T23:00:32.501046+0000","last_fullsized":"2024-04-01T23:00:32.501046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:56:04.675231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'159","reported_seq":190,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.943492+0000","last_change":"2024-04-01T22:33:32.850553+0000","last_active":"2024-04-01T23:00:58.943492+0000","last_peered":"2024-04-01T23:00:58.943492+0000","last_clean":"2024-04-01T23:00:58.943492+0000","last_became_active":"2024-04-01T22:33:32.849774+0000","last_became_peered":"2024-04-01T22:33:32.849774+0000","last_unstale":"2024-04-01T23:00:58.943492+0000","last_undegraded":"2024-04-01T23:00:58.943492+0000","last_fullsized":"2024-04-01T23:00:58.943492+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:04:48.921372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":7876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'30","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.632532+0000","last_change":"2024-04-01T22:33:27.949879+0000","last_active":"2024-04-01T23:01:32.632532+0000","last_peered":"2024-04-01T23:01:32.632532+0000","last_clean":"2024-04-01T23:01:32.632532+0000","last_became_active":"2024-04-01T22:33:27.949620+0000","last_became_peered":"2024-04-01T22:33:27.949620+0000","last_unstale":"2024-04-01T23:01:32.632532+0000","last_undegraded":"2024-04-01T23:01:32.632532+0000","last_fullsized":"2024-04-01T23:01:32.632532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:49:52.536559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'4","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:14.050511+0000","last_change":"2024-04-01T22:33:26.846346+0000","last_active":"2024-04-01T23:01:14.050511+0000","last_peered":"2024-04-01T23:01:14.050511+0000","last_clean":"2024-04-01T23:01:14.050511+0000","last_became_active":"2024-04-01T22:33:26.846052+0000","last_became_peered":"2024-04-01T22:33:26.846052+0000","last_unstale":"2024-04-01T23:01:14.050511+0000","last_undegraded":"2024-04-01T23:01:14.050511+0000","last_fullsized":"2024-04-01T23:01:14.050511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:41:58.838710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'111","reported_seq":142,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:59.673722+0000","last_change":"2024-04-01T22:33:32.846766+0000","last_active":"2024-04-01T23:00:59.673722+0000","last_peered":"2024-04-01T23:00:59.673722+0000","last_clean":"2024-04-01T23:00:59.673722+0000","last_became_active":"2024-04-01T22:33:32.846422+0000","last_became_peered":"2024-04-01T22:33:32.846422+0000","last_unstale":"2024-04-01T23:00:59.673722+0000","last_undegraded":"2024-04-01T23:00:59.673722+0000","last_fullsized":"2024-04-01T23:00:59.673722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:41:50.766262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":8847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'31","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.628334+0000","last_change":"2024-04-01T22:33:27.855299+0000","last_active":"2024-04-01T23:01:32.628334+0000","last_peered":"2024-04-01T23:01:32.628334+0000","last_clean":"2024-04-01T23:01:32.628334+0000","last_became_active":"2024-04-01T22:33:27.855035+0000","last_became_peered":"2024-04-01T22:33:27.855035+0000","last_unstale":"2024-04-01T23:01:32.628334+0000","last_undegraded":"2024-04-01T23:01:32.628334+0000","last_fullsized":"2024-04-01T23:01:32.628334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:48:53.083180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'821","reported_seq":1676,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:29.533240+0000","last_change":"2024-04-01T22:33:26.856300+0000","last_active":"2024-04-01T23:01:29.533240+0000","last_peered":"2024-04-01T23:01:29.533240+0000","last_clean":"2024-04-01T23:01:29.533240+0000","last_became_active":"2024-04-01T22:33:26.855864+0000","last_became_peered":"2024-04-01T22:33:26.855864+0000","last_unstale":"2024-04-01T23:01:29.533240+0000","last_undegraded":"2024-04-01T23:01:29.533240+0000","last_fullsized":"2024-04-01T23:01:29.533240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":821,"log_dups_size":0,"ondisk_log_size":821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:38:14.576161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188865,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":816,"num_read_kb":876,"num_write":818,"num_write_kb":878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'133","reported_seq":157,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:53.580097+0000","last_change":"2024-04-01T22:34:05.317101+0000","last_active":"2024-04-01T23:00:53.580097+0000","last_peered":"2024-04-01T23:00:53.580097+0000","last_clean":"2024-04-01T23:00:53.580097+0000","last_became_active":"2024-04-01T22:34:05.316665+0000","last_became_peered":"2024-04-01T22:34:05.316665+0000","last_unstale":"2024-04-01T23:00:53.580097+0000","last_undegraded":"2024-04-01T23:00:53.580097+0000","last_fullsized":"2024-04-01T23:00:53.580097+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:47:09.903506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":5930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"27'23","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.807554+0000","last_change":"2024-04-01T22:33:27.949013+0000","last_active":"2024-04-01T23:01:32.807554+0000","last_peered":"2024-04-01T23:01:32.807554+0000","last_clean":"2024-04-01T23:01:32.807554+0000","last_became_active":"2024-04-01T22:33:27.948687+0000","last_became_peered":"2024-04-01T22:33:27.948687+0000","last_unstale":"2024-04-01T23:01:32.807554+0000","last_undegraded":"2024-04-01T23:01:32.807554+0000","last_fullsized":"2024-04-01T23:01:32.807554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:50:54.852207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'280","reported_seq":320,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.906776+0000","last_change":"2024-04-01T22:33:26.848366+0000","last_active":"2024-04-01T23:01:32.906776+0000","last_peered":"2024-04-01T23:01:32.906776+0000","last_clean":"2024-04-01T23:01:32.906776+0000","last_became_active":"2024-04-01T22:33:26.848019+0000","last_became_peered":"2024-04-01T22:33:26.848019+0000","last_unstale":"2024-04-01T23:01:32.906776+0000","last_undegraded":"2024-04-01T23:01:32.906776+0000","last_fullsized":"2024-04-01T23:01:32.906776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:41:58.838710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2901821,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":275,"num_write_kb":2970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'118","reported_seq":148,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:56.100787+0000","last_change":"2024-04-01T22:33:33.253077+0000","last_active":"2024-04-01T23:00:56.100787+0000","last_peered":"2024-04-01T23:00:56.100787+0000","last_clean":"2024-04-01T23:00:56.100787+0000","last_became_active":"2024-04-01T22:33:33.252725+0000","last_became_peered":"2024-04-01T22:33:33.252725+0000","last_unstale":"2024-04-01T23:00:56.100787+0000","last_undegraded":"2024-04-01T23:00:56.100787+0000","last_fullsized":"2024-04-01T23:00:56.100787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:28:17.970808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":6978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'30","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.708903+0000","last_change":"2024-04-01T22:33:27.975039+0000","last_active":"2024-04-01T23:01:32.708903+0000","last_peered":"2024-04-01T23:01:32.708903+0000","last_clean":"2024-04-01T23:01:32.708903+0000","last_became_active":"2024-04-01T22:33:27.974751+0000","last_became_peered":"2024-04-01T22:33:27.974751+0000","last_unstale":"2024-04-01T23:01:32.708903+0000","last_undegraded":"2024-04-01T23:01:32.708903+0000","last_fullsized":"2024-04-01T23:01:32.708903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:43:03.166262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:16.445098+0000","last_change":"2024-04-01T22:33:26.831690+0000","last_active":"2024-04-01T23:01:16.445098+0000","last_peered":"2024-04-01T23:01:16.445098+0000","last_clean":"2024-04-01T23:01:16.445098+0000","last_became_active":"2024-04-01T22:33:26.831398+0000","last_became_peered":"2024-04-01T22:33:26.831398+0000","last_unstale":"2024-04-01T23:01:16.445098+0000","last_undegraded":"2024-04-01T23:01:16.445098+0000","last_fullsized":"2024-04-01T23:01:16.445098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:38:14.576161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":196,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:59:22.388655+0000","last_change":"2024-04-01T22:33:15.962585+0000","last_active":"2024-04-01T22:59:22.388655+0000","last_peered":"2024-04-01T22:59:22.388655+0000","last_clean":"2024-04-01T22:59:22.388655+0000","last_became_active":"2024-04-01T22:33:15.961762+0000","last_became_peered":"2024-04-01T22:33:15.961762+0000","last_unstale":"2024-04-01T22:59:22.388655+0000","last_undegraded":"2024-04-01T22:59:22.388655+0000","last_fullsized":"2024-04-01T22:59:22.388655+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:13.756389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:13.756389+0000","last_clean_scrub_stamp":"2024-04-01T22:33:13.756389+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:33:28.684533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'139","reported_seq":170,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.536776+0000","last_change":"2024-04-01T22:33:33.252863+0000","last_active":"2024-04-01T23:00:58.536776+0000","last_peered":"2024-04-01T23:00:58.536776+0000","last_clean":"2024-04-01T23:00:58.536776+0000","last_became_active":"2024-04-01T22:33:33.252494+0000","last_became_peered":"2024-04-01T22:33:33.252494+0000","last_unstale":"2024-04-01T23:00:58.536776+0000","last_undegraded":"2024-04-01T23:00:58.536776+0000","last_fullsized":"2024-04-01T23:00:58.536776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:47:09.903506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":7634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'31","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.782041+0000","last_change":"2024-04-01T22:34:04.937211+0000","last_active":"2024-04-01T23:01:32.782041+0000","last_peered":"2024-04-01T23:01:32.782041+0000","last_clean":"2024-04-01T23:01:32.782041+0000","last_became_active":"2024-04-01T22:34:04.936886+0000","last_became_peered":"2024-04-01T22:34:04.936886+0000","last_unstale":"2024-04-01T23:01:32.782041+0000","last_undegraded":"2024-04-01T23:01:32.782041+0000","last_fullsized":"2024-04-01T23:01:32.782041+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:53:33.542832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'6","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:22.420377+0000","last_change":"2024-04-01T22:33:26.832331+0000","last_active":"2024-04-01T23:01:22.420377+0000","last_peered":"2024-04-01T23:01:22.420377+0000","last_clean":"2024-04-01T23:01:22.420377+0000","last_became_active":"2024-04-01T22:33:26.832078+0000","last_became_peered":"2024-04-01T22:33:26.832078+0000","last_unstale":"2024-04-01T23:01:22.420377+0000","last_undegraded":"2024-04-01T23:01:22.420377+0000","last_fullsized":"2024-04-01T23:01:22.420377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:40:49.124240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'107","reported_seq":137,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:53.619717+0000","last_change":"2024-04-01T22:33:33.249696+0000","last_active":"2024-04-01T23:00:53.619717+0000","last_peered":"2024-04-01T23:00:53.619717+0000","last_clean":"2024-04-01T23:00:53.619717+0000","last_became_active":"2024-04-01T22:33:33.249313+0000","last_became_peered":"2024-04-01T22:33:33.249313+0000","last_unstale":"2024-04-01T23:00:53.619717+0000","last_undegraded":"2024-04-01T23:00:53.619717+0000","last_fullsized":"2024-04-01T23:00:53.619717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:39:33.591520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":3624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'31","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.640645+0000","last_change":"2024-04-01T22:33:27.971916+0000","last_active":"2024-04-01T23:01:32.640645+0000","last_peered":"2024-04-01T23:01:32.640645+0000","last_clean":"2024-04-01T23:01:32.640645+0000","last_became_active":"2024-04-01T22:33:27.971672+0000","last_became_peered":"2024-04-01T22:33:27.971672+0000","last_unstale":"2024-04-01T23:01:32.640645+0000","last_undegraded":"2024-04-01T23:01:32.640645+0000","last_fullsized":"2024-04-01T23:01:32.640645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:43:39.489075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:27.500628+0000","last_change":"2024-04-01T22:33:26.849350+0000","last_active":"2024-04-01T23:00:27.500628+0000","last_peered":"2024-04-01T23:00:27.500628+0000","last_clean":"2024-04-01T23:00:27.500628+0000","last_became_active":"2024-04-01T22:33:26.849098+0000","last_became_peered":"2024-04-01T22:33:26.849098+0000","last_unstale":"2024-04-01T23:00:27.500628+0000","last_undegraded":"2024-04-01T23:00:27.500628+0000","last_fullsized":"2024-04-01T23:00:27.500628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:47:18.407469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'171","reported_seq":201,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:56.100414+0000","last_change":"2024-04-01T22:33:32.847889+0000","last_active":"2024-04-01T23:00:56.100414+0000","last_peered":"2024-04-01T23:00:56.100414+0000","last_clean":"2024-04-01T23:00:56.100414+0000","last_became_active":"2024-04-01T22:33:32.847546+0000","last_became_peered":"2024-04-01T22:33:32.847546+0000","last_unstale":"2024-04-01T23:00:56.100414+0000","last_undegraded":"2024-04-01T23:00:56.100414+0000","last_fullsized":"2024-04-01T23:00:56.100414+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:57:05.158344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":10714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'32","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.781608+0000","last_change":"2024-04-01T22:33:27.881170+0000","last_active":"2024-04-01T23:01:32.781608+0000","last_peered":"2024-04-01T23:01:32.781608+0000","last_clean":"2024-04-01T23:01:32.781608+0000","last_became_active":"2024-04-01T22:33:27.880870+0000","last_became_peered":"2024-04-01T22:33:27.880870+0000","last_unstale":"2024-04-01T23:01:32.781608+0000","last_undegraded":"2024-04-01T23:01:32.781608+0000","last_fullsized":"2024-04-01T23:01:32.781608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:43:39.489075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'5","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:22.420216+0000","last_change":"2024-04-01T22:33:26.856069+0000","last_active":"2024-04-01T23:01:22.420216+0000","last_peered":"2024-04-01T23:01:22.420216+0000","last_clean":"2024-04-01T23:01:22.420216+0000","last_became_active":"2024-04-01T22:33:26.855705+0000","last_became_peered":"2024-04-01T22:33:26.855705+0000","last_unstale":"2024-04-01T23:01:22.420216+0000","last_undegraded":"2024-04-01T23:01:22.420216+0000","last_fullsized":"2024-04-01T23:01:22.420216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:56:04.675231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'124","reported_seq":154,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.930624+0000","last_change":"2024-04-01T22:33:33.249689+0000","last_active":"2024-04-01T23:00:58.930624+0000","last_peered":"2024-04-01T23:00:58.930624+0000","last_clean":"2024-04-01T23:00:58.930624+0000","last_became_active":"2024-04-01T22:33:33.249315+0000","last_became_peered":"2024-04-01T22:33:33.249315+0000","last_unstale":"2024-04-01T23:00:58.930624+0000","last_undegraded":"2024-04-01T23:00:58.930624+0000","last_fullsized":"2024-04-01T23:00:58.930624+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:19:44.325870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":11773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'20","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.779728+0000","last_change":"2024-04-01T22:33:27.881320+0000","last_active":"2024-04-01T23:01:32.779728+0000","last_peered":"2024-04-01T23:01:32.779728+0000","last_clean":"2024-04-01T23:01:32.779728+0000","last_became_active":"2024-04-01T22:33:27.880973+0000","last_became_peered":"2024-04-01T22:33:27.880973+0000","last_unstale":"2024-04-01T23:01:32.779728+0000","last_undegraded":"2024-04-01T23:01:32.779728+0000","last_fullsized":"2024-04-01T23:01:32.779728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:04:44.021944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:16.450936+0000","last_change":"2024-04-01T22:33:26.845121+0000","last_active":"2024-04-01T23:01:16.450936+0000","last_peered":"2024-04-01T23:01:16.450936+0000","last_clean":"2024-04-01T23:01:16.450936+0000","last_became_active":"2024-04-01T22:33:26.844852+0000","last_became_peered":"2024-04-01T22:33:26.844852+0000","last_unstale":"2024-04-01T23:01:16.450936+0000","last_undegraded":"2024-04-01T23:01:16.450936+0000","last_fullsized":"2024-04-01T23:01:16.450936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:58:40.837557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'146","reported_seq":176,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.525170+0000","last_change":"2024-04-01T22:33:32.846922+0000","last_active":"2024-04-01T23:00:58.525170+0000","last_peered":"2024-04-01T23:00:58.525170+0000","last_clean":"2024-04-01T23:00:58.525170+0000","last_became_active":"2024-04-01T22:33:32.846387+0000","last_became_peered":"2024-04-01T22:33:32.846387+0000","last_unstale":"2024-04-01T23:00:58.525170+0000","last_undegraded":"2024-04-01T23:00:58.525170+0000","last_fullsized":"2024-04-01T23:00:58.525170+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:08:05.436698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":12308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'32","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.775880+0000","last_change":"2024-04-01T22:33:27.884447+0000","last_active":"2024-04-01T23:01:32.775880+0000","last_peered":"2024-04-01T23:01:32.775880+0000","last_clean":"2024-04-01T23:01:32.775880+0000","last_became_active":"2024-04-01T22:33:27.884148+0000","last_became_peered":"2024-04-01T22:33:27.884148+0000","last_unstale":"2024-04-01T23:01:32.775880+0000","last_undegraded":"2024-04-01T23:01:32.775880+0000","last_fullsized":"2024-04-01T23:01:32.775880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:08:00.537270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'16","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:27.271938+0000","last_change":"2024-04-01T22:33:26.844884+0000","last_active":"2024-04-01T23:01:27.271938+0000","last_peered":"2024-04-01T23:01:27.271938+0000","last_clean":"2024-04-01T23:01:27.271938+0000","last_became_active":"2024-04-01T22:33:26.844583+0000","last_became_peered":"2024-04-01T22:33:26.844583+0000","last_unstale":"2024-04-01T23:01:27.271938+0000","last_undegraded":"2024-04-01T23:01:27.271938+0000","last_fullsized":"2024-04-01T23:01:27.271938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:25:41.744696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'120","reported_seq":149,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.510554+0000","last_change":"2024-04-01T22:33:32.845036+0000","last_active":"2024-04-01T23:00:58.510554+0000","last_peered":"2024-04-01T23:00:58.510554+0000","last_clean":"2024-04-01T23:00:58.510554+0000","last_became_active":"2024-04-01T22:33:32.844555+0000","last_became_peered":"2024-04-01T22:33:32.844555+0000","last_unstale":"2024-04-01T23:00:58.510554+0000","last_undegraded":"2024-04-01T23:00:58.510554+0000","last_fullsized":"2024-04-01T23:00:58.510554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:43:44.388503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":6363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'25","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.635084+0000","last_change":"2024-04-01T22:33:27.950227+0000","last_active":"2024-04-01T23:01:32.635084+0000","last_peered":"2024-04-01T23:01:32.635084+0000","last_clean":"2024-04-01T23:01:32.635084+0000","last_became_active":"2024-04-01T22:33:27.949366+0000","last_became_peered":"2024-04-01T22:33:27.949366+0000","last_unstale":"2024-04-01T23:01:32.635084+0000","last_undegraded":"2024-04-01T23:01:32.635084+0000","last_fullsized":"2024-04-01T23:01:32.635084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:16:58.889368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'3","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:16.386180+0000","last_change":"2024-04-01T22:33:26.830463+0000","last_active":"2024-04-01T23:01:16.386180+0000","last_peered":"2024-04-01T23:01:16.386180+0000","last_clean":"2024-04-01T23:01:16.386180+0000","last_became_active":"2024-04-01T22:33:26.830179+0000","last_became_peered":"2024-04-01T22:33:26.830179+0000","last_unstale":"2024-04-01T23:01:16.386180+0000","last_undegraded":"2024-04-01T23:01:16.386180+0000","last_fullsized":"2024-04-01T23:01:16.386180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:38:14.576161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'118","reported_seq":147,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:55.150889+0000","last_change":"2024-04-01T22:33:33.252812+0000","last_active":"2024-04-01T23:00:55.150889+0000","last_peered":"2024-04-01T23:00:55.150889+0000","last_clean":"2024-04-01T23:00:55.150889+0000","last_became_active":"2024-04-01T22:33:33.252412+0000","last_became_peered":"2024-04-01T22:33:33.252412+0000","last_unstale":"2024-04-01T23:00:55.150889+0000","last_undegraded":"2024-04-01T23:00:55.150889+0000","last_fullsized":"2024-04-01T23:00:55.150889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:53:38.442260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":10338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'44","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.782716+0000","last_change":"2024-04-01T22:33:27.880363+0000","last_active":"2024-04-01T23:01:32.782716+0000","last_peered":"2024-04-01T23:01:32.782716+0000","last_clean":"2024-04-01T23:01:32.782716+0000","last_became_active":"2024-04-01T22:33:27.880096+0000","last_became_peered":"2024-04-01T22:33:27.880096+0000","last_unstale":"2024-04-01T23:01:32.782716+0000","last_undegraded":"2024-04-01T23:01:32.782716+0000","last_fullsized":"2024-04-01T23:01:32.782716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:19:20.248510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'6","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:25.556353+0000","last_change":"2024-04-01T22:33:26.855823+0000","last_active":"2024-04-01T23:01:25.556353+0000","last_peered":"2024-04-01T23:01:25.556353+0000","last_clean":"2024-04-01T23:01:25.556353+0000","last_became_active":"2024-04-01T22:33:26.855475+0000","last_became_peered":"2024-04-01T22:33:26.855475+0000","last_unstale":"2024-04-01T23:01:25.556353+0000","last_undegraded":"2024-04-01T23:01:25.556353+0000","last_fullsized":"2024-04-01T23:01:25.556353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:39:29.846272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'90","reported_seq":120,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:00.654216+0000","last_change":"2024-04-01T22:33:33.249941+0000","last_active":"2024-04-01T23:01:00.654216+0000","last_peered":"2024-04-01T23:01:00.654216+0000","last_clean":"2024-04-01T23:01:00.654216+0000","last_became_active":"2024-04-01T22:33:33.249352+0000","last_became_peered":"2024-04-01T22:33:33.249352+0000","last_unstale":"2024-04-01T23:01:00.654216+0000","last_undegraded":"2024-04-01T23:01:00.654216+0000","last_fullsized":"2024-04-01T23:01:00.654216+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:36:10.226231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":8688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'34","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.805613+0000","last_change":"2024-04-01T22:33:27.948988+0000","last_active":"2024-04-01T23:01:32.805613+0000","last_peered":"2024-04-01T23:01:32.805613+0000","last_clean":"2024-04-01T23:01:32.805613+0000","last_became_active":"2024-04-01T22:33:27.948691+0000","last_became_peered":"2024-04-01T22:33:27.948691+0000","last_unstale":"2024-04-01T23:01:32.805613+0000","last_undegraded":"2024-04-01T23:01:32.805613+0000","last_fullsized":"2024-04-01T23:01:32.805613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:23:08.563134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'9","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:20.451103+0000","last_change":"2024-04-01T22:33:26.849911+0000","last_active":"2024-04-01T23:01:20.451103+0000","last_peered":"2024-04-01T23:01:20.451103+0000","last_clean":"2024-04-01T23:01:20.451103+0000","last_became_active":"2024-04-01T22:33:26.849646+0000","last_became_peered":"2024-04-01T22:33:26.849646+0000","last_unstale":"2024-04-01T23:01:20.451103+0000","last_undegraded":"2024-04-01T23:01:20.451103+0000","last_fullsized":"2024-04-01T23:01:20.451103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:29:59.992702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'119","reported_seq":148,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:00.657163+0000","last_change":"2024-04-01T22:33:33.250214+0000","last_active":"2024-04-01T23:01:00.657163+0000","last_peered":"2024-04-01T23:01:00.657163+0000","last_clean":"2024-04-01T23:01:00.657163+0000","last_became_active":"2024-04-01T22:33:33.249853+0000","last_became_peered":"2024-04-01T22:33:33.249853+0000","last_unstale":"2024-04-01T23:01:00.657163+0000","last_undegraded":"2024-04-01T23:01:00.657163+0000","last_fullsized":"2024-04-01T23:01:00.657163+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:57:12.343606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":9692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'28","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.618088+0000","last_change":"2024-04-01T22:34:04.898357+0000","last_active":"2024-04-01T23:01:32.618088+0000","last_peered":"2024-04-01T23:01:32.618088+0000","last_clean":"2024-04-01T23:01:32.618088+0000","last_became_active":"2024-04-01T22:34:04.898014+0000","last_became_peered":"2024-04-01T22:34:04.898014+0000","last_unstale":"2024-04-01T23:01:32.618088+0000","last_undegraded":"2024-04-01T23:01:32.618088+0000","last_fullsized":"2024-04-01T23:01:32.618088+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:56:25.952727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.14","version":"27'845","reported_seq":883,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:27.449649+0000","last_change":"2024-04-01T22:33:26.855687+0000","last_active":"2024-04-01T23:01:27.449649+0000","last_peered":"2024-04-01T23:01:27.449649+0000","last_clean":"2024-04-01T23:01:27.449649+0000","last_became_active":"2024-04-01T22:33:26.855400+0000","last_became_peered":"2024-04-01T22:33:26.855400+0000","last_unstale":"2024-04-01T23:01:27.449649+0000","last_undegraded":"2024-04-01T23:01:27.449649+0000","last_fullsized":"2024-04-01T23:01:27.449649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:39:29.846272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":842,"num_write_kb":4541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'128","reported_seq":158,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:59.671035+0000","last_change":"2024-04-01T22:33:32.846727+0000","last_active":"2024-04-01T23:00:59.671035+0000","last_peered":"2024-04-01T23:00:59.671035+0000","last_clean":"2024-04-01T23:00:59.671035+0000","last_became_active":"2024-04-01T22:33:32.846156+0000","last_became_peered":"2024-04-01T22:33:32.846156+0000","last_unstale":"2024-04-01T23:00:59.671035+0000","last_undegraded":"2024-04-01T23:00:59.671035+0000","last_fullsized":"2024-04-01T23:00:59.671035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:57:05.158344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":9107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'28","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.637662+0000","last_change":"2024-04-01T22:33:27.879445+0000","last_active":"2024-04-01T23:01:32.637662+0000","last_peered":"2024-04-01T23:01:32.637662+0000","last_clean":"2024-04-01T23:01:32.637662+0000","last_became_active":"2024-04-01T22:33:27.879165+0000","last_became_peered":"2024-04-01T22:33:27.879165+0000","last_unstale":"2024-04-01T23:01:32.637662+0000","last_undegraded":"2024-04-01T23:01:32.637662+0000","last_fullsized":"2024-04-01T23:01:32.637662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:18:56.971360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'573","reported_seq":610,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:26.527933+0000","last_change":"2024-04-01T22:33:26.851767+0000","last_active":"2024-04-01T23:01:26.527933+0000","last_peered":"2024-04-01T23:01:26.527933+0000","last_clean":"2024-04-01T23:01:26.527933+0000","last_became_active":"2024-04-01T22:33:26.851489+0000","last_became_peered":"2024-04-01T22:33:26.851489+0000","last_unstale":"2024-04-01T23:01:26.527933+0000","last_undegraded":"2024-04-01T23:01:26.527933+0000","last_fullsized":"2024-04-01T23:01:26.527933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":573,"log_dups_size":0,"ondisk_log_size":573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:49:51.408086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":569,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'166","reported_seq":196,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:00.657960+0000","last_change":"2024-04-01T22:33:32.846386+0000","last_active":"2024-04-01T23:01:00.657960+0000","last_peered":"2024-04-01T23:01:00.657960+0000","last_clean":"2024-04-01T23:01:00.657960+0000","last_became_active":"2024-04-01T22:33:32.846024+0000","last_became_peered":"2024-04-01T22:33:32.846024+0000","last_unstale":"2024-04-01T23:01:00.657960+0000","last_undegraded":"2024-04-01T23:01:00.657960+0000","last_fullsized":"2024-04-01T23:01:00.657960+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:39:33.591520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":22198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'35","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.807582+0000","last_change":"2024-04-01T22:33:27.974120+0000","last_active":"2024-04-01T23:01:32.807582+0000","last_peered":"2024-04-01T23:01:32.807582+0000","last_clean":"2024-04-01T23:01:32.807582+0000","last_became_active":"2024-04-01T22:33:27.973846+0000","last_became_peered":"2024-04-01T22:33:27.973846+0000","last_unstale":"2024-04-01T23:01:32.807582+0000","last_undegraded":"2024-04-01T23:01:32.807582+0000","last_fullsized":"2024-04-01T23:01:32.807582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:15:46.224658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'8","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:22.423540+0000","last_change":"2024-04-01T22:33:26.831927+0000","last_active":"2024-04-01T23:01:22.423540+0000","last_peered":"2024-04-01T23:01:22.423540+0000","last_clean":"2024-04-01T23:01:22.423540+0000","last_became_active":"2024-04-01T22:33:26.831676+0000","last_became_peered":"2024-04-01T22:33:26.831676+0000","last_unstale":"2024-04-01T23:01:22.423540+0000","last_undegraded":"2024-04-01T23:01:22.423540+0000","last_fullsized":"2024-04-01T23:01:22.423540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:40:49.124240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'96","reported_seq":126,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.522528+0000","last_change":"2024-04-01T22:33:32.849983+0000","last_active":"2024-04-01T23:00:58.522528+0000","last_peered":"2024-04-01T23:00:58.522528+0000","last_clean":"2024-04-01T23:00:58.522528+0000","last_became_active":"2024-04-01T22:33:32.849661+0000","last_became_peered":"2024-04-01T22:33:32.849661+0000","last_unstale":"2024-04-01T23:00:58.522528+0000","last_undegraded":"2024-04-01T23:00:58.522528+0000","last_fullsized":"2024-04-01T23:00:58.522528+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:41:40.370250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":9067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'37","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.685525+0000","last_change":"2024-04-01T22:33:27.972417+0000","last_active":"2024-04-01T23:01:32.685525+0000","last_peered":"2024-04-01T23:01:32.685525+0000","last_clean":"2024-04-01T23:01:32.685525+0000","last_became_active":"2024-04-01T22:33:27.972173+0000","last_became_peered":"2024-04-01T22:33:27.972173+0000","last_unstale":"2024-04-01T23:01:32.685525+0000","last_undegraded":"2024-04-01T23:01:32.685525+0000","last_fullsized":"2024-04-01T23:01:32.685525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:47:05.004078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:02.441408+0000","last_change":"2024-04-01T22:33:26.831934+0000","last_active":"2024-04-01T23:00:02.441408+0000","last_peered":"2024-04-01T23:00:02.441408+0000","last_clean":"2024-04-01T23:00:02.441408+0000","last_became_active":"2024-04-01T22:33:26.831702+0000","last_became_peered":"2024-04-01T22:33:26.831702+0000","last_unstale":"2024-04-01T23:00:02.441408+0000","last_undegraded":"2024-04-01T23:00:02.441408+0000","last_fullsized":"2024-04-01T23:00:02.441408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:56:04.675231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'144","reported_seq":174,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:00.655446+0000","last_change":"2024-04-01T22:33:33.254394+0000","last_active":"2024-04-01T23:01:00.655446+0000","last_peered":"2024-04-01T23:01:00.655446+0000","last_clean":"2024-04-01T23:01:00.655446+0000","last_became_active":"2024-04-01T22:33:33.253993+0000","last_became_peered":"2024-04-01T22:33:33.253993+0000","last_unstale":"2024-04-01T23:01:00.655446+0000","last_undegraded":"2024-04-01T23:01:00.655446+0000","last_fullsized":"2024-04-01T23:01:00.655446+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:11:05.243371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":10480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'142","reported_seq":174,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:56.101446+0000","last_change":"2024-04-01T22:33:33.253062+0000","last_active":"2024-04-01T23:00:56.101446+0000","last_peered":"2024-04-01T23:00:56.101446+0000","last_clean":"2024-04-01T23:00:56.101446+0000","last_became_active":"2024-04-01T22:33:33.252690+0000","last_became_peered":"2024-04-01T22:33:33.252690+0000","last_unstale":"2024-04-01T23:00:56.101446+0000","last_undegraded":"2024-04-01T23:00:56.101446+0000","last_fullsized":"2024-04-01T23:00:56.101446+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:04:48.921372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":7949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'40","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.629951+0000","last_change":"2024-04-01T22:33:27.855871+0000","last_active":"2024-04-01T23:01:32.629951+0000","last_peered":"2024-04-01T23:01:32.629951+0000","last_clean":"2024-04-01T23:01:32.629951+0000","last_became_active":"2024-04-01T22:33:27.855609+0000","last_became_peered":"2024-04-01T22:33:27.855609+0000","last_unstale":"2024-04-01T23:01:32.629951+0000","last_undegraded":"2024-04-01T23:01:32.629951+0000","last_fullsized":"2024-04-01T23:01:32.629951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:43:03.166262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:09.911428+0000","last_change":"2024-04-01T22:33:26.831819+0000","last_active":"2024-04-01T23:00:09.911428+0000","last_peered":"2024-04-01T23:00:09.911428+0000","last_clean":"2024-04-01T23:00:09.911428+0000","last_became_active":"2024-04-01T22:33:26.831554+0000","last_became_peered":"2024-04-01T22:33:26.831554+0000","last_unstale":"2024-04-01T23:00:09.911428+0000","last_undegraded":"2024-04-01T23:00:09.911428+0000","last_fullsized":"2024-04-01T23:00:09.911428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:56:04.675231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'135","reported_seq":166,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:56.419481+0000","last_change":"2024-04-01T22:33:32.849917+0000","last_active":"2024-04-01T23:00:56.419481+0000","last_peered":"2024-04-01T23:00:56.419481+0000","last_clean":"2024-04-01T23:00:56.419481+0000","last_became_active":"2024-04-01T22:33:32.849536+0000","last_became_peered":"2024-04-01T22:33:32.849536+0000","last_unstale":"2024-04-01T23:00:56.419481+0000","last_undegraded":"2024-04-01T23:00:56.419481+0000","last_fullsized":"2024-04-01T23:00:56.419481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:41:50.766262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":12020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'41","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.710686+0000","last_change":"2024-04-01T22:33:27.950424+0000","last_active":"2024-04-01T23:01:32.710686+0000","last_peered":"2024-04-01T23:01:32.710686+0000","last_clean":"2024-04-01T23:01:32.710686+0000","last_became_active":"2024-04-01T22:33:27.950148+0000","last_became_peered":"2024-04-01T22:33:27.950148+0000","last_unstale":"2024-04-01T23:01:32.710686+0000","last_undegraded":"2024-04-01T23:01:32.710686+0000","last_fullsized":"2024-04-01T23:01:32.710686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:50:04.913482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'1","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:07.398877+0000","last_change":"2024-04-01T22:33:26.855715+0000","last_active":"2024-04-01T23:00:07.398877+0000","last_peered":"2024-04-01T23:00:07.398877+0000","last_clean":"2024-04-01T23:00:07.398877+0000","last_became_active":"2024-04-01T22:33:26.855136+0000","last_became_peered":"2024-04-01T22:33:26.855136+0000","last_unstale":"2024-04-01T23:00:07.398877+0000","last_undegraded":"2024-04-01T23:00:07.398877+0000","last_fullsized":"2024-04-01T23:00:07.398877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:19:52.712250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'613","reported_seq":650,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:14.104867+0000","last_change":"2024-04-01T22:33:26.830837+0000","last_active":"2024-04-01T23:01:14.104867+0000","last_peered":"2024-04-01T23:01:14.104867+0000","last_clean":"2024-04-01T23:01:14.104867+0000","last_became_active":"2024-04-01T22:33:26.830563+0000","last_became_peered":"2024-04-01T22:33:26.830563+0000","last_unstale":"2024-04-01T23:01:14.104867+0000","last_undegraded":"2024-04-01T23:01:14.104867+0000","last_fullsized":"2024-04-01T23:01:14.104867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:40:49.124240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":609,"num_write_kb":4438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'35","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.807951+0000","last_change":"2024-04-01T22:33:27.951393+0000","last_active":"2024-04-01T23:01:32.807951+0000","last_peered":"2024-04-01T23:01:32.807951+0000","last_clean":"2024-04-01T23:01:32.807951+0000","last_became_active":"2024-04-01T22:33:27.951103+0000","last_became_peered":"2024-04-01T22:33:27.951103+0000","last_unstale":"2024-04-01T23:01:32.807951+0000","last_undegraded":"2024-04-01T23:01:32.807951+0000","last_fullsized":"2024-04-01T23:01:32.807951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:43:57.121738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'96","reported_seq":125,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:51.560205+0000","last_change":"2024-04-01T22:33:32.846734+0000","last_active":"2024-04-01T23:00:51.560205+0000","last_peered":"2024-04-01T23:00:51.560205+0000","last_clean":"2024-04-01T23:00:51.560205+0000","last_became_active":"2024-04-01T22:33:32.846376+0000","last_became_peered":"2024-04-01T22:33:32.846376+0000","last_unstale":"2024-04-01T23:00:51.560205+0000","last_undegraded":"2024-04-01T23:00:51.560205+0000","last_fullsized":"2024-04-01T23:00:51.560205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:50:41.471405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":4400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'650","reported_seq":687,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:20.438640+0000","last_change":"2024-04-01T22:33:26.855529+0000","last_active":"2024-04-01T23:01:20.438640+0000","last_peered":"2024-04-01T23:01:20.438640+0000","last_clean":"2024-04-01T23:01:20.438640+0000","last_became_active":"2024-04-01T22:33:26.855101+0000","last_became_peered":"2024-04-01T22:33:26.855101+0000","last_unstale":"2024-04-01T23:01:20.438640+0000","last_undegraded":"2024-04-01T23:01:20.438640+0000","last_fullsized":"2024-04-01T23:01:20.438640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:40:49.124240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":645,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'30","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.633452+0000","last_change":"2024-04-01T22:33:27.868702+0000","last_active":"2024-04-01T23:01:32.633452+0000","last_peered":"2024-04-01T23:01:32.633452+0000","last_clean":"2024-04-01T23:01:32.633452+0000","last_became_active":"2024-04-01T22:33:27.868297+0000","last_became_peered":"2024-04-01T22:33:27.868297+0000","last_unstale":"2024-04-01T23:01:32.633452+0000","last_undegraded":"2024-04-01T23:01:32.633452+0000","last_fullsized":"2024-04-01T23:01:32.633452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:39:30.974746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'127","reported_seq":163,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.922474+0000","last_change":"2024-04-01T22:34:05.319978+0000","last_active":"2024-04-01T23:00:58.922474+0000","last_peered":"2024-04-01T23:00:58.922474+0000","last_clean":"2024-04-01T23:00:58.922474+0000","last_became_active":"2024-04-01T22:34:05.319550+0000","last_became_peered":"2024-04-01T22:34:05.319550+0000","last_unstale":"2024-04-01T23:00:58.922474+0000","last_undegraded":"2024-04-01T23:00:58.922474+0000","last_fullsized":"2024-04-01T23:00:58.922474+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:34:03.139988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":7877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'45","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.672541+0000","last_change":"2024-04-01T22:33:27.950106+0000","last_active":"2024-04-01T23:01:32.672541+0000","last_peered":"2024-04-01T23:01:32.672541+0000","last_clean":"2024-04-01T23:01:32.672541+0000","last_became_active":"2024-04-01T22:33:27.949843+0000","last_became_peered":"2024-04-01T22:33:27.949843+0000","last_unstale":"2024-04-01T23:01:32.672541+0000","last_undegraded":"2024-04-01T23:01:32.672541+0000","last_fullsized":"2024-04-01T23:01:32.672541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:23:08.563134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'43","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.628992+0000","last_change":"2024-04-01T22:33:27.974409+0000","last_active":"2024-04-01T23:01:32.628992+0000","last_peered":"2024-04-01T23:01:32.628992+0000","last_clean":"2024-04-01T23:01:32.628992+0000","last_became_active":"2024-04-01T22:33:27.974128+0000","last_became_peered":"2024-04-01T22:33:27.974128+0000","last_unstale":"2024-04-01T23:01:32.628992+0000","last_undegraded":"2024-04-01T23:01:32.628992+0000","last_fullsized":"2024-04-01T23:01:32.628992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:49:52.536559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'42","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.640581+0000","last_change":"2024-04-01T22:33:27.974885+0000","last_active":"2024-04-01T23:01:32.640581+0000","last_peered":"2024-04-01T23:01:32.640581+0000","last_clean":"2024-04-01T23:01:32.640581+0000","last_became_active":"2024-04-01T22:33:27.973988+0000","last_became_peered":"2024-04-01T22:33:27.973988+0000","last_unstale":"2024-04-01T23:01:32.640581+0000","last_undegraded":"2024-04-01T23:01:32.640581+0000","last_fullsized":"2024-04-01T23:01:32.640581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:56:25.952727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'29","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.806818+0000","last_change":"2024-04-01T22:33:27.950817+0000","last_active":"2024-04-01T23:01:32.806818+0000","last_peered":"2024-04-01T23:01:32.806818+0000","last_clean":"2024-04-01T23:01:32.806818+0000","last_became_active":"2024-04-01T22:33:27.950515+0000","last_became_peered":"2024-04-01T22:33:27.950515+0000","last_unstale":"2024-04-01T23:01:32.806818+0000","last_undegraded":"2024-04-01T23:01:32.806818+0000","last_fullsized":"2024-04-01T23:01:32.806818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:48:53.083180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'25","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.709118+0000","last_change":"2024-04-01T22:33:27.869385+0000","last_active":"2024-04-01T23:01:32.709118+0000","last_peered":"2024-04-01T23:01:32.709118+0000","last_clean":"2024-04-01T23:01:32.709118+0000","last_became_active":"2024-04-01T22:33:27.869102+0000","last_became_peered":"2024-04-01T22:33:27.869102+0000","last_unstale":"2024-04-01T23:01:32.709118+0000","last_undegraded":"2024-04-01T23:01:32.709118+0000","last_fullsized":"2024-04-01T23:01:32.709118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:43:57.121738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'26","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.629389+0000","last_change":"2024-04-01T22:33:27.856463+0000","last_active":"2024-04-01T23:01:32.629389+0000","last_peered":"2024-04-01T23:01:32.629389+0000","last_clean":"2024-04-01T23:01:32.629389+0000","last_became_active":"2024-04-01T22:33:27.856213+0000","last_became_peered":"2024-04-01T22:33:27.856213+0000","last_unstale":"2024-04-01T23:01:32.629389+0000","last_undegraded":"2024-04-01T23:01:32.629389+0000","last_fullsized":"2024-04-01T23:01:32.629389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:43:57.121738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'41","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.676975+0000","last_change":"2024-04-01T22:33:27.921487+0000","last_active":"2024-04-01T23:01:32.676975+0000","last_peered":"2024-04-01T23:01:32.676975+0000","last_clean":"2024-04-01T23:01:32.676975+0000","last_became_active":"2024-04-01T22:33:27.921229+0000","last_became_peered":"2024-04-01T22:33:27.921229+0000","last_unstale":"2024-04-01T23:01:32.676975+0000","last_undegraded":"2024-04-01T23:01:32.676975+0000","last_fullsized":"2024-04-01T23:01:32.676975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:43:03.166262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'30","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.708707+0000","last_change":"2024-04-01T22:33:27.868732+0000","last_active":"2024-04-01T23:01:32.708707+0000","last_peered":"2024-04-01T23:01:32.708707+0000","last_clean":"2024-04-01T23:01:32.708707+0000","last_became_active":"2024-04-01T22:33:27.868496+0000","last_became_peered":"2024-04-01T22:33:27.868496+0000","last_unstale":"2024-04-01T23:01:32.708707+0000","last_undegraded":"2024-04-01T23:01:32.708707+0000","last_fullsized":"2024-04-01T23:01:32.708707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:56:25.952727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'30","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.671962+0000","last_change":"2024-04-01T22:33:27.974270+0000","last_active":"2024-04-01T23:01:32.671962+0000","last_peered":"2024-04-01T23:01:32.671962+0000","last_clean":"2024-04-01T23:01:32.671962+0000","last_became_active":"2024-04-01T22:33:27.973851+0000","last_became_peered":"2024-04-01T22:33:27.973851+0000","last_unstale":"2024-04-01T23:01:32.671962+0000","last_undegraded":"2024-04-01T23:01:32.671962+0000","last_fullsized":"2024-04-01T23:01:32.671962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:43:57.121738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'42","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.624517+0000","last_change":"2024-04-01T22:34:05.290057+0000","last_active":"2024-04-01T23:01:32.624517+0000","last_peered":"2024-04-01T23:01:32.624517+0000","last_clean":"2024-04-01T23:01:32.624517+0000","last_became_active":"2024-04-01T22:34:05.289755+0000","last_became_peered":"2024-04-01T22:34:05.289755+0000","last_unstale":"2024-04-01T23:01:32.624517+0000","last_undegraded":"2024-04-01T23:01:32.624517+0000","last_fullsized":"2024-04-01T23:01:32.624517+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:19:20.248510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"27'35","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.682011+0000","last_change":"2024-04-01T22:33:27.979380+0000","last_active":"2024-04-01T23:01:32.682011+0000","last_peered":"2024-04-01T23:01:32.682011+0000","last_clean":"2024-04-01T23:01:32.682011+0000","last_became_active":"2024-04-01T22:33:27.979108+0000","last_became_peered":"2024-04-01T22:33:27.979108+0000","last_unstale":"2024-04-01T23:01:32.682011+0000","last_undegraded":"2024-04-01T23:01:32.682011+0000","last_fullsized":"2024-04-01T23:01:32.682011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:50:04.913482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'48","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.808007+0000","last_change":"2024-04-01T22:33:27.953950+0000","last_active":"2024-04-01T23:01:32.808007+0000","last_peered":"2024-04-01T23:01:32.808007+0000","last_clean":"2024-04-01T23:01:32.808007+0000","last_became_active":"2024-04-01T22:33:27.953674+0000","last_became_peered":"2024-04-01T22:33:27.953674+0000","last_unstale":"2024-04-01T23:01:32.808007+0000","last_undegraded":"2024-04-01T23:01:32.808007+0000","last_fullsized":"2024-04-01T23:01:32.808007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:01:14.826403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'37","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.672896+0000","last_change":"2024-04-01T22:33:27.919041+0000","last_active":"2024-04-01T23:01:32.672896+0000","last_peered":"2024-04-01T23:01:32.672896+0000","last_clean":"2024-04-01T23:01:32.672896+0000","last_became_active":"2024-04-01T22:33:27.918815+0000","last_became_peered":"2024-04-01T22:33:27.918815+0000","last_unstale":"2024-04-01T23:01:32.672896+0000","last_undegraded":"2024-04-01T23:01:32.672896+0000","last_fullsized":"2024-04-01T23:01:32.672896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:15:08.500466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'34","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.703645+0000","last_change":"2024-04-01T22:33:27.881613+0000","last_active":"2024-04-01T23:01:32.703645+0000","last_peered":"2024-04-01T23:01:32.703645+0000","last_clean":"2024-04-01T23:01:32.703645+0000","last_became_active":"2024-04-01T22:33:27.881372+0000","last_became_peered":"2024-04-01T22:33:27.881372+0000","last_unstale":"2024-04-01T23:01:32.703645+0000","last_undegraded":"2024-04-01T23:01:32.703645+0000","last_fullsized":"2024-04-01T23:01:32.703645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:28:13.071380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"27'43","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.628635+0000","last_change":"2024-04-01T22:33:27.919025+0000","last_active":"2024-04-01T23:01:32.628635+0000","last_peered":"2024-04-01T23:01:32.628635+0000","last_clean":"2024-04-01T23:01:32.628635+0000","last_became_active":"2024-04-01T22:33:27.918749+0000","last_became_peered":"2024-04-01T22:33:27.918749+0000","last_unstale":"2024-04-01T23:01:32.628635+0000","last_undegraded":"2024-04-01T23:01:32.628635+0000","last_fullsized":"2024-04-01T23:01:32.628635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:47:19.535942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'36","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.649018+0000","last_change":"2024-04-01T22:33:27.979289+0000","last_active":"2024-04-01T23:01:32.649018+0000","last_peered":"2024-04-01T23:01:32.649018+0000","last_clean":"2024-04-01T23:01:32.649018+0000","last_became_active":"2024-04-01T22:33:27.979036+0000","last_became_peered":"2024-04-01T22:33:27.979036+0000","last_unstale":"2024-04-01T23:01:32.649018+0000","last_undegraded":"2024-04-01T23:01:32.649018+0000","last_fullsized":"2024-04-01T23:01:32.649018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:19:20.248510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"27'35","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.674355+0000","last_change":"2024-04-01T22:33:27.974214+0000","last_active":"2024-04-01T23:01:32.674355+0000","last_peered":"2024-04-01T23:01:32.674355+0000","last_clean":"2024-04-01T23:01:32.674355+0000","last_became_active":"2024-04-01T22:33:27.973962+0000","last_became_peered":"2024-04-01T22:33:27.973962+0000","last_unstale":"2024-04-01T23:01:32.674355+0000","last_undegraded":"2024-04-01T23:01:32.674355+0000","last_fullsized":"2024-04-01T23:01:32.674355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:15:08.500466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"27'37","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.628813+0000","last_change":"2024-04-01T22:33:27.869600+0000","last_active":"2024-04-01T23:01:32.628813+0000","last_peered":"2024-04-01T23:01:32.628813+0000","last_clean":"2024-04-01T23:01:32.628813+0000","last_became_active":"2024-04-01T22:33:27.869279+0000","last_became_peered":"2024-04-01T22:33:27.869279+0000","last_unstale":"2024-04-01T23:01:32.628813+0000","last_undegraded":"2024-04-01T23:01:32.628813+0000","last_fullsized":"2024-04-01T23:01:32.628813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:16:58.889368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'36","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.806471+0000","last_change":"2024-04-01T22:33:27.948313+0000","last_active":"2024-04-01T23:01:32.806471+0000","last_peered":"2024-04-01T23:01:32.806471+0000","last_clean":"2024-04-01T23:01:32.806471+0000","last_became_active":"2024-04-01T22:33:27.947834+0000","last_became_peered":"2024-04-01T22:33:27.947834+0000","last_unstale":"2024-04-01T23:01:32.806471+0000","last_undegraded":"2024-04-01T23:01:32.806471+0000","last_fullsized":"2024-04-01T23:01:32.806471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:50:36.571977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'35","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.708867+0000","last_change":"2024-04-01T22:33:27.915571+0000","last_active":"2024-04-01T23:01:32.708867+0000","last_peered":"2024-04-01T23:01:32.708867+0000","last_clean":"2024-04-01T23:01:32.708867+0000","last_became_active":"2024-04-01T22:33:27.915372+0000","last_became_peered":"2024-04-01T22:33:27.915372+0000","last_unstale":"2024-04-01T23:01:32.708867+0000","last_undegraded":"2024-04-01T23:01:32.708867+0000","last_fullsized":"2024-04-01T23:01:32.708867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:15:46.224658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'26","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.635273+0000","last_change":"2024-04-01T22:33:27.915752+0000","last_active":"2024-04-01T23:01:32.635273+0000","last_peered":"2024-04-01T23:01:32.635273+0000","last_clean":"2024-04-01T23:01:32.635273+0000","last_became_active":"2024-04-01T22:33:27.915515+0000","last_became_peered":"2024-04-01T22:33:27.915515+0000","last_unstale":"2024-04-01T23:01:32.635273+0000","last_undegraded":"2024-04-01T23:01:32.635273+0000","last_fullsized":"2024-04-01T23:01:32.635273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:47:19.535942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'29","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.649629+0000","last_change":"2024-04-01T22:33:27.974798+0000","last_active":"2024-04-01T23:01:32.649629+0000","last_peered":"2024-04-01T23:01:32.649629+0000","last_clean":"2024-04-01T23:01:32.649629+0000","last_became_active":"2024-04-01T22:33:27.974558+0000","last_became_peered":"2024-04-01T22:33:27.974558+0000","last_unstale":"2024-04-01T23:01:32.649629+0000","last_undegraded":"2024-04-01T23:01:32.649629+0000","last_fullsized":"2024-04-01T23:01:32.649629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:15:46.224658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'40","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.679257+0000","last_change":"2024-04-01T22:33:27.974420+0000","last_active":"2024-04-01T23:01:32.679257+0000","last_peered":"2024-04-01T23:01:32.679257+0000","last_clean":"2024-04-01T23:01:32.679257+0000","last_became_active":"2024-04-01T22:33:27.974139+0000","last_became_peered":"2024-04-01T22:33:27.974139+0000","last_unstale":"2024-04-01T23:01:32.679257+0000","last_undegraded":"2024-04-01T23:01:32.679257+0000","last_fullsized":"2024-04-01T23:01:32.679257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:48:53.083180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'41","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.781493+0000","last_change":"2024-04-01T22:33:27.972053+0000","last_active":"2024-04-01T23:01:32.781493+0000","last_peered":"2024-04-01T23:01:32.781493+0000","last_clean":"2024-04-01T23:01:32.781493+0000","last_became_active":"2024-04-01T22:33:27.971803+0000","last_became_peered":"2024-04-01T22:33:27.971803+0000","last_unstale":"2024-04-01T23:01:32.781493+0000","last_undegraded":"2024-04-01T23:01:32.781493+0000","last_fullsized":"2024-04-01T23:01:32.781493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:41:45.866834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'27","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.710773+0000","last_change":"2024-04-01T22:33:27.974447+0000","last_active":"2024-04-01T23:01:32.710773+0000","last_peered":"2024-04-01T23:01:32.710773+0000","last_clean":"2024-04-01T23:01:32.710773+0000","last_became_active":"2024-04-01T22:33:27.974205+0000","last_became_peered":"2024-04-01T22:33:27.974205+0000","last_unstale":"2024-04-01T23:01:32.710773+0000","last_undegraded":"2024-04-01T23:01:32.710773+0000","last_fullsized":"2024-04-01T23:01:32.710773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:23:08.563134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'34","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.695541+0000","last_change":"2024-04-01T22:33:27.949226+0000","last_active":"2024-04-01T23:01:32.695541+0000","last_peered":"2024-04-01T23:01:32.695541+0000","last_clean":"2024-04-01T23:01:32.695541+0000","last_became_active":"2024-04-01T22:33:27.948929+0000","last_became_peered":"2024-04-01T22:33:27.948929+0000","last_unstale":"2024-04-01T23:01:32.695541+0000","last_undegraded":"2024-04-01T23:01:32.695541+0000","last_fullsized":"2024-04-01T23:01:32.695541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:50:04.913482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'34","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.672893+0000","last_change":"2024-04-01T22:33:27.974650+0000","last_active":"2024-04-01T23:01:32.672893+0000","last_peered":"2024-04-01T23:01:32.672893+0000","last_clean":"2024-04-01T23:01:32.672893+0000","last_became_active":"2024-04-01T22:33:27.973891+0000","last_became_peered":"2024-04-01T22:33:27.973891+0000","last_unstale":"2024-04-01T23:01:32.672893+0000","last_undegraded":"2024-04-01T23:01:32.672893+0000","last_fullsized":"2024-04-01T23:01:32.672893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:08:00.537270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'27","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.774173+0000","last_change":"2024-04-01T22:33:27.879045+0000","last_active":"2024-04-01T23:01:32.774173+0000","last_peered":"2024-04-01T23:01:32.774173+0000","last_clean":"2024-04-01T23:01:32.774173+0000","last_became_active":"2024-04-01T22:33:27.878782+0000","last_became_peered":"2024-04-01T22:33:27.878782+0000","last_unstale":"2024-04-01T23:01:32.774173+0000","last_undegraded":"2024-04-01T23:01:32.774173+0000","last_fullsized":"2024-04-01T23:01:32.774173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:56:25.952727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'23","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.685801+0000","last_change":"2024-04-01T22:33:27.974592+0000","last_active":"2024-04-01T23:01:32.685801+0000","last_peered":"2024-04-01T23:01:32.685801+0000","last_clean":"2024-04-01T23:01:32.685801+0000","last_became_active":"2024-04-01T22:33:27.973592+0000","last_became_peered":"2024-04-01T22:33:27.973592+0000","last_unstale":"2024-04-01T23:01:32.685801+0000","last_undegraded":"2024-04-01T23:01:32.685801+0000","last_fullsized":"2024-04-01T23:01:32.685801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:08:15.465415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'38","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.807778+0000","last_change":"2024-04-01T22:33:27.948715+0000","last_active":"2024-04-01T23:01:32.807778+0000","last_peered":"2024-04-01T23:01:32.807778+0000","last_clean":"2024-04-01T23:01:32.807778+0000","last_became_active":"2024-04-01T22:33:27.948371+0000","last_became_peered":"2024-04-01T22:33:27.948371+0000","last_unstale":"2024-04-01T23:01:32.807778+0000","last_undegraded":"2024-04-01T23:01:32.807778+0000","last_fullsized":"2024-04-01T23:01:32.807778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:19:48.595176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'33","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.626201+0000","last_change":"2024-04-01T22:33:27.949784+0000","last_active":"2024-04-01T23:01:32.626201+0000","last_peered":"2024-04-01T23:01:32.626201+0000","last_clean":"2024-04-01T23:01:32.626201+0000","last_became_active":"2024-04-01T22:33:27.949522+0000","last_became_peered":"2024-04-01T22:33:27.949522+0000","last_unstale":"2024-04-01T23:01:32.626201+0000","last_undegraded":"2024-04-01T23:01:32.626201+0000","last_fullsized":"2024-04-01T23:01:32.626201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:15:08.500466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'27","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.774104+0000","last_change":"2024-04-01T22:33:27.915533+0000","last_active":"2024-04-01T23:01:32.774104+0000","last_peered":"2024-04-01T23:01:32.774104+0000","last_clean":"2024-04-01T23:01:32.774104+0000","last_became_active":"2024-04-01T22:33:27.915245+0000","last_became_peered":"2024-04-01T22:33:27.915245+0000","last_unstale":"2024-04-01T23:01:32.774104+0000","last_undegraded":"2024-04-01T23:01:32.774104+0000","last_fullsized":"2024-04-01T23:01:32.774104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:39:28.692092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3654,"num_write_kb":290798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4064,"ondisk_log_size":4064,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2128,"ondisk_log_size":2128,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":36646588,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":816,"num_read_kb":876,"num_write":10141,"num_write_kb":41168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":48185344,"data_stored":73293176,"data_compressed":7244306,"data_compressed_allocated":10911744,"data_compressed_original":36085760,"omap_allocated":0,"internal_metadata":0},"log_size":8253,"ondisk_log_size":8253,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65062,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575193,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72588,"kb_used_data":15044,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94299252,"statfs":{"total":96636764160,"available":96562434048,"internally_reserved":0,"allocated":15405056,"data_stored":24583315,"data_compressed":2540462,"data_compressed_allocated":3739648,"data_compressed_original":13099008,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575193,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56068,"kb_used_data":11004,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94315772,"statfs":{"total":96636764160,"available":96579350528,"internally_reserved":0,"allocated":11268096,"data_stored":16896912,"data_compressed":1639374,"data_compressed_allocated":2478080,"data_compressed_original":8286208,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575192,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":119114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575193,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36636,"kb_used_data":5460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335204,"statfs":{"total":96636764160,"available":96599248896,"internally_reserved":0,"allocated":5591040,"data_stored":8507758,"data_compressed":911578,"data_compressed_allocated":1363968,"data_compressed_original":4464640,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575193,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58728,"kb_used_data":9504,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94313112,"statfs":{"total":96636764160,"available":96576626688,"internally_reserved":0,"allocated":9732096,"data_stored":12891473,"data_compressed":1012016,"data_compressed_allocated":1646592,"data_compressed_original":4988928,"omap_allocated":1592,"internal_metadata":50395592},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575193,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":483328,"data_stored":307889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575192,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41316,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330524,"statfs":{"total":96636764160,"available":96594456576,"internally_reserved":0,"allocated":1863680,"data_stored":3021005,"data_compressed":393957,"data_compressed_allocated":561152,"data_compressed_original":1900544,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575193,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41200,"kb_used_data":5864,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330640,"statfs":{"total":96636764160,"available":96594575360,"internally_reserved":0,"allocated":6004736,"data_stored":9098638,"data_compressed":811981,"data_compressed_allocated":1212416,"data_compressed_original":4493312,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32531,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32531,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5648384,"data_stored":8389246,"data_compressed":779450,"data_compressed_allocated":1167360,"data_compressed_original":3919872,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1572864,"data_stored":2901981,"data_compressed":393957,"data_compressed_allocated":561152,"data_compressed_original":1900544,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":192512,"data_stored":188865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9441280,"data_stored":12772449,"data_compressed":1012016,"data_compressed_allocated":1646592,"data_compressed_original":4988928,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5300224,"data_stored":8388734,"data_compressed":911578,"data_compressed_allocated":1363968,"data_compressed_original":4464640,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10977280,"data_stored":16777888,"data_compressed":1639374,"data_compressed_allocated":2478080,"data_compressed_original":8286208,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15048704,"data_stored":23873923,"data_compressed":2507931,"data_compressed_allocated":3694592,"data_compressed_original":12525568,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T23:01:39.984 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-01T23:01:39.984 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T23:01:40.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.125+0000 7f549a42e640 1 Processor -- start 2024-04-01T23:01:40.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.125+0000 7f549a42e640 1 -- start start 2024-04-01T23:01:40.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.126+0000 7f549a42e640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f549415aec0 0x7f549406c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:40.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.126+0000 7f549a42e640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5494154b70 con 0x7f549415bb20 2024-04-01T23:01:40.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.126+0000 7f549a42e640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54940cdac0 con 0x7f549406c250 2024-04-01T23:01:40.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.126+0000 7f549a42e640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f54940ce990 con 0x7f549415aec0 2024-04-01T23:01:40.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.127+0000 7f54989cb640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f549415bb20 0x7f549415bf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35588/0 (socket says 172.21.15.47:35588) 2024-04-01T23:01:40.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.127+0000 7f54989cb640 1 -- 172.21.15.47:0/2662677634 learned_addr learned my addr 172.21.15.47:0/2662677634 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T23:01:40.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.127+0000 7f54937fe640 1 --2- 172.21.15.47:0/2662677634 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f549415aec0 0x7f549406c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:40.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.129+0000 7f5492ffd640 1 -- 172.21.15.47:0/2662677634 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2769457936 0 0) 0x7f5494154b70 con 0x7f549415bb20 2024-04-01T23:01:40.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.129+0000 7f5492ffd640 1 -- 172.21.15.47:0/2662677634 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5480003520 con 0x7f549415bb20 2024-04-01T23:01:40.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.129+0000 7f5492ffd640 1 -- 172.21.15.47:0/2662677634 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2271952776 0 0) 0x7f54940cdac0 con 0x7f549406c250 2024-04-01T23:01:40.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.129+0000 7f5492ffd640 1 -- 172.21.15.47:0/2662677634 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5494154b70 con 0x7f549406c250 2024-04-01T23:01:40.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.130+0000 7f54937fe640 1 -- 172.21.15.47:0/2662677634 >> v1:172.21.15.181:6789/0 conn(0x7f549406c250 legacy=0x7f54940ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:40.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.130+0000 7f54937fe640 1 -- 172.21.15.47:0/2662677634 >> v1:172.21.15.47:6789/0 conn(0x7f549415bb20 legacy=0x7f549415bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:40.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.130+0000 7f54937fe640 1 -- 172.21.15.47:0/2662677634 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54940cf2a0 con 0x7f549415aec0 2024-04-01T23:01:40.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.132+0000 7f54937fe640 1 --2- 172.21.15.47:0/2662677634 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f549415aec0 0x7f549406c630 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f54840097d0 tx=0x7f548402b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1b03325071d7b26 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:40.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.136+0000 7f5492ffd640 1 -- 172.21.15.47:0/2662677634 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5484034070 con 0x7f549415aec0 2024-04-01T23:01:40.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.136+0000 7f5492ffd640 1 -- 172.21.15.47:0/2662677634 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5484030880 con 0x7f549415aec0 2024-04-01T23:01:40.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.136+0000 7f5492ffd640 1 -- 172.21.15.47:0/2662677634 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5484030c50 con 0x7f549415aec0 2024-04-01T23:01:40.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.137+0000 7f549a42e640 1 -- 172.21.15.47:0/2662677634 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f549415aec0 msgr2=0x7f549406c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:40.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.137+0000 7f549a42e640 1 --2- 172.21.15.47:0/2662677634 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f549415aec0 0x7f549406c630 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f54840097d0 tx=0x7f548402b9c0 comp rx=0 tx=0).stop 2024-04-01T23:01:40.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.137+0000 7f549a42e640 1 -- 172.21.15.47:0/2662677634 shutdown_connections 2024-04-01T23:01:40.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.137+0000 7f549a42e640 1 --2- 172.21.15.47:0/2662677634 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f549415aec0 0x7f549406c630 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:40.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.137+0000 7f549a42e640 1 -- 172.21.15.47:0/2662677634 >> 172.21.15.47:0/2662677634 conn(0x7f54940cfdb0 msgr2=0x7f54940d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:40.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.137+0000 7f549a42e640 1 -- 172.21.15.47:0/2662677634 shutdown_connections 2024-04-01T23:01:40.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.137+0000 7f549a42e640 1 -- 172.21.15.47:0/2662677634 wait complete. 2024-04-01T23:01:40.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.138+0000 7f549a42e640 1 Processor -- start 2024-04-01T23:01:40.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.138+0000 7f549a42e640 1 -- start start 2024-04-01T23:01:40.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.139+0000 7f549a42e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f549406c250 0x7f5494156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:40.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.139+0000 7f549a42e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f549415aec0 0x7f54940b1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:40.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.139+0000 7f549a42e640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f549415bb20 0x7f5494155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:40.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.139+0000 7f549a42e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f54940ce340 con 0x7f549415aec0 2024-04-01T23:01:40.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.139+0000 7f549a42e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f54940ce060 con 0x7f549406c250 2024-04-01T23:01:40.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.139+0000 7f549a42e640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f54940ce620 con 0x7f549415bb20 2024-04-01T23:01:40.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.139+0000 7f54937fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f549415aec0 0x7f54940b1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:40.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.139+0000 7f54989cb640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f549415bb20 0x7f5494155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:40.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.139+0000 7f5493fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f549406c250 0x7f5494156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:40.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.139+0000 7f54989cb640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f549415bb20 0x7f5494155c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:41670/0 (socket says 172.21.15.47:41670) 2024-04-01T23:01:40.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.139+0000 7f54989cb640 1 -- 172.21.15.47:0/2734311034 learned_addr learned my addr 172.21.15.47:0/2734311034 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:40.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.143+0000 7f54989cb640 1 -- 172.21.15.47:0/2734311034 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f549406c250 msgr2=0x7f5494156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:40.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.143+0000 7f54989cb640 1 --2- 172.21.15.47:0/2734311034 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f549406c250 0x7f5494156f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:40.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.143+0000 7f54989cb640 1 -- 172.21.15.47:0/2734311034 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f549415aec0 msgr2=0x7f54940b1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:40.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.143+0000 7f54989cb640 1 --2- 172.21.15.47:0/2734311034 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f549415aec0 0x7f54940b1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:40.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.143+0000 7f54989cb640 1 -- 172.21.15.47:0/2734311034 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54940b3cb0 con 0x7f549415bb20 2024-04-01T23:01:40.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.145+0000 7f54989cb640 1 --2- 172.21.15.47:0/2734311034 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f549415bb20 0x7f5494155c80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f548c00cad0 tx=0x7f548c00cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:40.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.148+0000 7f5490ff9640 1 -- 172.21.15.47:0/2734311034 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f548c017070 con 0x7f549415bb20 2024-04-01T23:01:40.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.148+0000 7f5490ff9640 1 -- 172.21.15.47:0/2734311034 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f548c00ac50 con 0x7f549415bb20 2024-04-01T23:01:40.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.149+0000 7f5490ff9640 1 -- 172.21.15.47:0/2734311034 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f548c012400 con 0x7f549415bb20 2024-04-01T23:01:40.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.149+0000 7f549a42e640 1 -- 172.21.15.47:0/2734311034 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54940b3f90 con 0x7f549415bb20 2024-04-01T23:01:40.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.149+0000 7f549a42e640 1 -- 172.21.15.47:0/2734311034 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f54940b4550 con 0x7f549415bb20 2024-04-01T23:01:40.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.150+0000 7f549a42e640 1 -- 172.21.15.47:0/2734311034 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5494068210 con 0x7f549415bb20 2024-04-01T23:01:40.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.169+0000 7f5490ff9640 1 -- 172.21.15.47:0/2734311034 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f548c01a070 con 0x7f549415bb20 2024-04-01T23:01:40.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.169+0000 7f5490ff9640 1 --2- 172.21.15.47:0/2734311034 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f547406b9e0 0x7f547406dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:40.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.169+0000 7f5493fff640 1 --2- 172.21.15.47:0/2734311034 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f547406b9e0 0x7f547406dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:40.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.170+0000 7f5493fff640 1 --2- 172.21.15.47:0/2734311034 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f547406b9e0 0x7f547406dea0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f547c007fd0 tx=0x7f547c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:40.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.171+0000 7f5490ff9640 1 -- 172.21.15.47:0/2734311034 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f548c057020 con 0x7f549415bb20 2024-04-01T23:01:40.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.405+0000 7f5490ff9640 1 -- 172.21.15.47:0/2734311034 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f548c021020 con 0x7f549415bb20 2024-04-01T23:01:40.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.589+0000 7f549a42e640 1 -- 172.21.15.47:0/2734311034 --> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f54940b5b50 con 0x7f547406b9e0 2024-04-01T23:01:40.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.597+0000 7f5490ff9640 1 -- 172.21.15.47:0/2734311034 <== mgr.4107 v2:172.21.15.47:6800/1257047371 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+333937 (secure 0 0 0) 0x7f54940b5b50 con 0x7f547406b9e0 2024-04-01T23:01:40.598 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T23:01:40.600 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-01T23:01:40.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.602+0000 7f549a42e640 1 -- 172.21.15.47:0/2734311034 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f547406b9e0 msgr2=0x7f547406dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:40.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.602+0000 7f549a42e640 1 --2- 172.21.15.47:0/2734311034 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f547406b9e0 0x7f547406dea0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f547c007fd0 tx=0x7f547c009040 comp rx=0 tx=0).stop 2024-04-01T23:01:40.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.602+0000 7f549a42e640 1 -- 172.21.15.47:0/2734311034 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f549415bb20 msgr2=0x7f5494155c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:40.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.602+0000 7f549a42e640 1 --2- 172.21.15.47:0/2734311034 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f549415bb20 0x7f5494155c80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f548c00cad0 tx=0x7f548c00cf90 comp rx=0 tx=0).stop 2024-04-01T23:01:40.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.602+0000 7f549a42e640 1 -- 172.21.15.47:0/2734311034 shutdown_connections 2024-04-01T23:01:40.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.602+0000 7f549a42e640 1 --2- 172.21.15.47:0/2734311034 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f547406b9e0 0x7f547406dea0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:40.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.602+0000 7f549a42e640 1 --2- 172.21.15.47:0/2734311034 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f549415bb20 0x7f5494155c80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:40.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.602+0000 7f549a42e640 1 --2- 172.21.15.47:0/2734311034 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f549415aec0 0x7f54940b1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:40.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.602+0000 7f549a42e640 1 --2- 172.21.15.47:0/2734311034 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f549406c250 0x7f5494156f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:40.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.602+0000 7f549a42e640 1 -- 172.21.15.47:0/2734311034 >> 172.21.15.47:0/2734311034 conn(0x7f54940cfdb0 msgr2=0x7f54941540a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:40.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.602+0000 7f549a42e640 1 -- 172.21.15.47:0/2734311034 shutdown_connections 2024-04-01T23:01:40.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.602+0000 7f549a42e640 1 -- 172.21.15.47:0/2734311034 wait complete. 2024-04-01T23:01:40.613 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":875,"stamp":"2024-04-01T23:01:39.138750+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":37236956,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":932,"num_read_kb":976,"num_write":13954,"num_write_kb":334382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14562,"ondisk_log_size":14562,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":361328,"kb_used_data":49456,"kb_used_omap":12,"kb_used_meta":311795,"kb_avail":754613392,"statfs":{"total":773094113280,"available":772724113408,"internally_reserved":0,"allocated":50642944,"data_stored":75426104,"data_compressed":7309368,"data_compressed_allocated":11001856,"data_compressed_original":37232640,"omap_allocated":12751,"internal_metadata":319278641},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":97442,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8,"num_write":47,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002406"},"pg_stats":[{"pgid":"2.1f","version":"27'641","reported_seq":680,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:11.945740+0000","last_change":"2024-04-01T22:33:26.849312+0000","last_active":"2024-04-01T23:01:11.945740+0000","last_peered":"2024-04-01T23:01:11.945740+0000","last_clean":"2024-04-01T23:01:11.945740+0000","last_became_active":"2024-04-01T22:33:26.849009+0000","last_became_peered":"2024-04-01T22:33:26.849009+0000","last_unstale":"2024-04-01T23:01:11.945740+0000","last_undegraded":"2024-04-01T23:01:11.945740+0000","last_fullsized":"2024-04-01T23:01:11.945740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:58:40.837557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":638,"num_write_kb":4397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'23","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.707366+0000","last_change":"2024-04-01T22:33:27.919006+0000","last_active":"2024-04-01T23:01:32.707366+0000","last_peered":"2024-04-01T23:01:32.707366+0000","last_clean":"2024-04-01T23:01:32.707366+0000","last_became_active":"2024-04-01T22:33:27.918702+0000","last_became_peered":"2024-04-01T22:33:27.918702+0000","last_unstale":"2024-04-01T23:01:32.707366+0000","last_undegraded":"2024-04-01T23:01:32.707366+0000","last_fullsized":"2024-04-01T23:01:32.707366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:08:00.537270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'149","reported_seq":178,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.922398+0000","last_change":"2024-04-01T22:33:33.255162+0000","last_active":"2024-04-01T23:00:58.922398+0000","last_peered":"2024-04-01T23:00:58.922398+0000","last_clean":"2024-04-01T23:00:58.922398+0000","last_became_active":"2024-04-01T22:33:33.254187+0000","last_became_peered":"2024-04-01T22:33:33.254187+0000","last_unstale":"2024-04-01T23:00:58.922398+0000","last_undegraded":"2024-04-01T23:00:58.922398+0000","last_fullsized":"2024-04-01T23:00:58.922398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:57:12.343606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":7671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'717","reported_seq":757,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:09.146912+0000","last_change":"2024-04-01T22:33:26.855377+0000","last_active":"2024-04-01T23:01:09.146912+0000","last_peered":"2024-04-01T23:01:09.146912+0000","last_clean":"2024-04-01T23:01:09.146912+0000","last_became_active":"2024-04-01T22:33:26.855119+0000","last_became_peered":"2024-04-01T22:33:26.855119+0000","last_unstale":"2024-04-01T23:01:09.146912+0000","last_undegraded":"2024-04-01T23:01:09.146912+0000","last_fullsized":"2024-04-01T23:01:09.146912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:25:41.744696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":714,"num_write_kb":4525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'35","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.807686+0000","last_change":"2024-04-01T22:33:27.974175+0000","last_active":"2024-04-01T23:01:32.807686+0000","last_peered":"2024-04-01T23:01:32.807686+0000","last_clean":"2024-04-01T23:01:32.807686+0000","last_became_active":"2024-04-01T22:33:27.973915+0000","last_became_peered":"2024-04-01T22:33:27.973915+0000","last_unstale":"2024-04-01T23:01:32.807686+0000","last_undegraded":"2024-04-01T23:01:32.807686+0000","last_fullsized":"2024-04-01T23:01:32.807686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:43:03.166262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'127","reported_seq":156,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:00.657110+0000","last_change":"2024-04-01T22:33:32.853556+0000","last_active":"2024-04-01T23:01:00.657110+0000","last_peered":"2024-04-01T23:01:00.657110+0000","last_clean":"2024-04-01T23:01:00.657110+0000","last_became_active":"2024-04-01T22:33:32.853215+0000","last_became_peered":"2024-04-01T22:33:32.853215+0000","last_unstale":"2024-04-01T23:01:00.657110+0000","last_undegraded":"2024-04-01T23:01:00.657110+0000","last_fullsized":"2024-04-01T23:01:00.657110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:50:09.812910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":8638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'1188","reported_seq":1225,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:22.425341+0000","last_change":"2024-04-01T22:33:26.849967+0000","last_active":"2024-04-01T23:01:22.425341+0000","last_peered":"2024-04-01T23:01:22.425341+0000","last_clean":"2024-04-01T23:01:22.425341+0000","last_became_active":"2024-04-01T22:33:26.849432+0000","last_became_peered":"2024-04-01T22:33:26.849432+0000","last_unstale":"2024-04-01T23:01:22.425341+0000","last_undegraded":"2024-04-01T23:01:22.425341+0000","last_fullsized":"2024-04-01T23:01:22.425341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":1188,"log_dups_size":0,"ondisk_log_size":1188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:47:18.407469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1179,"num_write_kb":8891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'25","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.622804+0000","last_change":"2024-04-01T22:34:05.289795+0000","last_active":"2024-04-01T23:01:32.622804+0000","last_peered":"2024-04-01T23:01:32.622804+0000","last_clean":"2024-04-01T23:01:32.622804+0000","last_became_active":"2024-04-01T22:34:05.289454+0000","last_became_peered":"2024-04-01T22:34:05.289454+0000","last_unstale":"2024-04-01T23:01:32.622804+0000","last_undegraded":"2024-04-01T23:01:32.622804+0000","last_fullsized":"2024-04-01T23:01:32.622804+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:08:15.465415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"27'122","reported_seq":151,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:01.900227+0000","last_change":"2024-04-01T22:33:32.847230+0000","last_active":"2024-04-01T23:01:01.900227+0000","last_peered":"2024-04-01T23:01:01.900227+0000","last_clean":"2024-04-01T23:01:01.900227+0000","last_became_active":"2024-04-01T22:33:32.846382+0000","last_became_peered":"2024-04-01T22:33:32.846382+0000","last_unstale":"2024-04-01T23:01:01.900227+0000","last_undegraded":"2024-04-01T23:01:01.900227+0000","last_fullsized":"2024-04-01T23:01:01.900227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:41:50.766262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":10048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'7","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:16.444748+0000","last_change":"2024-04-01T22:33:26.852784+0000","last_active":"2024-04-01T23:01:16.444748+0000","last_peered":"2024-04-01T23:01:16.444748+0000","last_clean":"2024-04-01T23:01:16.444748+0000","last_became_active":"2024-04-01T22:33:26.852530+0000","last_became_peered":"2024-04-01T22:33:26.852530+0000","last_unstale":"2024-04-01T23:01:16.444748+0000","last_undegraded":"2024-04-01T23:01:16.444748+0000","last_fullsized":"2024-04-01T23:01:16.444748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:39:29.846272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'45","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.682061+0000","last_change":"2024-04-01T22:33:27.974358+0000","last_active":"2024-04-01T23:01:32.682061+0000","last_peered":"2024-04-01T23:01:32.682061+0000","last_clean":"2024-04-01T23:01:32.682061+0000","last_became_active":"2024-04-01T22:33:27.974117+0000","last_became_peered":"2024-04-01T22:33:27.974117+0000","last_unstale":"2024-04-01T23:01:32.682061+0000","last_undegraded":"2024-04-01T23:01:32.682061+0000","last_fullsized":"2024-04-01T23:01:32.682061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:39:28.692092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'133","reported_seq":162,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:59.670790+0000","last_change":"2024-04-01T22:33:32.844681+0000","last_active":"2024-04-01T23:00:59.670790+0000","last_peered":"2024-04-01T23:00:59.670790+0000","last_clean":"2024-04-01T23:00:59.670790+0000","last_became_active":"2024-04-01T22:33:32.844334+0000","last_became_peered":"2024-04-01T22:33:32.844334+0000","last_unstale":"2024-04-01T23:00:59.670790+0000","last_undegraded":"2024-04-01T23:00:59.670790+0000","last_fullsized":"2024-04-01T23:00:59.670790+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:56:30.852155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":7546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'27","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.682016+0000","last_change":"2024-04-01T22:33:27.918822+0000","last_active":"2024-04-01T23:01:32.682016+0000","last_peered":"2024-04-01T23:01:32.682016+0000","last_clean":"2024-04-01T23:01:32.682016+0000","last_became_active":"2024-04-01T22:33:27.918466+0000","last_became_peered":"2024-04-01T22:33:27.918466+0000","last_unstale":"2024-04-01T23:01:32.682016+0000","last_undegraded":"2024-04-01T23:01:32.682016+0000","last_fullsized":"2024-04-01T23:01:32.682016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:43:57.121738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'506","reported_seq":544,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:09.155923+0000","last_change":"2024-04-01T22:33:26.850443+0000","last_active":"2024-04-01T23:01:09.155923+0000","last_peered":"2024-04-01T23:01:09.155923+0000","last_clean":"2024-04-01T23:01:09.155923+0000","last_became_active":"2024-04-01T22:33:26.849954+0000","last_became_peered":"2024-04-01T22:33:26.849954+0000","last_unstale":"2024-04-01T23:01:09.155923+0000","last_undegraded":"2024-04-01T23:01:09.155923+0000","last_fullsized":"2024-04-01T23:01:09.155923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:49:51.408086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":502,"num_write_kb":4355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'101","reported_seq":131,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.525138+0000","last_change":"2024-04-01T22:33:32.853569+0000","last_active":"2024-04-01T23:00:58.525138+0000","last_peered":"2024-04-01T23:00:58.525138+0000","last_clean":"2024-04-01T23:00:58.525138+0000","last_became_active":"2024-04-01T22:33:32.853185+0000","last_became_peered":"2024-04-01T22:33:32.853185+0000","last_unstale":"2024-04-01T23:00:58.525138+0000","last_undegraded":"2024-04-01T23:00:58.525138+0000","last_fullsized":"2024-04-01T23:00:58.525138+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:19:25.147938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":9107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'34","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.707599+0000","last_change":"2024-04-01T22:33:27.949789+0000","last_active":"2024-04-01T23:01:32.707599+0000","last_peered":"2024-04-01T23:01:32.707599+0000","last_clean":"2024-04-01T23:01:32.707599+0000","last_became_active":"2024-04-01T22:33:27.949518+0000","last_became_peered":"2024-04-01T22:33:27.949518+0000","last_unstale":"2024-04-01T23:01:32.707599+0000","last_undegraded":"2024-04-01T23:01:32.707599+0000","last_fullsized":"2024-04-01T23:01:32.707599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:15:08.500466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:19.369124+0000","last_change":"2024-04-01T22:33:26.856856+0000","last_active":"2024-04-01T23:01:19.369124+0000","last_peered":"2024-04-01T23:01:19.369124+0000","last_clean":"2024-04-01T23:01:19.369124+0000","last_became_active":"2024-04-01T22:33:26.856591+0000","last_became_peered":"2024-04-01T22:33:26.856591+0000","last_unstale":"2024-04-01T23:01:19.369124+0000","last_undegraded":"2024-04-01T23:01:19.369124+0000","last_fullsized":"2024-04-01T23:01:19.369124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:38:14.576161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'141","reported_seq":171,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:55.230632+0000","last_change":"2024-04-01T22:33:32.847352+0000","last_active":"2024-04-01T23:00:55.230632+0000","last_peered":"2024-04-01T23:00:55.230632+0000","last_clean":"2024-04-01T23:00:55.230632+0000","last_became_active":"2024-04-01T22:33:32.846849+0000","last_became_peered":"2024-04-01T22:33:32.846849+0000","last_unstale":"2024-04-01T23:00:55.230632+0000","last_undegraded":"2024-04-01T23:00:55.230632+0000","last_fullsized":"2024-04-01T23:00:55.230632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:04:48.921372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":7884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'32","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.711128+0000","last_change":"2024-04-01T22:33:27.855387+0000","last_active":"2024-04-01T23:01:32.711128+0000","last_peered":"2024-04-01T23:01:32.711128+0000","last_clean":"2024-04-01T23:01:32.711128+0000","last_became_active":"2024-04-01T22:33:27.855123+0000","last_became_peered":"2024-04-01T22:33:27.855123+0000","last_unstale":"2024-04-01T23:01:32.711128+0000","last_undegraded":"2024-04-01T23:01:32.711128+0000","last_fullsized":"2024-04-01T23:01:32.711128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:16:58.889368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'1","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:14.096774+0000","last_change":"2024-04-01T22:33:26.848128+0000","last_active":"2024-04-01T23:01:14.096774+0000","last_peered":"2024-04-01T23:01:14.096774+0000","last_clean":"2024-04-01T23:01:14.096774+0000","last_became_active":"2024-04-01T22:33:26.847904+0000","last_became_peered":"2024-04-01T22:33:26.847904+0000","last_unstale":"2024-04-01T23:01:14.096774+0000","last_undegraded":"2024-04-01T23:01:14.096774+0000","last_fullsized":"2024-04-01T23:01:14.096774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:41:58.838710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'122","reported_seq":146,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.936244+0000","last_change":"2024-04-01T22:34:05.290215+0000","last_active":"2024-04-01T23:00:58.936244+0000","last_peered":"2024-04-01T23:00:58.936244+0000","last_clean":"2024-04-01T23:00:58.936244+0000","last_became_active":"2024-04-01T22:34:05.289769+0000","last_became_peered":"2024-04-01T22:34:05.289769+0000","last_unstale":"2024-04-01T23:00:58.936244+0000","last_undegraded":"2024-04-01T23:00:58.936244+0000","last_fullsized":"2024-04-01T23:00:58.936244+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:39:33.591520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":7582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,7],"acting":[2,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"27'32","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.632757+0000","last_change":"2024-04-01T22:33:27.868997+0000","last_active":"2024-04-01T23:01:32.632757+0000","last_peered":"2024-04-01T23:01:32.632757+0000","last_clean":"2024-04-01T23:01:32.632757+0000","last_became_active":"2024-04-01T22:33:27.868713+0000","last_became_peered":"2024-04-01T22:33:27.868713+0000","last_unstale":"2024-04-01T23:01:32.632757+0000","last_undegraded":"2024-04-01T23:01:32.632757+0000","last_fullsized":"2024-04-01T23:01:32.632757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:41:59.967183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'5","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:25.553755+0000","last_change":"2024-04-01T22:33:26.848037+0000","last_active":"2024-04-01T23:01:25.553755+0000","last_peered":"2024-04-01T23:01:25.553755+0000","last_clean":"2024-04-01T23:01:25.553755+0000","last_became_active":"2024-04-01T22:33:26.847736+0000","last_became_peered":"2024-04-01T22:33:26.847736+0000","last_unstale":"2024-04-01T23:01:25.553755+0000","last_undegraded":"2024-04-01T23:01:25.553755+0000","last_fullsized":"2024-04-01T23:01:25.553755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:56:04.675231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'108","reported_seq":138,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.933263+0000","last_change":"2024-04-01T22:33:32.847015+0000","last_active":"2024-04-01T23:00:58.933263+0000","last_peered":"2024-04-01T23:00:58.933263+0000","last_clean":"2024-04-01T23:00:58.933263+0000","last_became_active":"2024-04-01T22:33:32.846639+0000","last_became_peered":"2024-04-01T22:33:32.846639+0000","last_unstale":"2024-04-01T23:00:58.933263+0000","last_undegraded":"2024-04-01T23:00:58.933263+0000","last_fullsized":"2024-04-01T23:00:58.933263+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:47:09.903506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":8005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'39","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.807706+0000","last_change":"2024-04-01T22:33:27.948117+0000","last_active":"2024-04-01T23:01:32.807706+0000","last_peered":"2024-04-01T23:01:32.807706+0000","last_clean":"2024-04-01T23:01:32.807706+0000","last_became_active":"2024-04-01T22:33:27.947735+0000","last_became_peered":"2024-04-01T22:33:27.947735+0000","last_unstale":"2024-04-01T23:01:32.807706+0000","last_undegraded":"2024-04-01T23:01:32.807706+0000","last_fullsized":"2024-04-01T23:01:32.807706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:16:58.889368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'9","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:26.524501+0000","last_change":"2024-04-01T22:33:26.849404+0000","last_active":"2024-04-01T23:01:26.524501+0000","last_peered":"2024-04-01T23:01:26.524501+0000","last_clean":"2024-04-01T23:01:26.524501+0000","last_became_active":"2024-04-01T22:33:26.849086+0000","last_became_peered":"2024-04-01T22:33:26.849086+0000","last_unstale":"2024-04-01T23:01:26.524501+0000","last_undegraded":"2024-04-01T23:01:26.524501+0000","last_fullsized":"2024-04-01T23:01:26.524501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:41:58.838710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'117","reported_seq":148,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.933305+0000","last_change":"2024-04-01T22:33:33.249726+0000","last_active":"2024-04-01T23:00:58.933305+0000","last_peered":"2024-04-01T23:00:58.933305+0000","last_clean":"2024-04-01T23:00:58.933305+0000","last_became_active":"2024-04-01T22:33:33.249309+0000","last_became_peered":"2024-04-01T22:33:33.249309+0000","last_unstale":"2024-04-01T23:00:58.933305+0000","last_undegraded":"2024-04-01T23:00:58.933305+0000","last_fullsized":"2024-04-01T23:00:58.933305+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:08:20.364843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":13518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'31","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.707509+0000","last_change":"2024-04-01T22:33:27.879797+0000","last_active":"2024-04-01T23:01:32.707509+0000","last_peered":"2024-04-01T23:01:32.707509+0000","last_clean":"2024-04-01T23:01:32.707509+0000","last_became_active":"2024-04-01T22:33:27.879582+0000","last_became_peered":"2024-04-01T22:33:27.879582+0000","last_unstale":"2024-04-01T23:01:32.707509+0000","last_undegraded":"2024-04-01T23:01:32.707509+0000","last_fullsized":"2024-04-01T23:01:32.707509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:08:15.465415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'1318","reported_seq":1357,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:29.261176+0000","last_change":"2024-04-01T22:33:26.847504+0000","last_active":"2024-04-01T23:01:29.261176+0000","last_peered":"2024-04-01T23:01:29.261176+0000","last_clean":"2024-04-01T23:01:29.261176+0000","last_became_active":"2024-04-01T22:33:26.847333+0000","last_became_peered":"2024-04-01T22:33:26.847333+0000","last_unstale":"2024-04-01T23:01:29.261176+0000","last_undegraded":"2024-04-01T23:01:29.261176+0000","last_fullsized":"2024-04-01T23:01:29.261176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":1318,"log_dups_size":0,"ondisk_log_size":1318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:39:29.846272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3324,"num_write_kb":1182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'132","reported_seq":164,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.922776+0000","last_change":"2024-04-01T22:33:33.255030+0000","last_active":"2024-04-01T23:00:58.922776+0000","last_peered":"2024-04-01T23:00:58.922776+0000","last_clean":"2024-04-01T23:00:58.922776+0000","last_became_active":"2024-04-01T22:33:33.254621+0000","last_became_peered":"2024-04-01T22:33:33.254621+0000","last_unstale":"2024-04-01T23:00:58.922776+0000","last_undegraded":"2024-04-01T23:00:58.922776+0000","last_fullsized":"2024-04-01T23:00:58.922776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:19:44.325870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":7706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'30","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.628328+0000","last_change":"2024-04-01T22:33:27.855669+0000","last_active":"2024-04-01T23:01:32.628328+0000","last_peered":"2024-04-01T23:01:32.628328+0000","last_clean":"2024-04-01T23:01:32.628328+0000","last_became_active":"2024-04-01T22:33:27.855419+0000","last_became_peered":"2024-04-01T22:33:27.855419+0000","last_unstale":"2024-04-01T23:01:32.628328+0000","last_undegraded":"2024-04-01T23:01:32.628328+0000","last_fullsized":"2024-04-01T23:01:32.628328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:15:46.224658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:20.447485+0000","last_change":"2024-04-01T22:33:26.850176+0000","last_active":"2024-04-01T23:01:20.447485+0000","last_peered":"2024-04-01T23:01:20.447485+0000","last_clean":"2024-04-01T23:01:20.447485+0000","last_became_active":"2024-04-01T22:33:26.849717+0000","last_became_peered":"2024-04-01T22:33:26.849717+0000","last_unstale":"2024-04-01T23:01:20.447485+0000","last_undegraded":"2024-04-01T23:01:20.447485+0000","last_fullsized":"2024-04-01T23:01:20.447485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:18:55.842886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'123","reported_seq":154,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.513385+0000","last_change":"2024-04-01T22:33:33.249765+0000","last_active":"2024-04-01T23:00:58.513385+0000","last_peered":"2024-04-01T23:00:58.513385+0000","last_clean":"2024-04-01T23:00:58.513385+0000","last_became_active":"2024-04-01T22:33:33.249370+0000","last_became_peered":"2024-04-01T22:33:33.249370+0000","last_unstale":"2024-04-01T23:00:58.513385+0000","last_undegraded":"2024-04-01T23:00:58.513385+0000","last_fullsized":"2024-04-01T23:00:58.513385+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:41:50.766262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":9230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'30","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.673401+0000","last_change":"2024-04-01T22:33:27.979163+0000","last_active":"2024-04-01T23:01:32.673401+0000","last_peered":"2024-04-01T23:01:32.673401+0000","last_clean":"2024-04-01T23:01:32.673401+0000","last_became_active":"2024-04-01T22:33:27.978902+0000","last_became_peered":"2024-04-01T22:33:27.978902+0000","last_unstale":"2024-04-01T23:01:32.673401+0000","last_undegraded":"2024-04-01T23:01:32.673401+0000","last_fullsized":"2024-04-01T23:01:32.673401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:04:44.021944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'1","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:32.501046+0000","last_change":"2024-04-01T22:33:26.846575+0000","last_active":"2024-04-01T23:00:32.501046+0000","last_peered":"2024-04-01T23:00:32.501046+0000","last_clean":"2024-04-01T23:00:32.501046+0000","last_became_active":"2024-04-01T22:33:26.846265+0000","last_became_peered":"2024-04-01T22:33:26.846265+0000","last_unstale":"2024-04-01T23:00:32.501046+0000","last_undegraded":"2024-04-01T23:00:32.501046+0000","last_fullsized":"2024-04-01T23:00:32.501046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:56:04.675231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'159","reported_seq":190,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.943492+0000","last_change":"2024-04-01T22:33:32.850553+0000","last_active":"2024-04-01T23:00:58.943492+0000","last_peered":"2024-04-01T23:00:58.943492+0000","last_clean":"2024-04-01T23:00:58.943492+0000","last_became_active":"2024-04-01T22:33:32.849774+0000","last_became_peered":"2024-04-01T22:33:32.849774+0000","last_unstale":"2024-04-01T23:00:58.943492+0000","last_undegraded":"2024-04-01T23:00:58.943492+0000","last_fullsized":"2024-04-01T23:00:58.943492+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:04:48.921372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":7876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'30","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.632532+0000","last_change":"2024-04-01T22:33:27.949879+0000","last_active":"2024-04-01T23:01:32.632532+0000","last_peered":"2024-04-01T23:01:32.632532+0000","last_clean":"2024-04-01T23:01:32.632532+0000","last_became_active":"2024-04-01T22:33:27.949620+0000","last_became_peered":"2024-04-01T22:33:27.949620+0000","last_unstale":"2024-04-01T23:01:32.632532+0000","last_undegraded":"2024-04-01T23:01:32.632532+0000","last_fullsized":"2024-04-01T23:01:32.632532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:49:52.536559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'4","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:14.050511+0000","last_change":"2024-04-01T22:33:26.846346+0000","last_active":"2024-04-01T23:01:14.050511+0000","last_peered":"2024-04-01T23:01:14.050511+0000","last_clean":"2024-04-01T23:01:14.050511+0000","last_became_active":"2024-04-01T22:33:26.846052+0000","last_became_peered":"2024-04-01T22:33:26.846052+0000","last_unstale":"2024-04-01T23:01:14.050511+0000","last_undegraded":"2024-04-01T23:01:14.050511+0000","last_fullsized":"2024-04-01T23:01:14.050511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:41:58.838710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'111","reported_seq":142,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:59.673722+0000","last_change":"2024-04-01T22:33:32.846766+0000","last_active":"2024-04-01T23:00:59.673722+0000","last_peered":"2024-04-01T23:00:59.673722+0000","last_clean":"2024-04-01T23:00:59.673722+0000","last_became_active":"2024-04-01T22:33:32.846422+0000","last_became_peered":"2024-04-01T22:33:32.846422+0000","last_unstale":"2024-04-01T23:00:59.673722+0000","last_undegraded":"2024-04-01T23:00:59.673722+0000","last_fullsized":"2024-04-01T23:00:59.673722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:41:50.766262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":8847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'31","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.628334+0000","last_change":"2024-04-01T22:33:27.855299+0000","last_active":"2024-04-01T23:01:32.628334+0000","last_peered":"2024-04-01T23:01:32.628334+0000","last_clean":"2024-04-01T23:01:32.628334+0000","last_became_active":"2024-04-01T22:33:27.855035+0000","last_became_peered":"2024-04-01T22:33:27.855035+0000","last_unstale":"2024-04-01T23:01:32.628334+0000","last_undegraded":"2024-04-01T23:01:32.628334+0000","last_fullsized":"2024-04-01T23:01:32.628334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:48:53.083180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'821","reported_seq":1676,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:29.533240+0000","last_change":"2024-04-01T22:33:26.856300+0000","last_active":"2024-04-01T23:01:29.533240+0000","last_peered":"2024-04-01T23:01:29.533240+0000","last_clean":"2024-04-01T23:01:29.533240+0000","last_became_active":"2024-04-01T22:33:26.855864+0000","last_became_peered":"2024-04-01T22:33:26.855864+0000","last_unstale":"2024-04-01T23:01:29.533240+0000","last_undegraded":"2024-04-01T23:01:29.533240+0000","last_fullsized":"2024-04-01T23:01:29.533240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":821,"log_dups_size":0,"ondisk_log_size":821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:38:14.576161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188865,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":816,"num_read_kb":876,"num_write":818,"num_write_kb":878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'133","reported_seq":157,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:53.580097+0000","last_change":"2024-04-01T22:34:05.317101+0000","last_active":"2024-04-01T23:00:53.580097+0000","last_peered":"2024-04-01T23:00:53.580097+0000","last_clean":"2024-04-01T23:00:53.580097+0000","last_became_active":"2024-04-01T22:34:05.316665+0000","last_became_peered":"2024-04-01T22:34:05.316665+0000","last_unstale":"2024-04-01T23:00:53.580097+0000","last_undegraded":"2024-04-01T23:00:53.580097+0000","last_fullsized":"2024-04-01T23:00:53.580097+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:47:09.903506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":5930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"27'23","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.807554+0000","last_change":"2024-04-01T22:33:27.949013+0000","last_active":"2024-04-01T23:01:32.807554+0000","last_peered":"2024-04-01T23:01:32.807554+0000","last_clean":"2024-04-01T23:01:32.807554+0000","last_became_active":"2024-04-01T22:33:27.948687+0000","last_became_peered":"2024-04-01T22:33:27.948687+0000","last_unstale":"2024-04-01T23:01:32.807554+0000","last_undegraded":"2024-04-01T23:01:32.807554+0000","last_fullsized":"2024-04-01T23:01:32.807554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:50:54.852207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'280","reported_seq":320,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.906776+0000","last_change":"2024-04-01T22:33:26.848366+0000","last_active":"2024-04-01T23:01:32.906776+0000","last_peered":"2024-04-01T23:01:32.906776+0000","last_clean":"2024-04-01T23:01:32.906776+0000","last_became_active":"2024-04-01T22:33:26.848019+0000","last_became_peered":"2024-04-01T22:33:26.848019+0000","last_unstale":"2024-04-01T23:01:32.906776+0000","last_undegraded":"2024-04-01T23:01:32.906776+0000","last_fullsized":"2024-04-01T23:01:32.906776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:41:58.838710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2901821,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":275,"num_write_kb":2970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'118","reported_seq":148,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:56.100787+0000","last_change":"2024-04-01T22:33:33.253077+0000","last_active":"2024-04-01T23:00:56.100787+0000","last_peered":"2024-04-01T23:00:56.100787+0000","last_clean":"2024-04-01T23:00:56.100787+0000","last_became_active":"2024-04-01T22:33:33.252725+0000","last_became_peered":"2024-04-01T22:33:33.252725+0000","last_unstale":"2024-04-01T23:00:56.100787+0000","last_undegraded":"2024-04-01T23:00:56.100787+0000","last_fullsized":"2024-04-01T23:00:56.100787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:28:17.970808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":6978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'30","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.708903+0000","last_change":"2024-04-01T22:33:27.975039+0000","last_active":"2024-04-01T23:01:32.708903+0000","last_peered":"2024-04-01T23:01:32.708903+0000","last_clean":"2024-04-01T23:01:32.708903+0000","last_became_active":"2024-04-01T22:33:27.974751+0000","last_became_peered":"2024-04-01T22:33:27.974751+0000","last_unstale":"2024-04-01T23:01:32.708903+0000","last_undegraded":"2024-04-01T23:01:32.708903+0000","last_fullsized":"2024-04-01T23:01:32.708903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:43:03.166262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:16.445098+0000","last_change":"2024-04-01T22:33:26.831690+0000","last_active":"2024-04-01T23:01:16.445098+0000","last_peered":"2024-04-01T23:01:16.445098+0000","last_clean":"2024-04-01T23:01:16.445098+0000","last_became_active":"2024-04-01T22:33:26.831398+0000","last_became_peered":"2024-04-01T22:33:26.831398+0000","last_unstale":"2024-04-01T23:01:16.445098+0000","last_undegraded":"2024-04-01T23:01:16.445098+0000","last_fullsized":"2024-04-01T23:01:16.445098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:38:14.576161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":196,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:59:22.388655+0000","last_change":"2024-04-01T22:33:15.962585+0000","last_active":"2024-04-01T22:59:22.388655+0000","last_peered":"2024-04-01T22:59:22.388655+0000","last_clean":"2024-04-01T22:59:22.388655+0000","last_became_active":"2024-04-01T22:33:15.961762+0000","last_became_peered":"2024-04-01T22:33:15.961762+0000","last_unstale":"2024-04-01T22:59:22.388655+0000","last_undegraded":"2024-04-01T22:59:22.388655+0000","last_fullsized":"2024-04-01T22:59:22.388655+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:13.756389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:13.756389+0000","last_clean_scrub_stamp":"2024-04-01T22:33:13.756389+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:33:28.684533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'139","reported_seq":170,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.536776+0000","last_change":"2024-04-01T22:33:33.252863+0000","last_active":"2024-04-01T23:00:58.536776+0000","last_peered":"2024-04-01T23:00:58.536776+0000","last_clean":"2024-04-01T23:00:58.536776+0000","last_became_active":"2024-04-01T22:33:33.252494+0000","last_became_peered":"2024-04-01T22:33:33.252494+0000","last_unstale":"2024-04-01T23:00:58.536776+0000","last_undegraded":"2024-04-01T23:00:58.536776+0000","last_fullsized":"2024-04-01T23:00:58.536776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:47:09.903506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":7634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'31","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.782041+0000","last_change":"2024-04-01T22:34:04.937211+0000","last_active":"2024-04-01T23:01:32.782041+0000","last_peered":"2024-04-01T23:01:32.782041+0000","last_clean":"2024-04-01T23:01:32.782041+0000","last_became_active":"2024-04-01T22:34:04.936886+0000","last_became_peered":"2024-04-01T22:34:04.936886+0000","last_unstale":"2024-04-01T23:01:32.782041+0000","last_undegraded":"2024-04-01T23:01:32.782041+0000","last_fullsized":"2024-04-01T23:01:32.782041+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:53:33.542832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'6","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:22.420377+0000","last_change":"2024-04-01T22:33:26.832331+0000","last_active":"2024-04-01T23:01:22.420377+0000","last_peered":"2024-04-01T23:01:22.420377+0000","last_clean":"2024-04-01T23:01:22.420377+0000","last_became_active":"2024-04-01T22:33:26.832078+0000","last_became_peered":"2024-04-01T22:33:26.832078+0000","last_unstale":"2024-04-01T23:01:22.420377+0000","last_undegraded":"2024-04-01T23:01:22.420377+0000","last_fullsized":"2024-04-01T23:01:22.420377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:40:49.124240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'107","reported_seq":137,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:53.619717+0000","last_change":"2024-04-01T22:33:33.249696+0000","last_active":"2024-04-01T23:00:53.619717+0000","last_peered":"2024-04-01T23:00:53.619717+0000","last_clean":"2024-04-01T23:00:53.619717+0000","last_became_active":"2024-04-01T22:33:33.249313+0000","last_became_peered":"2024-04-01T22:33:33.249313+0000","last_unstale":"2024-04-01T23:00:53.619717+0000","last_undegraded":"2024-04-01T23:00:53.619717+0000","last_fullsized":"2024-04-01T23:00:53.619717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:39:33.591520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":3624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'31","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.640645+0000","last_change":"2024-04-01T22:33:27.971916+0000","last_active":"2024-04-01T23:01:32.640645+0000","last_peered":"2024-04-01T23:01:32.640645+0000","last_clean":"2024-04-01T23:01:32.640645+0000","last_became_active":"2024-04-01T22:33:27.971672+0000","last_became_peered":"2024-04-01T22:33:27.971672+0000","last_unstale":"2024-04-01T23:01:32.640645+0000","last_undegraded":"2024-04-01T23:01:32.640645+0000","last_fullsized":"2024-04-01T23:01:32.640645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:43:39.489075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:27.500628+0000","last_change":"2024-04-01T22:33:26.849350+0000","last_active":"2024-04-01T23:00:27.500628+0000","last_peered":"2024-04-01T23:00:27.500628+0000","last_clean":"2024-04-01T23:00:27.500628+0000","last_became_active":"2024-04-01T22:33:26.849098+0000","last_became_peered":"2024-04-01T22:33:26.849098+0000","last_unstale":"2024-04-01T23:00:27.500628+0000","last_undegraded":"2024-04-01T23:00:27.500628+0000","last_fullsized":"2024-04-01T23:00:27.500628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:47:18.407469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'171","reported_seq":201,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:56.100414+0000","last_change":"2024-04-01T22:33:32.847889+0000","last_active":"2024-04-01T23:00:56.100414+0000","last_peered":"2024-04-01T23:00:56.100414+0000","last_clean":"2024-04-01T23:00:56.100414+0000","last_became_active":"2024-04-01T22:33:32.847546+0000","last_became_peered":"2024-04-01T22:33:32.847546+0000","last_unstale":"2024-04-01T23:00:56.100414+0000","last_undegraded":"2024-04-01T23:00:56.100414+0000","last_fullsized":"2024-04-01T23:00:56.100414+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:57:05.158344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":10714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'32","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.781608+0000","last_change":"2024-04-01T22:33:27.881170+0000","last_active":"2024-04-01T23:01:32.781608+0000","last_peered":"2024-04-01T23:01:32.781608+0000","last_clean":"2024-04-01T23:01:32.781608+0000","last_became_active":"2024-04-01T22:33:27.880870+0000","last_became_peered":"2024-04-01T22:33:27.880870+0000","last_unstale":"2024-04-01T23:01:32.781608+0000","last_undegraded":"2024-04-01T23:01:32.781608+0000","last_fullsized":"2024-04-01T23:01:32.781608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:43:39.489075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'5","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:22.420216+0000","last_change":"2024-04-01T22:33:26.856069+0000","last_active":"2024-04-01T23:01:22.420216+0000","last_peered":"2024-04-01T23:01:22.420216+0000","last_clean":"2024-04-01T23:01:22.420216+0000","last_became_active":"2024-04-01T22:33:26.855705+0000","last_became_peered":"2024-04-01T22:33:26.855705+0000","last_unstale":"2024-04-01T23:01:22.420216+0000","last_undegraded":"2024-04-01T23:01:22.420216+0000","last_fullsized":"2024-04-01T23:01:22.420216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:56:04.675231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'124","reported_seq":154,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.930624+0000","last_change":"2024-04-01T22:33:33.249689+0000","last_active":"2024-04-01T23:00:58.930624+0000","last_peered":"2024-04-01T23:00:58.930624+0000","last_clean":"2024-04-01T23:00:58.930624+0000","last_became_active":"2024-04-01T22:33:33.249315+0000","last_became_peered":"2024-04-01T22:33:33.249315+0000","last_unstale":"2024-04-01T23:00:58.930624+0000","last_undegraded":"2024-04-01T23:00:58.930624+0000","last_fullsized":"2024-04-01T23:00:58.930624+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:19:44.325870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":11773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'20","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.779728+0000","last_change":"2024-04-01T22:33:27.881320+0000","last_active":"2024-04-01T23:01:32.779728+0000","last_peered":"2024-04-01T23:01:32.779728+0000","last_clean":"2024-04-01T23:01:32.779728+0000","last_became_active":"2024-04-01T22:33:27.880973+0000","last_became_peered":"2024-04-01T22:33:27.880973+0000","last_unstale":"2024-04-01T23:01:32.779728+0000","last_undegraded":"2024-04-01T23:01:32.779728+0000","last_fullsized":"2024-04-01T23:01:32.779728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:04:44.021944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:16.450936+0000","last_change":"2024-04-01T22:33:26.845121+0000","last_active":"2024-04-01T23:01:16.450936+0000","last_peered":"2024-04-01T23:01:16.450936+0000","last_clean":"2024-04-01T23:01:16.450936+0000","last_became_active":"2024-04-01T22:33:26.844852+0000","last_became_peered":"2024-04-01T22:33:26.844852+0000","last_unstale":"2024-04-01T23:01:16.450936+0000","last_undegraded":"2024-04-01T23:01:16.450936+0000","last_fullsized":"2024-04-01T23:01:16.450936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:58:40.837557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'146","reported_seq":176,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.525170+0000","last_change":"2024-04-01T22:33:32.846922+0000","last_active":"2024-04-01T23:00:58.525170+0000","last_peered":"2024-04-01T23:00:58.525170+0000","last_clean":"2024-04-01T23:00:58.525170+0000","last_became_active":"2024-04-01T22:33:32.846387+0000","last_became_peered":"2024-04-01T22:33:32.846387+0000","last_unstale":"2024-04-01T23:00:58.525170+0000","last_undegraded":"2024-04-01T23:00:58.525170+0000","last_fullsized":"2024-04-01T23:00:58.525170+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:08:05.436698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":12308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'32","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.775880+0000","last_change":"2024-04-01T22:33:27.884447+0000","last_active":"2024-04-01T23:01:32.775880+0000","last_peered":"2024-04-01T23:01:32.775880+0000","last_clean":"2024-04-01T23:01:32.775880+0000","last_became_active":"2024-04-01T22:33:27.884148+0000","last_became_peered":"2024-04-01T22:33:27.884148+0000","last_unstale":"2024-04-01T23:01:32.775880+0000","last_undegraded":"2024-04-01T23:01:32.775880+0000","last_fullsized":"2024-04-01T23:01:32.775880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:08:00.537270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'16","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:27.271938+0000","last_change":"2024-04-01T22:33:26.844884+0000","last_active":"2024-04-01T23:01:27.271938+0000","last_peered":"2024-04-01T23:01:27.271938+0000","last_clean":"2024-04-01T23:01:27.271938+0000","last_became_active":"2024-04-01T22:33:26.844583+0000","last_became_peered":"2024-04-01T22:33:26.844583+0000","last_unstale":"2024-04-01T23:01:27.271938+0000","last_undegraded":"2024-04-01T23:01:27.271938+0000","last_fullsized":"2024-04-01T23:01:27.271938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:25:41.744696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'120","reported_seq":149,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.510554+0000","last_change":"2024-04-01T22:33:32.845036+0000","last_active":"2024-04-01T23:00:58.510554+0000","last_peered":"2024-04-01T23:00:58.510554+0000","last_clean":"2024-04-01T23:00:58.510554+0000","last_became_active":"2024-04-01T22:33:32.844555+0000","last_became_peered":"2024-04-01T22:33:32.844555+0000","last_unstale":"2024-04-01T23:00:58.510554+0000","last_undegraded":"2024-04-01T23:00:58.510554+0000","last_fullsized":"2024-04-01T23:00:58.510554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:43:44.388503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":6363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'25","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.635084+0000","last_change":"2024-04-01T22:33:27.950227+0000","last_active":"2024-04-01T23:01:32.635084+0000","last_peered":"2024-04-01T23:01:32.635084+0000","last_clean":"2024-04-01T23:01:32.635084+0000","last_became_active":"2024-04-01T22:33:27.949366+0000","last_became_peered":"2024-04-01T22:33:27.949366+0000","last_unstale":"2024-04-01T23:01:32.635084+0000","last_undegraded":"2024-04-01T23:01:32.635084+0000","last_fullsized":"2024-04-01T23:01:32.635084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:16:58.889368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'3","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:16.386180+0000","last_change":"2024-04-01T22:33:26.830463+0000","last_active":"2024-04-01T23:01:16.386180+0000","last_peered":"2024-04-01T23:01:16.386180+0000","last_clean":"2024-04-01T23:01:16.386180+0000","last_became_active":"2024-04-01T22:33:26.830179+0000","last_became_peered":"2024-04-01T22:33:26.830179+0000","last_unstale":"2024-04-01T23:01:16.386180+0000","last_undegraded":"2024-04-01T23:01:16.386180+0000","last_fullsized":"2024-04-01T23:01:16.386180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:38:14.576161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'118","reported_seq":147,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:55.150889+0000","last_change":"2024-04-01T22:33:33.252812+0000","last_active":"2024-04-01T23:00:55.150889+0000","last_peered":"2024-04-01T23:00:55.150889+0000","last_clean":"2024-04-01T23:00:55.150889+0000","last_became_active":"2024-04-01T22:33:33.252412+0000","last_became_peered":"2024-04-01T22:33:33.252412+0000","last_unstale":"2024-04-01T23:00:55.150889+0000","last_undegraded":"2024-04-01T23:00:55.150889+0000","last_fullsized":"2024-04-01T23:00:55.150889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:53:38.442260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":10338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'44","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.782716+0000","last_change":"2024-04-01T22:33:27.880363+0000","last_active":"2024-04-01T23:01:32.782716+0000","last_peered":"2024-04-01T23:01:32.782716+0000","last_clean":"2024-04-01T23:01:32.782716+0000","last_became_active":"2024-04-01T22:33:27.880096+0000","last_became_peered":"2024-04-01T22:33:27.880096+0000","last_unstale":"2024-04-01T23:01:32.782716+0000","last_undegraded":"2024-04-01T23:01:32.782716+0000","last_fullsized":"2024-04-01T23:01:32.782716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:19:20.248510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'6","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:25.556353+0000","last_change":"2024-04-01T22:33:26.855823+0000","last_active":"2024-04-01T23:01:25.556353+0000","last_peered":"2024-04-01T23:01:25.556353+0000","last_clean":"2024-04-01T23:01:25.556353+0000","last_became_active":"2024-04-01T22:33:26.855475+0000","last_became_peered":"2024-04-01T22:33:26.855475+0000","last_unstale":"2024-04-01T23:01:25.556353+0000","last_undegraded":"2024-04-01T23:01:25.556353+0000","last_fullsized":"2024-04-01T23:01:25.556353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:39:29.846272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'90","reported_seq":120,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:00.654216+0000","last_change":"2024-04-01T22:33:33.249941+0000","last_active":"2024-04-01T23:01:00.654216+0000","last_peered":"2024-04-01T23:01:00.654216+0000","last_clean":"2024-04-01T23:01:00.654216+0000","last_became_active":"2024-04-01T22:33:33.249352+0000","last_became_peered":"2024-04-01T22:33:33.249352+0000","last_unstale":"2024-04-01T23:01:00.654216+0000","last_undegraded":"2024-04-01T23:01:00.654216+0000","last_fullsized":"2024-04-01T23:01:00.654216+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:36:10.226231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":8688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'34","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.805613+0000","last_change":"2024-04-01T22:33:27.948988+0000","last_active":"2024-04-01T23:01:32.805613+0000","last_peered":"2024-04-01T23:01:32.805613+0000","last_clean":"2024-04-01T23:01:32.805613+0000","last_became_active":"2024-04-01T22:33:27.948691+0000","last_became_peered":"2024-04-01T22:33:27.948691+0000","last_unstale":"2024-04-01T23:01:32.805613+0000","last_undegraded":"2024-04-01T23:01:32.805613+0000","last_fullsized":"2024-04-01T23:01:32.805613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:23:08.563134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'9","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:20.451103+0000","last_change":"2024-04-01T22:33:26.849911+0000","last_active":"2024-04-01T23:01:20.451103+0000","last_peered":"2024-04-01T23:01:20.451103+0000","last_clean":"2024-04-01T23:01:20.451103+0000","last_became_active":"2024-04-01T22:33:26.849646+0000","last_became_peered":"2024-04-01T22:33:26.849646+0000","last_unstale":"2024-04-01T23:01:20.451103+0000","last_undegraded":"2024-04-01T23:01:20.451103+0000","last_fullsized":"2024-04-01T23:01:20.451103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:29:59.992702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'119","reported_seq":148,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:00.657163+0000","last_change":"2024-04-01T22:33:33.250214+0000","last_active":"2024-04-01T23:01:00.657163+0000","last_peered":"2024-04-01T23:01:00.657163+0000","last_clean":"2024-04-01T23:01:00.657163+0000","last_became_active":"2024-04-01T22:33:33.249853+0000","last_became_peered":"2024-04-01T22:33:33.249853+0000","last_unstale":"2024-04-01T23:01:00.657163+0000","last_undegraded":"2024-04-01T23:01:00.657163+0000","last_fullsized":"2024-04-01T23:01:00.657163+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:57:12.343606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":9692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'28","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.618088+0000","last_change":"2024-04-01T22:34:04.898357+0000","last_active":"2024-04-01T23:01:32.618088+0000","last_peered":"2024-04-01T23:01:32.618088+0000","last_clean":"2024-04-01T23:01:32.618088+0000","last_became_active":"2024-04-01T22:34:04.898014+0000","last_became_peered":"2024-04-01T22:34:04.898014+0000","last_unstale":"2024-04-01T23:01:32.618088+0000","last_undegraded":"2024-04-01T23:01:32.618088+0000","last_fullsized":"2024-04-01T23:01:32.618088+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:56:25.952727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.14","version":"27'845","reported_seq":883,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:27.449649+0000","last_change":"2024-04-01T22:33:26.855687+0000","last_active":"2024-04-01T23:01:27.449649+0000","last_peered":"2024-04-01T23:01:27.449649+0000","last_clean":"2024-04-01T23:01:27.449649+0000","last_became_active":"2024-04-01T22:33:26.855400+0000","last_became_peered":"2024-04-01T22:33:26.855400+0000","last_unstale":"2024-04-01T23:01:27.449649+0000","last_undegraded":"2024-04-01T23:01:27.449649+0000","last_fullsized":"2024-04-01T23:01:27.449649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:39:29.846272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":842,"num_write_kb":4541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'128","reported_seq":158,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:59.671035+0000","last_change":"2024-04-01T22:33:32.846727+0000","last_active":"2024-04-01T23:00:59.671035+0000","last_peered":"2024-04-01T23:00:59.671035+0000","last_clean":"2024-04-01T23:00:59.671035+0000","last_became_active":"2024-04-01T22:33:32.846156+0000","last_became_peered":"2024-04-01T22:33:32.846156+0000","last_unstale":"2024-04-01T23:00:59.671035+0000","last_undegraded":"2024-04-01T23:00:59.671035+0000","last_fullsized":"2024-04-01T23:00:59.671035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:57:05.158344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":9107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'28","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.637662+0000","last_change":"2024-04-01T22:33:27.879445+0000","last_active":"2024-04-01T23:01:32.637662+0000","last_peered":"2024-04-01T23:01:32.637662+0000","last_clean":"2024-04-01T23:01:32.637662+0000","last_became_active":"2024-04-01T22:33:27.879165+0000","last_became_peered":"2024-04-01T22:33:27.879165+0000","last_unstale":"2024-04-01T23:01:32.637662+0000","last_undegraded":"2024-04-01T23:01:32.637662+0000","last_fullsized":"2024-04-01T23:01:32.637662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:18:56.971360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'573","reported_seq":610,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:26.527933+0000","last_change":"2024-04-01T22:33:26.851767+0000","last_active":"2024-04-01T23:01:26.527933+0000","last_peered":"2024-04-01T23:01:26.527933+0000","last_clean":"2024-04-01T23:01:26.527933+0000","last_became_active":"2024-04-01T22:33:26.851489+0000","last_became_peered":"2024-04-01T22:33:26.851489+0000","last_unstale":"2024-04-01T23:01:26.527933+0000","last_undegraded":"2024-04-01T23:01:26.527933+0000","last_fullsized":"2024-04-01T23:01:26.527933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":573,"log_dups_size":0,"ondisk_log_size":573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:49:51.408086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":569,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'166","reported_seq":196,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:00.657960+0000","last_change":"2024-04-01T22:33:32.846386+0000","last_active":"2024-04-01T23:01:00.657960+0000","last_peered":"2024-04-01T23:01:00.657960+0000","last_clean":"2024-04-01T23:01:00.657960+0000","last_became_active":"2024-04-01T22:33:32.846024+0000","last_became_peered":"2024-04-01T22:33:32.846024+0000","last_unstale":"2024-04-01T23:01:00.657960+0000","last_undegraded":"2024-04-01T23:01:00.657960+0000","last_fullsized":"2024-04-01T23:01:00.657960+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:39:33.591520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":22198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'35","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.807582+0000","last_change":"2024-04-01T22:33:27.974120+0000","last_active":"2024-04-01T23:01:32.807582+0000","last_peered":"2024-04-01T23:01:32.807582+0000","last_clean":"2024-04-01T23:01:32.807582+0000","last_became_active":"2024-04-01T22:33:27.973846+0000","last_became_peered":"2024-04-01T22:33:27.973846+0000","last_unstale":"2024-04-01T23:01:32.807582+0000","last_undegraded":"2024-04-01T23:01:32.807582+0000","last_fullsized":"2024-04-01T23:01:32.807582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:15:46.224658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'8","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:22.423540+0000","last_change":"2024-04-01T22:33:26.831927+0000","last_active":"2024-04-01T23:01:22.423540+0000","last_peered":"2024-04-01T23:01:22.423540+0000","last_clean":"2024-04-01T23:01:22.423540+0000","last_became_active":"2024-04-01T22:33:26.831676+0000","last_became_peered":"2024-04-01T22:33:26.831676+0000","last_unstale":"2024-04-01T23:01:22.423540+0000","last_undegraded":"2024-04-01T23:01:22.423540+0000","last_fullsized":"2024-04-01T23:01:22.423540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:40:49.124240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'96","reported_seq":126,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.522528+0000","last_change":"2024-04-01T22:33:32.849983+0000","last_active":"2024-04-01T23:00:58.522528+0000","last_peered":"2024-04-01T23:00:58.522528+0000","last_clean":"2024-04-01T23:00:58.522528+0000","last_became_active":"2024-04-01T22:33:32.849661+0000","last_became_peered":"2024-04-01T22:33:32.849661+0000","last_unstale":"2024-04-01T23:00:58.522528+0000","last_undegraded":"2024-04-01T23:00:58.522528+0000","last_fullsized":"2024-04-01T23:00:58.522528+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:41:40.370250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":9067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'37","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.685525+0000","last_change":"2024-04-01T22:33:27.972417+0000","last_active":"2024-04-01T23:01:32.685525+0000","last_peered":"2024-04-01T23:01:32.685525+0000","last_clean":"2024-04-01T23:01:32.685525+0000","last_became_active":"2024-04-01T22:33:27.972173+0000","last_became_peered":"2024-04-01T22:33:27.972173+0000","last_unstale":"2024-04-01T23:01:32.685525+0000","last_undegraded":"2024-04-01T23:01:32.685525+0000","last_fullsized":"2024-04-01T23:01:32.685525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:47:05.004078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:02.441408+0000","last_change":"2024-04-01T22:33:26.831934+0000","last_active":"2024-04-01T23:00:02.441408+0000","last_peered":"2024-04-01T23:00:02.441408+0000","last_clean":"2024-04-01T23:00:02.441408+0000","last_became_active":"2024-04-01T22:33:26.831702+0000","last_became_peered":"2024-04-01T22:33:26.831702+0000","last_unstale":"2024-04-01T23:00:02.441408+0000","last_undegraded":"2024-04-01T23:00:02.441408+0000","last_fullsized":"2024-04-01T23:00:02.441408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:56:04.675231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'144","reported_seq":174,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:00.655446+0000","last_change":"2024-04-01T22:33:33.254394+0000","last_active":"2024-04-01T23:01:00.655446+0000","last_peered":"2024-04-01T23:01:00.655446+0000","last_clean":"2024-04-01T23:01:00.655446+0000","last_became_active":"2024-04-01T22:33:33.253993+0000","last_became_peered":"2024-04-01T22:33:33.253993+0000","last_unstale":"2024-04-01T23:01:00.655446+0000","last_undegraded":"2024-04-01T23:01:00.655446+0000","last_fullsized":"2024-04-01T23:01:00.655446+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:11:05.243371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":10480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'142","reported_seq":174,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:56.101446+0000","last_change":"2024-04-01T22:33:33.253062+0000","last_active":"2024-04-01T23:00:56.101446+0000","last_peered":"2024-04-01T23:00:56.101446+0000","last_clean":"2024-04-01T23:00:56.101446+0000","last_became_active":"2024-04-01T22:33:33.252690+0000","last_became_peered":"2024-04-01T22:33:33.252690+0000","last_unstale":"2024-04-01T23:00:56.101446+0000","last_undegraded":"2024-04-01T23:00:56.101446+0000","last_fullsized":"2024-04-01T23:00:56.101446+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:04:48.921372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":7949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'40","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.629951+0000","last_change":"2024-04-01T22:33:27.855871+0000","last_active":"2024-04-01T23:01:32.629951+0000","last_peered":"2024-04-01T23:01:32.629951+0000","last_clean":"2024-04-01T23:01:32.629951+0000","last_became_active":"2024-04-01T22:33:27.855609+0000","last_became_peered":"2024-04-01T22:33:27.855609+0000","last_unstale":"2024-04-01T23:01:32.629951+0000","last_undegraded":"2024-04-01T23:01:32.629951+0000","last_fullsized":"2024-04-01T23:01:32.629951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:43:03.166262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:09.911428+0000","last_change":"2024-04-01T22:33:26.831819+0000","last_active":"2024-04-01T23:00:09.911428+0000","last_peered":"2024-04-01T23:00:09.911428+0000","last_clean":"2024-04-01T23:00:09.911428+0000","last_became_active":"2024-04-01T22:33:26.831554+0000","last_became_peered":"2024-04-01T22:33:26.831554+0000","last_unstale":"2024-04-01T23:00:09.911428+0000","last_undegraded":"2024-04-01T23:00:09.911428+0000","last_fullsized":"2024-04-01T23:00:09.911428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:56:04.675231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'135","reported_seq":166,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:56.419481+0000","last_change":"2024-04-01T22:33:32.849917+0000","last_active":"2024-04-01T23:00:56.419481+0000","last_peered":"2024-04-01T23:00:56.419481+0000","last_clean":"2024-04-01T23:00:56.419481+0000","last_became_active":"2024-04-01T22:33:32.849536+0000","last_became_peered":"2024-04-01T22:33:32.849536+0000","last_unstale":"2024-04-01T23:00:56.419481+0000","last_undegraded":"2024-04-01T23:00:56.419481+0000","last_fullsized":"2024-04-01T23:00:56.419481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:41:50.766262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":12020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'41","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.710686+0000","last_change":"2024-04-01T22:33:27.950424+0000","last_active":"2024-04-01T23:01:32.710686+0000","last_peered":"2024-04-01T23:01:32.710686+0000","last_clean":"2024-04-01T23:01:32.710686+0000","last_became_active":"2024-04-01T22:33:27.950148+0000","last_became_peered":"2024-04-01T22:33:27.950148+0000","last_unstale":"2024-04-01T23:01:32.710686+0000","last_undegraded":"2024-04-01T23:01:32.710686+0000","last_fullsized":"2024-04-01T23:01:32.710686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:50:04.913482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'1","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:07.398877+0000","last_change":"2024-04-01T22:33:26.855715+0000","last_active":"2024-04-01T23:00:07.398877+0000","last_peered":"2024-04-01T23:00:07.398877+0000","last_clean":"2024-04-01T23:00:07.398877+0000","last_became_active":"2024-04-01T22:33:26.855136+0000","last_became_peered":"2024-04-01T22:33:26.855136+0000","last_unstale":"2024-04-01T23:00:07.398877+0000","last_undegraded":"2024-04-01T23:00:07.398877+0000","last_fullsized":"2024-04-01T23:00:07.398877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:19:52.712250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'613","reported_seq":650,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:14.104867+0000","last_change":"2024-04-01T22:33:26.830837+0000","last_active":"2024-04-01T23:01:14.104867+0000","last_peered":"2024-04-01T23:01:14.104867+0000","last_clean":"2024-04-01T23:01:14.104867+0000","last_became_active":"2024-04-01T22:33:26.830563+0000","last_became_peered":"2024-04-01T22:33:26.830563+0000","last_unstale":"2024-04-01T23:01:14.104867+0000","last_undegraded":"2024-04-01T23:01:14.104867+0000","last_fullsized":"2024-04-01T23:01:14.104867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:40:49.124240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":609,"num_write_kb":4438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'35","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.807951+0000","last_change":"2024-04-01T22:33:27.951393+0000","last_active":"2024-04-01T23:01:32.807951+0000","last_peered":"2024-04-01T23:01:32.807951+0000","last_clean":"2024-04-01T23:01:32.807951+0000","last_became_active":"2024-04-01T22:33:27.951103+0000","last_became_peered":"2024-04-01T22:33:27.951103+0000","last_unstale":"2024-04-01T23:01:32.807951+0000","last_undegraded":"2024-04-01T23:01:32.807951+0000","last_fullsized":"2024-04-01T23:01:32.807951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:43:57.121738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'96","reported_seq":125,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:51.560205+0000","last_change":"2024-04-01T22:33:32.846734+0000","last_active":"2024-04-01T23:00:51.560205+0000","last_peered":"2024-04-01T23:00:51.560205+0000","last_clean":"2024-04-01T23:00:51.560205+0000","last_became_active":"2024-04-01T22:33:32.846376+0000","last_became_peered":"2024-04-01T22:33:32.846376+0000","last_unstale":"2024-04-01T23:00:51.560205+0000","last_undegraded":"2024-04-01T23:00:51.560205+0000","last_fullsized":"2024-04-01T23:00:51.560205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:50:41.471405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":4400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'650","reported_seq":687,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:20.438640+0000","last_change":"2024-04-01T22:33:26.855529+0000","last_active":"2024-04-01T23:01:20.438640+0000","last_peered":"2024-04-01T23:01:20.438640+0000","last_clean":"2024-04-01T23:01:20.438640+0000","last_became_active":"2024-04-01T22:33:26.855101+0000","last_became_peered":"2024-04-01T22:33:26.855101+0000","last_unstale":"2024-04-01T23:01:20.438640+0000","last_undegraded":"2024-04-01T23:01:20.438640+0000","last_fullsized":"2024-04-01T23:01:20.438640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:40:49.124240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":645,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'30","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.633452+0000","last_change":"2024-04-01T22:33:27.868702+0000","last_active":"2024-04-01T23:01:32.633452+0000","last_peered":"2024-04-01T23:01:32.633452+0000","last_clean":"2024-04-01T23:01:32.633452+0000","last_became_active":"2024-04-01T22:33:27.868297+0000","last_became_peered":"2024-04-01T22:33:27.868297+0000","last_unstale":"2024-04-01T23:01:32.633452+0000","last_undegraded":"2024-04-01T23:01:32.633452+0000","last_fullsized":"2024-04-01T23:01:32.633452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:39:30.974746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'127","reported_seq":163,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.922474+0000","last_change":"2024-04-01T22:34:05.319978+0000","last_active":"2024-04-01T23:00:58.922474+0000","last_peered":"2024-04-01T23:00:58.922474+0000","last_clean":"2024-04-01T23:00:58.922474+0000","last_became_active":"2024-04-01T22:34:05.319550+0000","last_became_peered":"2024-04-01T22:34:05.319550+0000","last_unstale":"2024-04-01T23:00:58.922474+0000","last_undegraded":"2024-04-01T23:00:58.922474+0000","last_fullsized":"2024-04-01T23:00:58.922474+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:34:03.139988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":7877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'45","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.672541+0000","last_change":"2024-04-01T22:33:27.950106+0000","last_active":"2024-04-01T23:01:32.672541+0000","last_peered":"2024-04-01T23:01:32.672541+0000","last_clean":"2024-04-01T23:01:32.672541+0000","last_became_active":"2024-04-01T22:33:27.949843+0000","last_became_peered":"2024-04-01T22:33:27.949843+0000","last_unstale":"2024-04-01T23:01:32.672541+0000","last_undegraded":"2024-04-01T23:01:32.672541+0000","last_fullsized":"2024-04-01T23:01:32.672541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:23:08.563134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'43","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.628992+0000","last_change":"2024-04-01T22:33:27.974409+0000","last_active":"2024-04-01T23:01:32.628992+0000","last_peered":"2024-04-01T23:01:32.628992+0000","last_clean":"2024-04-01T23:01:32.628992+0000","last_became_active":"2024-04-01T22:33:27.974128+0000","last_became_peered":"2024-04-01T22:33:27.974128+0000","last_unstale":"2024-04-01T23:01:32.628992+0000","last_undegraded":"2024-04-01T23:01:32.628992+0000","last_fullsized":"2024-04-01T23:01:32.628992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:49:52.536559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'42","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.640581+0000","last_change":"2024-04-01T22:33:27.974885+0000","last_active":"2024-04-01T23:01:32.640581+0000","last_peered":"2024-04-01T23:01:32.640581+0000","last_clean":"2024-04-01T23:01:32.640581+0000","last_became_active":"2024-04-01T22:33:27.973988+0000","last_became_peered":"2024-04-01T22:33:27.973988+0000","last_unstale":"2024-04-01T23:01:32.640581+0000","last_undegraded":"2024-04-01T23:01:32.640581+0000","last_fullsized":"2024-04-01T23:01:32.640581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:56:25.952727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'29","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.806818+0000","last_change":"2024-04-01T22:33:27.950817+0000","last_active":"2024-04-01T23:01:32.806818+0000","last_peered":"2024-04-01T23:01:32.806818+0000","last_clean":"2024-04-01T23:01:32.806818+0000","last_became_active":"2024-04-01T22:33:27.950515+0000","last_became_peered":"2024-04-01T22:33:27.950515+0000","last_unstale":"2024-04-01T23:01:32.806818+0000","last_undegraded":"2024-04-01T23:01:32.806818+0000","last_fullsized":"2024-04-01T23:01:32.806818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:48:53.083180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'25","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.709118+0000","last_change":"2024-04-01T22:33:27.869385+0000","last_active":"2024-04-01T23:01:32.709118+0000","last_peered":"2024-04-01T23:01:32.709118+0000","last_clean":"2024-04-01T23:01:32.709118+0000","last_became_active":"2024-04-01T22:33:27.869102+0000","last_became_peered":"2024-04-01T22:33:27.869102+0000","last_unstale":"2024-04-01T23:01:32.709118+0000","last_undegraded":"2024-04-01T23:01:32.709118+0000","last_fullsized":"2024-04-01T23:01:32.709118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:43:57.121738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'26","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.629389+0000","last_change":"2024-04-01T22:33:27.856463+0000","last_active":"2024-04-01T23:01:32.629389+0000","last_peered":"2024-04-01T23:01:32.629389+0000","last_clean":"2024-04-01T23:01:32.629389+0000","last_became_active":"2024-04-01T22:33:27.856213+0000","last_became_peered":"2024-04-01T22:33:27.856213+0000","last_unstale":"2024-04-01T23:01:32.629389+0000","last_undegraded":"2024-04-01T23:01:32.629389+0000","last_fullsized":"2024-04-01T23:01:32.629389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:43:57.121738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'41","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.676975+0000","last_change":"2024-04-01T22:33:27.921487+0000","last_active":"2024-04-01T23:01:32.676975+0000","last_peered":"2024-04-01T23:01:32.676975+0000","last_clean":"2024-04-01T23:01:32.676975+0000","last_became_active":"2024-04-01T22:33:27.921229+0000","last_became_peered":"2024-04-01T22:33:27.921229+0000","last_unstale":"2024-04-01T23:01:32.676975+0000","last_undegraded":"2024-04-01T23:01:32.676975+0000","last_fullsized":"2024-04-01T23:01:32.676975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:43:03.166262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'30","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.708707+0000","last_change":"2024-04-01T22:33:27.868732+0000","last_active":"2024-04-01T23:01:32.708707+0000","last_peered":"2024-04-01T23:01:32.708707+0000","last_clean":"2024-04-01T23:01:32.708707+0000","last_became_active":"2024-04-01T22:33:27.868496+0000","last_became_peered":"2024-04-01T22:33:27.868496+0000","last_unstale":"2024-04-01T23:01:32.708707+0000","last_undegraded":"2024-04-01T23:01:32.708707+0000","last_fullsized":"2024-04-01T23:01:32.708707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:56:25.952727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'30","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.671962+0000","last_change":"2024-04-01T22:33:27.974270+0000","last_active":"2024-04-01T23:01:32.671962+0000","last_peered":"2024-04-01T23:01:32.671962+0000","last_clean":"2024-04-01T23:01:32.671962+0000","last_became_active":"2024-04-01T22:33:27.973851+0000","last_became_peered":"2024-04-01T22:33:27.973851+0000","last_unstale":"2024-04-01T23:01:32.671962+0000","last_undegraded":"2024-04-01T23:01:32.671962+0000","last_fullsized":"2024-04-01T23:01:32.671962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:43:57.121738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'42","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.624517+0000","last_change":"2024-04-01T22:34:05.290057+0000","last_active":"2024-04-01T23:01:32.624517+0000","last_peered":"2024-04-01T23:01:32.624517+0000","last_clean":"2024-04-01T23:01:32.624517+0000","last_became_active":"2024-04-01T22:34:05.289755+0000","last_became_peered":"2024-04-01T22:34:05.289755+0000","last_unstale":"2024-04-01T23:01:32.624517+0000","last_undegraded":"2024-04-01T23:01:32.624517+0000","last_fullsized":"2024-04-01T23:01:32.624517+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:19:20.248510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"27'35","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.682011+0000","last_change":"2024-04-01T22:33:27.979380+0000","last_active":"2024-04-01T23:01:32.682011+0000","last_peered":"2024-04-01T23:01:32.682011+0000","last_clean":"2024-04-01T23:01:32.682011+0000","last_became_active":"2024-04-01T22:33:27.979108+0000","last_became_peered":"2024-04-01T22:33:27.979108+0000","last_unstale":"2024-04-01T23:01:32.682011+0000","last_undegraded":"2024-04-01T23:01:32.682011+0000","last_fullsized":"2024-04-01T23:01:32.682011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:50:04.913482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'48","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.808007+0000","last_change":"2024-04-01T22:33:27.953950+0000","last_active":"2024-04-01T23:01:32.808007+0000","last_peered":"2024-04-01T23:01:32.808007+0000","last_clean":"2024-04-01T23:01:32.808007+0000","last_became_active":"2024-04-01T22:33:27.953674+0000","last_became_peered":"2024-04-01T22:33:27.953674+0000","last_unstale":"2024-04-01T23:01:32.808007+0000","last_undegraded":"2024-04-01T23:01:32.808007+0000","last_fullsized":"2024-04-01T23:01:32.808007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:01:14.826403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'37","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.672896+0000","last_change":"2024-04-01T22:33:27.919041+0000","last_active":"2024-04-01T23:01:32.672896+0000","last_peered":"2024-04-01T23:01:32.672896+0000","last_clean":"2024-04-01T23:01:32.672896+0000","last_became_active":"2024-04-01T22:33:27.918815+0000","last_became_peered":"2024-04-01T22:33:27.918815+0000","last_unstale":"2024-04-01T23:01:32.672896+0000","last_undegraded":"2024-04-01T23:01:32.672896+0000","last_fullsized":"2024-04-01T23:01:32.672896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:15:08.500466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'34","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.703645+0000","last_change":"2024-04-01T22:33:27.881613+0000","last_active":"2024-04-01T23:01:32.703645+0000","last_peered":"2024-04-01T23:01:32.703645+0000","last_clean":"2024-04-01T23:01:32.703645+0000","last_became_active":"2024-04-01T22:33:27.881372+0000","last_became_peered":"2024-04-01T22:33:27.881372+0000","last_unstale":"2024-04-01T23:01:32.703645+0000","last_undegraded":"2024-04-01T23:01:32.703645+0000","last_fullsized":"2024-04-01T23:01:32.703645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:28:13.071380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"27'43","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.628635+0000","last_change":"2024-04-01T22:33:27.919025+0000","last_active":"2024-04-01T23:01:32.628635+0000","last_peered":"2024-04-01T23:01:32.628635+0000","last_clean":"2024-04-01T23:01:32.628635+0000","last_became_active":"2024-04-01T22:33:27.918749+0000","last_became_peered":"2024-04-01T22:33:27.918749+0000","last_unstale":"2024-04-01T23:01:32.628635+0000","last_undegraded":"2024-04-01T23:01:32.628635+0000","last_fullsized":"2024-04-01T23:01:32.628635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:47:19.535942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'36","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.649018+0000","last_change":"2024-04-01T22:33:27.979289+0000","last_active":"2024-04-01T23:01:32.649018+0000","last_peered":"2024-04-01T23:01:32.649018+0000","last_clean":"2024-04-01T23:01:32.649018+0000","last_became_active":"2024-04-01T22:33:27.979036+0000","last_became_peered":"2024-04-01T22:33:27.979036+0000","last_unstale":"2024-04-01T23:01:32.649018+0000","last_undegraded":"2024-04-01T23:01:32.649018+0000","last_fullsized":"2024-04-01T23:01:32.649018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:19:20.248510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"27'35","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.674355+0000","last_change":"2024-04-01T22:33:27.974214+0000","last_active":"2024-04-01T23:01:32.674355+0000","last_peered":"2024-04-01T23:01:32.674355+0000","last_clean":"2024-04-01T23:01:32.674355+0000","last_became_active":"2024-04-01T22:33:27.973962+0000","last_became_peered":"2024-04-01T22:33:27.973962+0000","last_unstale":"2024-04-01T23:01:32.674355+0000","last_undegraded":"2024-04-01T23:01:32.674355+0000","last_fullsized":"2024-04-01T23:01:32.674355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:15:08.500466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"27'37","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.628813+0000","last_change":"2024-04-01T22:33:27.869600+0000","last_active":"2024-04-01T23:01:32.628813+0000","last_peered":"2024-04-01T23:01:32.628813+0000","last_clean":"2024-04-01T23:01:32.628813+0000","last_became_active":"2024-04-01T22:33:27.869279+0000","last_became_peered":"2024-04-01T22:33:27.869279+0000","last_unstale":"2024-04-01T23:01:32.628813+0000","last_undegraded":"2024-04-01T23:01:32.628813+0000","last_fullsized":"2024-04-01T23:01:32.628813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:16:58.889368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'36","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.806471+0000","last_change":"2024-04-01T22:33:27.948313+0000","last_active":"2024-04-01T23:01:32.806471+0000","last_peered":"2024-04-01T23:01:32.806471+0000","last_clean":"2024-04-01T23:01:32.806471+0000","last_became_active":"2024-04-01T22:33:27.947834+0000","last_became_peered":"2024-04-01T22:33:27.947834+0000","last_unstale":"2024-04-01T23:01:32.806471+0000","last_undegraded":"2024-04-01T23:01:32.806471+0000","last_fullsized":"2024-04-01T23:01:32.806471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:50:36.571977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'35","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.708867+0000","last_change":"2024-04-01T22:33:27.915571+0000","last_active":"2024-04-01T23:01:32.708867+0000","last_peered":"2024-04-01T23:01:32.708867+0000","last_clean":"2024-04-01T23:01:32.708867+0000","last_became_active":"2024-04-01T22:33:27.915372+0000","last_became_peered":"2024-04-01T22:33:27.915372+0000","last_unstale":"2024-04-01T23:01:32.708867+0000","last_undegraded":"2024-04-01T23:01:32.708867+0000","last_fullsized":"2024-04-01T23:01:32.708867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:15:46.224658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'26","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.635273+0000","last_change":"2024-04-01T22:33:27.915752+0000","last_active":"2024-04-01T23:01:32.635273+0000","last_peered":"2024-04-01T23:01:32.635273+0000","last_clean":"2024-04-01T23:01:32.635273+0000","last_became_active":"2024-04-01T22:33:27.915515+0000","last_became_peered":"2024-04-01T22:33:27.915515+0000","last_unstale":"2024-04-01T23:01:32.635273+0000","last_undegraded":"2024-04-01T23:01:32.635273+0000","last_fullsized":"2024-04-01T23:01:32.635273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:47:19.535942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'29","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.649629+0000","last_change":"2024-04-01T22:33:27.974798+0000","last_active":"2024-04-01T23:01:32.649629+0000","last_peered":"2024-04-01T23:01:32.649629+0000","last_clean":"2024-04-01T23:01:32.649629+0000","last_became_active":"2024-04-01T22:33:27.974558+0000","last_became_peered":"2024-04-01T22:33:27.974558+0000","last_unstale":"2024-04-01T23:01:32.649629+0000","last_undegraded":"2024-04-01T23:01:32.649629+0000","last_fullsized":"2024-04-01T23:01:32.649629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:15:46.224658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'40","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.679257+0000","last_change":"2024-04-01T22:33:27.974420+0000","last_active":"2024-04-01T23:01:32.679257+0000","last_peered":"2024-04-01T23:01:32.679257+0000","last_clean":"2024-04-01T23:01:32.679257+0000","last_became_active":"2024-04-01T22:33:27.974139+0000","last_became_peered":"2024-04-01T22:33:27.974139+0000","last_unstale":"2024-04-01T23:01:32.679257+0000","last_undegraded":"2024-04-01T23:01:32.679257+0000","last_fullsized":"2024-04-01T23:01:32.679257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:48:53.083180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'41","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.781493+0000","last_change":"2024-04-01T22:33:27.972053+0000","last_active":"2024-04-01T23:01:32.781493+0000","last_peered":"2024-04-01T23:01:32.781493+0000","last_clean":"2024-04-01T23:01:32.781493+0000","last_became_active":"2024-04-01T22:33:27.971803+0000","last_became_peered":"2024-04-01T22:33:27.971803+0000","last_unstale":"2024-04-01T23:01:32.781493+0000","last_undegraded":"2024-04-01T23:01:32.781493+0000","last_fullsized":"2024-04-01T23:01:32.781493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:41:45.866834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'27","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.710773+0000","last_change":"2024-04-01T22:33:27.974447+0000","last_active":"2024-04-01T23:01:32.710773+0000","last_peered":"2024-04-01T23:01:32.710773+0000","last_clean":"2024-04-01T23:01:32.710773+0000","last_became_active":"2024-04-01T22:33:27.974205+0000","last_became_peered":"2024-04-01T22:33:27.974205+0000","last_unstale":"2024-04-01T23:01:32.710773+0000","last_undegraded":"2024-04-01T23:01:32.710773+0000","last_fullsized":"2024-04-01T23:01:32.710773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:23:08.563134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'34","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.695541+0000","last_change":"2024-04-01T22:33:27.949226+0000","last_active":"2024-04-01T23:01:32.695541+0000","last_peered":"2024-04-01T23:01:32.695541+0000","last_clean":"2024-04-01T23:01:32.695541+0000","last_became_active":"2024-04-01T22:33:27.948929+0000","last_became_peered":"2024-04-01T22:33:27.948929+0000","last_unstale":"2024-04-01T23:01:32.695541+0000","last_undegraded":"2024-04-01T23:01:32.695541+0000","last_fullsized":"2024-04-01T23:01:32.695541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:50:04.913482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'34","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.672893+0000","last_change":"2024-04-01T22:33:27.974650+0000","last_active":"2024-04-01T23:01:32.672893+0000","last_peered":"2024-04-01T23:01:32.672893+0000","last_clean":"2024-04-01T23:01:32.672893+0000","last_became_active":"2024-04-01T22:33:27.973891+0000","last_became_peered":"2024-04-01T22:33:27.973891+0000","last_unstale":"2024-04-01T23:01:32.672893+0000","last_undegraded":"2024-04-01T23:01:32.672893+0000","last_fullsized":"2024-04-01T23:01:32.672893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:08:00.537270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'27","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.774173+0000","last_change":"2024-04-01T22:33:27.879045+0000","last_active":"2024-04-01T23:01:32.774173+0000","last_peered":"2024-04-01T23:01:32.774173+0000","last_clean":"2024-04-01T23:01:32.774173+0000","last_became_active":"2024-04-01T22:33:27.878782+0000","last_became_peered":"2024-04-01T22:33:27.878782+0000","last_unstale":"2024-04-01T23:01:32.774173+0000","last_undegraded":"2024-04-01T23:01:32.774173+0000","last_fullsized":"2024-04-01T23:01:32.774173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:56:25.952727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'23","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.685801+0000","last_change":"2024-04-01T22:33:27.974592+0000","last_active":"2024-04-01T23:01:32.685801+0000","last_peered":"2024-04-01T23:01:32.685801+0000","last_clean":"2024-04-01T23:01:32.685801+0000","last_became_active":"2024-04-01T22:33:27.973592+0000","last_became_peered":"2024-04-01T22:33:27.973592+0000","last_unstale":"2024-04-01T23:01:32.685801+0000","last_undegraded":"2024-04-01T23:01:32.685801+0000","last_fullsized":"2024-04-01T23:01:32.685801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:08:15.465415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'38","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.807778+0000","last_change":"2024-04-01T22:33:27.948715+0000","last_active":"2024-04-01T23:01:32.807778+0000","last_peered":"2024-04-01T23:01:32.807778+0000","last_clean":"2024-04-01T23:01:32.807778+0000","last_became_active":"2024-04-01T22:33:27.948371+0000","last_became_peered":"2024-04-01T22:33:27.948371+0000","last_unstale":"2024-04-01T23:01:32.807778+0000","last_undegraded":"2024-04-01T23:01:32.807778+0000","last_fullsized":"2024-04-01T23:01:32.807778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:19:48.595176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'33","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.626201+0000","last_change":"2024-04-01T22:33:27.949784+0000","last_active":"2024-04-01T23:01:32.626201+0000","last_peered":"2024-04-01T23:01:32.626201+0000","last_clean":"2024-04-01T23:01:32.626201+0000","last_became_active":"2024-04-01T22:33:27.949522+0000","last_became_peered":"2024-04-01T22:33:27.949522+0000","last_unstale":"2024-04-01T23:01:32.626201+0000","last_undegraded":"2024-04-01T23:01:32.626201+0000","last_fullsized":"2024-04-01T23:01:32.626201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:15:08.500466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'27","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.774104+0000","last_change":"2024-04-01T22:33:27.915533+0000","last_active":"2024-04-01T23:01:32.774104+0000","last_peered":"2024-04-01T23:01:32.774104+0000","last_clean":"2024-04-01T23:01:32.774104+0000","last_became_active":"2024-04-01T22:33:27.915245+0000","last_became_peered":"2024-04-01T22:33:27.915245+0000","last_unstale":"2024-04-01T23:01:32.774104+0000","last_undegraded":"2024-04-01T23:01:32.774104+0000","last_fullsized":"2024-04-01T23:01:32.774104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:39:28.692092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3654,"num_write_kb":290798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4064,"ondisk_log_size":4064,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2128,"ondisk_log_size":2128,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":36646588,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":816,"num_read_kb":876,"num_write":10141,"num_write_kb":41168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":48185344,"data_stored":73293176,"data_compressed":7244306,"data_compressed_allocated":10911744,"data_compressed_original":36085760,"omap_allocated":0,"internal_metadata":0},"log_size":8253,"ondisk_log_size":8253,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65062,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575193,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72588,"kb_used_data":15044,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94299252,"statfs":{"total":96636764160,"available":96562434048,"internally_reserved":0,"allocated":15405056,"data_stored":24583315,"data_compressed":2540462,"data_compressed_allocated":3739648,"data_compressed_original":13099008,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575193,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56068,"kb_used_data":11004,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94315772,"statfs":{"total":96636764160,"available":96579350528,"internally_reserved":0,"allocated":11268096,"data_stored":16896912,"data_compressed":1639374,"data_compressed_allocated":2478080,"data_compressed_original":8286208,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575192,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":119114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575193,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36636,"kb_used_data":5460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335204,"statfs":{"total":96636764160,"available":96599248896,"internally_reserved":0,"allocated":5591040,"data_stored":8507758,"data_compressed":911578,"data_compressed_allocated":1363968,"data_compressed_original":4464640,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575193,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58728,"kb_used_data":9504,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94313112,"statfs":{"total":96636764160,"available":96576626688,"internally_reserved":0,"allocated":9732096,"data_stored":12891473,"data_compressed":1012016,"data_compressed_allocated":1646592,"data_compressed_original":4988928,"omap_allocated":1592,"internal_metadata":50395592},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575193,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":483328,"data_stored":307889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575192,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41316,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330524,"statfs":{"total":96636764160,"available":96594456576,"internally_reserved":0,"allocated":1863680,"data_stored":3021005,"data_compressed":393957,"data_compressed_allocated":561152,"data_compressed_original":1900544,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575193,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41200,"kb_used_data":5864,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330640,"statfs":{"total":96636764160,"available":96594575360,"internally_reserved":0,"allocated":6004736,"data_stored":9098638,"data_compressed":811981,"data_compressed_allocated":1212416,"data_compressed_original":4493312,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32531,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32531,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5648384,"data_stored":8389246,"data_compressed":779450,"data_compressed_allocated":1167360,"data_compressed_original":3919872,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1572864,"data_stored":2901981,"data_compressed":393957,"data_compressed_allocated":561152,"data_compressed_original":1900544,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":192512,"data_stored":188865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9441280,"data_stored":12772449,"data_compressed":1012016,"data_compressed_allocated":1646592,"data_compressed_original":4988928,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5300224,"data_stored":8388734,"data_compressed":911578,"data_compressed_allocated":1363968,"data_compressed_original":4464640,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10977280,"data_stored":16777888,"data_compressed":1639374,"data_compressed_allocated":2478080,"data_compressed_original":8286208,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15048704,"data_stored":23873923,"data_compressed":2507931,"data_compressed_allocated":3694592,"data_compressed_original":12525568,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T23:01:40.618 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T23:01:40.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.759+0000 7f70ec9f6640 1 Processor -- start 2024-04-01T23:01:40.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.759+0000 7f70ec9f6640 1 -- start start 2024-04-01T23:01:40.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.759+0000 7f70ec9f6640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f70e81524d0 0x7f70e80c8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:40.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.759+0000 7f70ec9f6640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f70e80c8ec0 0x7f70e80ca090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:40.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.759+0000 7f70ec9f6640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f70e80ca5d0 0x7f70e815bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:40.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.759+0000 7f70ec9f6640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f70e8159130 con 0x7f70e80c8ec0 2024-04-01T23:01:40.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.759+0000 7f70ec9f6640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f70e81528b0 con 0x7f70e81524d0 2024-04-01T23:01:40.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.759+0000 7f70ec9f6640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f70e81585b0 con 0x7f70e80ca5d0 2024-04-01T23:01:40.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.760+0000 7f70dffff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f70e80c8ec0 0x7f70e80ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:40.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.760+0000 7f70e659c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f70e81524d0 0x7f70e80c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:40.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.760+0000 7f70e6d9d640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f70e80ca5d0 0x7f70e815bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:40.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.761+0000 7f70dffff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f70e80c8ec0 0x7f70e80ca090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53186/0 (socket says 172.21.15.47:53186) 2024-04-01T23:01:40.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.761+0000 7f70dffff640 1 -- 172.21.15.47:0/633573914 learned_addr learned my addr 172.21.15.47:0/633573914 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:40.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.763+0000 7f70dffff640 1 -- 172.21.15.47:0/633573914 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f70e80ca5d0 msgr2=0x7f70e815bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:01:40.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.763+0000 7f70dffff640 1 --2- 172.21.15.47:0/633573914 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f70e80ca5d0 0x7f70e815bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:40.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.763+0000 7f70dffff640 1 -- 172.21.15.47:0/633573914 >> v2:172.21.15.181:3300/0 conn(0x7f70e81524d0 msgr2=0x7f70e80c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:01:40.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.763+0000 7f70dffff640 1 --2- 172.21.15.47:0/633573914 >> v2:172.21.15.181:3300/0 conn(0x7f70e81524d0 0x7f70e80c8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:40.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.763+0000 7f70dffff640 1 -- 172.21.15.47:0/633573914 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e8158890 con 0x7f70e80c8ec0 2024-04-01T23:01:40.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.765+0000 7f70dffff640 1 --2- 172.21.15.47:0/633573914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70e80c8ec0 0x7f70e80ca090 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f70e80c86f0 tx=0x7f70d002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab7660db23f24b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:40.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.769+0000 7f70e5d9b640 1 -- 172.21.15.47:0/633573914 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d0035020 con 0x7f70e80c8ec0 2024-04-01T23:01:40.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.769+0000 7f70e5d9b640 1 -- 172.21.15.47:0/633573914 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70d0031870 con 0x7f70e80c8ec0 2024-04-01T23:01:40.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.769+0000 7f70e5d9b640 1 -- 172.21.15.47:0/633573914 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d0031c40 con 0x7f70e80c8ec0 2024-04-01T23:01:40.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.769+0000 7f70ec9f6640 1 -- 172.21.15.47:0/633573914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70e80c8ec0 msgr2=0x7f70e80ca090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:40.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.769+0000 7f70ec9f6640 1 --2- 172.21.15.47:0/633573914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70e80c8ec0 0x7f70e80ca090 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f70e80c86f0 tx=0x7f70d002b910 comp rx=0 tx=0).stop 2024-04-01T23:01:40.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.769+0000 7f70ec9f6640 1 -- 172.21.15.47:0/633573914 shutdown_connections 2024-04-01T23:01:40.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.769+0000 7f70ec9f6640 1 --2- 172.21.15.47:0/633573914 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f70e80ca5d0 0x7f70e815bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:40.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.769+0000 7f70ec9f6640 1 --2- 172.21.15.47:0/633573914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70e80c8ec0 0x7f70e80ca090 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:40.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.769+0000 7f70ec9f6640 1 --2- 172.21.15.47:0/633573914 >> v2:172.21.15.181:3300/0 conn(0x7f70e81524d0 0x7f70e80c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:40.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.769+0000 7f70ec9f6640 1 -- 172.21.15.47:0/633573914 >> 172.21.15.47:0/633573914 conn(0x7f70e8071330 msgr2=0x7f70e8071740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:40.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.769+0000 7f70ec9f6640 1 -- 172.21.15.47:0/633573914 shutdown_connections 2024-04-01T23:01:40.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.769+0000 7f70ec9f6640 1 -- 172.21.15.47:0/633573914 wait complete. 2024-04-01T23:01:40.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.771+0000 7f70ec9f6640 1 Processor -- start 2024-04-01T23:01:40.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.771+0000 7f70ec9f6640 1 -- start start 2024-04-01T23:01:40.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.772+0000 7f70ec9f6640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f70e80c8ec0 0x7f70e80c5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:40.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.772+0000 7f70ec9f6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f70e80ca5d0 0x7f70e815aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:40.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.772+0000 7f70ec9f6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70e81524d0 0x7f70e80c5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:40.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.772+0000 7f70ec9f6640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f70e815b870 con 0x7f70e81524d0 2024-04-01T23:01:40.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.772+0000 7f70ec9f6640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f70e8158e50 con 0x7f70e80ca5d0 2024-04-01T23:01:40.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.772+0000 7f70ec9f6640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f70e8158170 con 0x7f70e80c8ec0 2024-04-01T23:01:40.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.772+0000 7f70e6d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70e81524d0 0x7f70e80c5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:40.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.772+0000 7f70e659c640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f70e80c8ec0 0x7f70e80c5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:40.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.773+0000 7f70dffff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f70e80ca5d0 0x7f70e815aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:40.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.773+0000 7f70e6d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70e81524d0 0x7f70e80c5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53190/0 (socket says 172.21.15.47:53190) 2024-04-01T23:01:40.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.773+0000 7f70e6d9d640 1 -- 172.21.15.47:0/1860332983 learned_addr learned my addr 172.21.15.47:0/1860332983 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:40.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.776+0000 7f70e659c640 1 -- 172.21.15.47:0/1860332983 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f70e80ca5d0 msgr2=0x7f70e815aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:40.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.776+0000 7f70e659c640 1 --2- 172.21.15.47:0/1860332983 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f70e80ca5d0 0x7f70e815aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:40.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.776+0000 7f70e659c640 1 -- 172.21.15.47:0/1860332983 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70e81524d0 msgr2=0x7f70e80c5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:40.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.776+0000 7f70e659c640 1 --2- 172.21.15.47:0/1860332983 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70e81524d0 0x7f70e80c5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:40.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.776+0000 7f70e659c640 1 -- 172.21.15.47:0/1860332983 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e81f03e0 con 0x7f70e80c8ec0 2024-04-01T23:01:40.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.776+0000 7f70e6d9d640 1 --2- 172.21.15.47:0/1860332983 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70e81524d0 0x7f70e80c5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T23:01:40.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.779+0000 7f70e659c640 1 --2- 172.21.15.47:0/1860332983 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f70e80c8ec0 0x7f70e80c5e00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f70d800e8a0 tx=0x7f70d800ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:40.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.783+0000 7f70deffd640 1 -- 172.21.15.47:0/1860332983 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d8017070 con 0x7f70e80c8ec0 2024-04-01T23:01:40.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.783+0000 7f70deffd640 1 -- 172.21.15.47:0/1860332983 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70d800c940 con 0x7f70e80c8ec0 2024-04-01T23:01:40.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.783+0000 7f70deffd640 1 -- 172.21.15.47:0/1860332983 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d8009e60 con 0x7f70e80c8ec0 2024-04-01T23:01:40.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.783+0000 7f70ec9f6640 1 -- 172.21.15.47:0/1860332983 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70e806c5a0 con 0x7f70e80c8ec0 2024-04-01T23:01:40.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.783+0000 7f70ec9f6640 1 -- 172.21.15.47:0/1860332983 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f70e806cb60 con 0x7f70e80c8ec0 2024-04-01T23:01:40.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:40.784+0000 7f70ec9f6640 1 -- 172.21.15.47:0/1860332983 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70e8068210 con 0x7f70e80c8ec0 2024-04-01T23:01:41.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:41.031+0000 7f70deffd640 1 -- 172.21.15.47:0/1860332983 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f70d801a070 con 0x7f70e80c8ec0 2024-04-01T23:01:41.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:41.032+0000 7f70deffd640 1 --2- 172.21.15.47:0/1860332983 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f70c806ba10 0x7f70c806ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:41.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:41.032+0000 7f70dffff640 1 --2- 172.21.15.47:0/1860332983 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f70c806ba10 0x7f70c806ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:41.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:41.032+0000 7f70dffff640 1 --2- 172.21.15.47:0/1860332983 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f70c806ba10 0x7f70c806ded0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f70d0036000 tx=0x7f70d003c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:41.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:41.035+0000 7f70deffd640 1 -- 172.21.15.47:0/1860332983 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f70d80573c0 con 0x7f70e80c8ec0 2024-04-01T23:01:41.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:41.045+0000 7f70deffd640 1 -- 172.21.15.47:0/1860332983 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f70d8059320 con 0x7f70e80c8ec0 2024-04-01T23:01:41.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:41.229+0000 7f70ec9f6640 1 -- 172.21.15.47:0/1860332983 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f70e81560f0 con 0x7f70e80c8ec0 2024-04-01T23:01:41.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:41.268+0000 7f70deffd640 1 -- 172.21.15.47:0/1860332983 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18914 (secure 0 0 0) 0x7f70d805d3c0 con 0x7f70e80c8ec0 2024-04-01T23:01:41.264 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T23:01:41.265 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":27,"fsid":"a6998a48-38bc-4e42-b0d9-04f2fb5c3c87","created":"2024-04-01T22:32:57.112033+0000","modified":"2024-04-01T22:34:04.850029+0000","last_up_change":"2024-04-01T22:33:11.141073+0000","last_in_change":"2024-04-01T22:33:02.650459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T22:33:13.356568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T22:33:25.309421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T22:33:26.268050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-01T22:33:30.588103+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7bd3f25d-e3a5-4932-b381-53dcbb464dde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6811","nonce":3827395709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6813","nonce":3827395709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6817","nonce":3827395709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6815","nonce":3827395709}]},"public_addr":"172.21.15.47:6811/3827395709","cluster_addr":"172.21.15.47:6813/3827395709","heartbeat_back_addr":"172.21.15.47:6817/3827395709","heartbeat_front_addr":"172.21.15.47:6815/3827395709","state":["exists","up"]},{"osd":1,"uuid":"2aa60ba2-67ff-43c7-96c4-82ae2f3855ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6827","nonce":3152157503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6829","nonce":3152157503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6833","nonce":3152157503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6831","nonce":3152157503}]},"public_addr":"172.21.15.47:6827/3152157503","cluster_addr":"172.21.15.47:6829/3152157503","heartbeat_back_addr":"172.21.15.47:6833/3152157503","heartbeat_front_addr":"172.21.15.47:6831/3152157503","state":["exists","up"]},{"osd":2,"uuid":"d83f8a98-6db8-42b7-9ef6-5b16eb9a3492","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6803","nonce":1003968856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6805","nonce":1003968856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6809","nonce":1003968856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6807","nonce":1003968856}]},"public_addr":"172.21.15.47:6803/1003968856","cluster_addr":"172.21.15.47:6805/1003968856","heartbeat_back_addr":"172.21.15.47:6809/1003968856","heartbeat_front_addr":"172.21.15.47:6807/1003968856","state":["exists","up"]},{"osd":3,"uuid":"edc02ed5-d25c-4dc9-a0c3-7a26f20fae07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6819","nonce":2845699561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6821","nonce":2845699561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6825","nonce":2845699561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6823","nonce":2845699561}]},"public_addr":"172.21.15.47:6819/2845699561","cluster_addr":"172.21.15.47:6821/2845699561","heartbeat_back_addr":"172.21.15.47:6825/2845699561","heartbeat_front_addr":"172.21.15.47:6823/2845699561","state":["exists","up"]},{"osd":4,"uuid":"b3d67e74-f51e-4474-9c62-dd0daa60c728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6809","nonce":2961538461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6811","nonce":2961538461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6815","nonce":2961538461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6813","nonce":2961538461}]},"public_addr":"172.21.15.181:6809/2961538461","cluster_addr":"172.21.15.181:6811/2961538461","heartbeat_back_addr":"172.21.15.181:6815/2961538461","heartbeat_front_addr":"172.21.15.181:6813/2961538461","state":["exists","up"]},{"osd":5,"uuid":"d86e8f7a-99f4-4457-9949-cf2cb853e79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6817","nonce":2161566540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6819","nonce":2161566540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6823","nonce":2161566540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6821","nonce":2161566540}]},"public_addr":"172.21.15.181:6817/2161566540","cluster_addr":"172.21.15.181:6819/2161566540","heartbeat_back_addr":"172.21.15.181:6823/2161566540","heartbeat_front_addr":"172.21.15.181:6821/2161566540","state":["exists","up"]},{"osd":6,"uuid":"aa08266c-1719-4abd-afb9-e7e8ac593658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6801","nonce":3792144865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6803","nonce":3792144865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6807","nonce":3792144865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6805","nonce":3792144865}]},"public_addr":"172.21.15.181:6801/3792144865","cluster_addr":"172.21.15.181:6803/3792144865","heartbeat_back_addr":"172.21.15.181:6807/3792144865","heartbeat_front_addr":"172.21.15.181:6805/3792144865","state":["exists","up"]},{"osd":7,"uuid":"6e509762-24c8-46c3-93a1-4c50b11ebcf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6825","nonce":1760995885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6827","nonce":1760995885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6831","nonce":1760995885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6829","nonce":1760995885}]},"public_addr":"172.21.15.181:6825/1760995885","cluster_addr":"172.21.15.181:6827/1760995885","heartbeat_back_addr":"172.21.15.181:6831/1760995885","heartbeat_front_addr":"172.21.15.181:6829/1760995885","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.202426+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.255318+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.170288+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.290065+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.214871+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.176432+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.139940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.299546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.15","mappings":[{"from":7,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T23:01:41.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:41.271+0000 7f70ec9f6640 1 -- 172.21.15.47:0/1860332983 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f70c806ba10 msgr2=0x7f70c806ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:41.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:41.271+0000 7f70ec9f6640 1 --2- 172.21.15.47:0/1860332983 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f70c806ba10 0x7f70c806ded0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f70d0036000 tx=0x7f70d003c040 comp rx=0 tx=0).stop 2024-04-01T23:01:41.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:41.271+0000 7f70ec9f6640 1 -- 172.21.15.47:0/1860332983 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f70e80c8ec0 msgr2=0x7f70e80c5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:41.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:41.271+0000 7f70ec9f6640 1 --2- 172.21.15.47:0/1860332983 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f70e80c8ec0 0x7f70e80c5e00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f70d800e8a0 tx=0x7f70d800ed60 comp rx=0 tx=0).stop 2024-04-01T23:01:41.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:41.271+0000 7f70ec9f6640 1 -- 172.21.15.47:0/1860332983 shutdown_connections 2024-04-01T23:01:41.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:41.271+0000 7f70ec9f6640 1 --2- 172.21.15.47:0/1860332983 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f70c806ba10 0x7f70c806ded0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:41.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:41.271+0000 7f70ec9f6640 1 --2- 172.21.15.47:0/1860332983 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70e81524d0 0x7f70e80c5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:41.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:41.271+0000 7f70ec9f6640 1 --2- 172.21.15.47:0/1860332983 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f70e80ca5d0 0x7f70e815aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:41.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:41.271+0000 7f70ec9f6640 1 --2- 172.21.15.47:0/1860332983 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f70e80c8ec0 0x7f70e80c5e00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:41.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:41.271+0000 7f70ec9f6640 1 -- 172.21.15.47:0/1860332983 >> 172.21.15.47:0/1860332983 conn(0x7f70e8071330 msgr2=0x7f70e8156fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:41.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:41.271+0000 7f70ec9f6640 1 -- 172.21.15.47:0/1860332983 shutdown_connections 2024-04-01T23:01:41.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:41.271+0000 7f70ec9f6640 1 -- 172.21.15.47:0/1860332983 wait complete. 2024-04-01T23:01:42.279 INFO:tasks.ceph:Scrubbing osd.0 2024-04-01T23:01:42.279 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-01T23:01:42.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.391+0000 7f69f4f8c640 1 Processor -- start 2024-04-01T23:01:42.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.391+0000 7f69f4f8c640 1 -- start start 2024-04-01T23:01:42.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.392+0000 7f69f4f8c640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f69f00c93f0 0x7f69f00cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:42.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.392+0000 7f69f4f8c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f69f015afc0 0x7f69f006c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:42.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.392+0000 7f69f4f8c640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69f00cdae0 con 0x7f69f006c770 2024-04-01T23:01:42.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.392+0000 7f69f4f8c640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f69f00c97d0 con 0x7f69f015afc0 2024-04-01T23:01:42.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.392+0000 7f69f4f8c640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f69f00cdd80 con 0x7f69f00c93f0 2024-04-01T23:01:42.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.392+0000 7f69eed9d640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f69f006c770 0x7f69f00cc0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35602/0 (socket says 172.21.15.47:35602) 2024-04-01T23:01:42.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.392+0000 7f69eed9d640 1 -- 172.21.15.47:0/703717138 learned_addr learned my addr 172.21.15.47:0/703717138 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T23:01:42.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.392+0000 7f69ee59c640 1 --2- 172.21.15.47:0/703717138 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f69f00c93f0 0x7f69f00cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:42.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.392+0000 7f69e7fff640 1 --2- 172.21.15.47:0/703717138 >> v2:172.21.15.181:3300/0 conn(0x7f69f015afc0 0x7f69f006c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:42.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.395+0000 7f69edd9b640 1 -- 172.21.15.47:0/703717138 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3644825746 0 0) 0x7f69f00cdae0 con 0x7f69f006c770 2024-04-01T23:01:42.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.395+0000 7f69ee59c640 1 -- 172.21.15.47:0/703717138 >> v2:172.21.15.181:3300/0 conn(0x7f69f015afc0 msgr2=0x7f69f006c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:01:42.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.395+0000 7f69ee59c640 1 --2- 172.21.15.47:0/703717138 >> v2:172.21.15.181:3300/0 conn(0x7f69f015afc0 0x7f69f006c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:42.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.395+0000 7f69ee59c640 1 -- 172.21.15.47:0/703717138 >> v1:172.21.15.47:6789/0 conn(0x7f69f006c770 legacy=0x7f69f00cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:42.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.395+0000 7f69ee59c640 1 -- 172.21.15.47:0/703717138 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f00ce060 con 0x7f69f00c93f0 2024-04-01T23:01:42.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.395+0000 7f69e7fff640 1 --2- 172.21.15.47:0/703717138 >> v2:172.21.15.181:3300/0 conn(0x7f69f015afc0 0x7f69f006c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T23:01:42.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.397+0000 7f69ee59c640 1 --2- 172.21.15.47:0/703717138 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f69f00c93f0 0x7f69f00cee30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f69e00097a0 tx=0x7f69e002b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51e1e716448eaa98 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:42.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.401+0000 7f69edd9b640 1 -- 172.21.15.47:0/703717138 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e0031780 con 0x7f69f00c93f0 2024-04-01T23:01:42.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.401+0000 7f69edd9b640 1 -- 172.21.15.47:0/703717138 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69e0037070 con 0x7f69f00c93f0 2024-04-01T23:01:42.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.401+0000 7f69edd9b640 1 -- 172.21.15.47:0/703717138 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e0031b40 con 0x7f69f00c93f0 2024-04-01T23:01:42.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.402+0000 7f69f4f8c640 1 -- 172.21.15.47:0/703717138 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f69f00c93f0 msgr2=0x7f69f00cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:42.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.402+0000 7f69f4f8c640 1 --2- 172.21.15.47:0/703717138 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f69f00c93f0 0x7f69f00cee30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f69e00097a0 tx=0x7f69e002b820 comp rx=0 tx=0).stop 2024-04-01T23:01:42.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.402+0000 7f69f4f8c640 1 -- 172.21.15.47:0/703717138 shutdown_connections 2024-04-01T23:01:42.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.402+0000 7f69f4f8c640 1 --2- 172.21.15.47:0/703717138 >> v2:172.21.15.181:3300/0 conn(0x7f69f015afc0 0x7f69f006c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:42.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.402+0000 7f69f4f8c640 1 --2- 172.21.15.47:0/703717138 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f69f00c93f0 0x7f69f00cee30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:42.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.402+0000 7f69f4f8c640 1 -- 172.21.15.47:0/703717138 >> 172.21.15.47:0/703717138 conn(0x7f69f00cfdb0 msgr2=0x7f69f00d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:42.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.402+0000 7f69f4f8c640 1 -- 172.21.15.47:0/703717138 shutdown_connections 2024-04-01T23:01:42.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.402+0000 7f69f4f8c640 1 -- 172.21.15.47:0/703717138 wait complete. 2024-04-01T23:01:42.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.403+0000 7f69f4f8c640 1 Processor -- start 2024-04-01T23:01:42.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.403+0000 7f69f4f8c640 1 -- start start 2024-04-01T23:01:42.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.404+0000 7f69f4f8c640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f69f006c770 0x7f69f01f4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:42.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.404+0000 7f69f4f8c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f69f00c93f0 0x7f69f01e3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:42.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.404+0000 7f69f4f8c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69f015afc0 0x7f69f01f1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:42.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.404+0000 7f69f4f8c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f69f015b400 con 0x7f69f015afc0 2024-04-01T23:01:42.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.404+0000 7f69f4f8c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f69f00ce620 con 0x7f69f00c93f0 2024-04-01T23:01:42.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.404+0000 7f69f4f8c640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f69f00cf430 con 0x7f69f006c770 2024-04-01T23:01:42.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.404+0000 7f69eed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69f015afc0 0x7f69f01f1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:42.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.404+0000 7f69ee59c640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f69f006c770 0x7f69f01f4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:42.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.404+0000 7f69e7fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f69f00c93f0 0x7f69f01e3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:42.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.405+0000 7f69eed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69f015afc0 0x7f69f01f1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53202/0 (socket says 172.21.15.47:53202) 2024-04-01T23:01:42.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.405+0000 7f69eed9d640 1 -- 172.21.15.47:0/79567145 learned_addr learned my addr 172.21.15.47:0/79567145 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:42.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.408+0000 7f69e7fff640 1 -- 172.21.15.47:0/79567145 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f69f006c770 msgr2=0x7f69f01f4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:42.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.408+0000 7f69e7fff640 1 --2- 172.21.15.47:0/79567145 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f69f006c770 0x7f69f01f4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:42.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.408+0000 7f69e7fff640 1 -- 172.21.15.47:0/79567145 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69f015afc0 msgr2=0x7f69f01f1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:42.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.408+0000 7f69e7fff640 1 --2- 172.21.15.47:0/79567145 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69f015afc0 0x7f69f01f1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:42.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.408+0000 7f69e7fff640 1 -- 172.21.15.47:0/79567145 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f00b0a60 con 0x7f69f00c93f0 2024-04-01T23:01:42.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.408+0000 7f69ee59c640 1 --2- 172.21.15.47:0/79567145 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f69f006c770 0x7f69f01f4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T23:01:42.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.411+0000 7f69e7fff640 1 --2- 172.21.15.47:0/79567145 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f69f00c93f0 0x7f69f01e3a70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f69d800e8d0 tx=0x7f69d800ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:42.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.414+0000 7f69e6ffd640 1 -- 172.21.15.47:0/79567145 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d8017070 con 0x7f69f00c93f0 2024-04-01T23:01:42.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.414+0000 7f69e6ffd640 1 -- 172.21.15.47:0/79567145 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d800c940 con 0x7f69f00c93f0 2024-04-01T23:01:42.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.414+0000 7f69f4f8c640 1 -- 172.21.15.47:0/79567145 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69f00b0d40 con 0x7f69f00c93f0 2024-04-01T23:01:42.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.414+0000 7f69e6ffd640 1 -- 172.21.15.47:0/79567145 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d800cd30 con 0x7f69f00c93f0 2024-04-01T23:01:42.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.414+0000 7f69f4f8c640 1 -- 172.21.15.47:0/79567145 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69f01f1690 con 0x7f69f00c93f0 2024-04-01T23:01:42.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.415+0000 7f69f4f8c640 1 -- 172.21.15.47:0/79567145 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f69f006cc90 con 0x7f69f00c93f0 2024-04-01T23:01:42.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.435+0000 7f69e6ffd640 1 -- 172.21.15.47:0/79567145 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f69d801a070 con 0x7f69f00c93f0 2024-04-01T23:01:42.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.435+0000 7f69e6ffd640 1 --2- 172.21.15.47:0/79567145 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f69d006b990 0x7f69d006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:42.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.435+0000 7f69ee59c640 1 --2- 172.21.15.47:0/79567145 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f69d006b990 0x7f69d006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:42.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.435+0000 7f69ee59c640 1 --2- 172.21.15.47:0/79567145 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f69d006b990 0x7f69d006de50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f69e0036000 tx=0x7f69e003d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:42.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.438+0000 7f69e6ffd640 1 -- 172.21.15.47:0/79567145 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f69d8057370 con 0x7f69f00c93f0 2024-04-01T23:01:42.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.438+0000 7f69e6ffd640 1 --2- 172.21.15.47:0/79567145 >> [v2:172.21.15.47:6810/3827395709,v1:172.21.15.47:6811/3827395709] conn(0x7f69d00752a0 0x7f69d0077740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:42.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.438+0000 7f69e6ffd640 1 -- 172.21.15.47:0/79567145 --> [v2:172.21.15.47:6810/3827395709,v1:172.21.15.47:6811/3827395709] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f69d0077e10 con 0x7f69d00752a0 2024-04-01T23:01:42.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.438+0000 7f69e6ffd640 1 -- 172.21.15.47:0/79567145 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f69d8055570 con 0x7f69f00c93f0 2024-04-01T23:01:42.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.438+0000 7f69eed9d640 1 --2- 172.21.15.47:0/79567145 >> [v2:172.21.15.47:6810/3827395709,v1:172.21.15.47:6811/3827395709] conn(0x7f69d00752a0 0x7f69d0077740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:42.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.439+0000 7f69eed9d640 1 --2- 172.21.15.47:0/79567145 >> [v2:172.21.15.47:6810/3827395709,v1:172.21.15.47:6811/3827395709] conn(0x7f69d00752a0 0x7f69d0077740 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:42.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.439+0000 7f69e6ffd640 1 -- 172.21.15.47:0/79567145 <== osd.0 v2:172.21.15.47:6810/3827395709 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f69d0077e10 con 0x7f69d00752a0 2024-04-01T23:01:42.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.453+0000 7f69f4f8c640 1 -- 172.21.15.47:0/79567145 --> [v2:172.21.15.47:6810/3827395709,v1:172.21.15.47:6811/3827395709] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f69f00732d0 con 0x7f69d00752a0 2024-04-01T23:01:42.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.453+0000 7f69e6ffd640 1 -- 172.21.15.47:0/79567145 <== osd.0 v2:172.21.15.47:6810/3827395709 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f69f00732d0 con 0x7f69d00752a0 2024-04-01T23:01:42.449 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-01T23:01:42.449 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-01T23:01:42.449 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-01T23:01:42.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.453+0000 7f69f4f8c640 1 -- 172.21.15.47:0/79567145 >> [v2:172.21.15.47:6810/3827395709,v1:172.21.15.47:6811/3827395709] conn(0x7f69d00752a0 msgr2=0x7f69d0077740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:42.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.453+0000 7f69f4f8c640 1 --2- 172.21.15.47:0/79567145 >> [v2:172.21.15.47:6810/3827395709,v1:172.21.15.47:6811/3827395709] conn(0x7f69d00752a0 0x7f69d0077740 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:42.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.453+0000 7f69f4f8c640 1 -- 172.21.15.47:0/79567145 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f69d006b990 msgr2=0x7f69d006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:42.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.453+0000 7f69f4f8c640 1 --2- 172.21.15.47:0/79567145 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f69d006b990 0x7f69d006de50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f69e0036000 tx=0x7f69e003d040 comp rx=0 tx=0).stop 2024-04-01T23:01:42.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.453+0000 7f69f4f8c640 1 -- 172.21.15.47:0/79567145 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f69f00c93f0 msgr2=0x7f69f01e3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:42.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.453+0000 7f69f4f8c640 1 --2- 172.21.15.47:0/79567145 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f69f00c93f0 0x7f69f01e3a70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f69d800e8d0 tx=0x7f69d800ecd0 comp rx=0 tx=0).stop 2024-04-01T23:01:42.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.453+0000 7f69eed9d640 1 -- 172.21.15.47:0/79567145 reap_dead start 2024-04-01T23:01:42.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.453+0000 7f69f4f8c640 1 -- 172.21.15.47:0/79567145 shutdown_connections 2024-04-01T23:01:42.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.453+0000 7f69f4f8c640 1 -- 172.21.15.47:0/79567145 >> 172.21.15.47:0/79567145 conn(0x7f69f00cfdb0 msgr2=0x7f69f00d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:42.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.453+0000 7f69f4f8c640 1 -- 172.21.15.47:0/79567145 shutdown_connections 2024-04-01T23:01:42.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.453+0000 7f69f4f8c640 1 -- 172.21.15.47:0/79567145 wait complete. 2024-04-01T23:01:42.464 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-01T23:01:42.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.571+0000 7f9663fc9640 1 Processor -- start 2024-04-01T23:01:42.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.571+0000 7f9663fc9640 1 -- start start 2024-04-01T23:01:42.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.572+0000 7f9663fc9640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f965c0cc7e0 0x7f965c15afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:42.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.572+0000 7f9663fc9640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f965c0cdae0 con 0x7f965c0c93f0 2024-04-01T23:01:42.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.572+0000 7f9663fc9640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f965c0c97d0 con 0x7f965c0cee30 2024-04-01T23:01:42.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.572+0000 7f9663fc9640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f965c15b500 con 0x7f965c0cc7e0 2024-04-01T23:01:42.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.573+0000 7f9661d65640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f965c0c93f0 0x7f965c06c230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35616/0 (socket says 172.21.15.47:35616) 2024-04-01T23:01:42.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.573+0000 7f9661d65640 1 -- 172.21.15.47:0/2756214593 learned_addr learned my addr 172.21.15.47:0/2756214593 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T23:01:42.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.573+0000 7f9662566640 1 --2- 172.21.15.47:0/2756214593 >> v2:172.21.15.181:3300/0 conn(0x7f965c0cc7e0 0x7f965c15afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:42.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.575+0000 7f9660d63640 1 -- 172.21.15.47:0/2756214593 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 211325956 0 0) 0x7f965c0cdae0 con 0x7f965c0c93f0 2024-04-01T23:01:42.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.575+0000 7f9660d63640 1 -- 172.21.15.47:0/2756214593 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9648003520 con 0x7f965c0c93f0 2024-04-01T23:01:42.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.578+0000 7f9662566640 1 -- 172.21.15.47:0/2756214593 >> v1:172.21.15.181:6789/0 conn(0x7f965c0cee30 legacy=0x7f965c0cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:42.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.578+0000 7f9662566640 1 -- 172.21.15.47:0/2756214593 >> v1:172.21.15.47:6789/0 conn(0x7f965c0c93f0 legacy=0x7f965c06c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:42.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.578+0000 7f9662566640 1 -- 172.21.15.47:0/2756214593 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f965c0cdd80 con 0x7f965c0cc7e0 2024-04-01T23:01:42.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.581+0000 7f9662566640 1 --2- 172.21.15.47:0/2756214593 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f965c0cc7e0 0x7f965c15afc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9654009d90 tx=0x7f965402beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7e5fbd1b85abf10 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:42.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.584+0000 7f9660d63640 1 -- 172.21.15.47:0/2756214593 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9654039070 con 0x7f965c0cc7e0 2024-04-01T23:01:42.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.584+0000 7f9660d63640 1 -- 172.21.15.47:0/2756214593 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f965402cc60 con 0x7f965c0cc7e0 2024-04-01T23:01:42.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.584+0000 7f9660d63640 1 -- 172.21.15.47:0/2756214593 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9654034660 con 0x7f965c0cc7e0 2024-04-01T23:01:42.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.585+0000 7f9663fc9640 1 -- 172.21.15.47:0/2756214593 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f965c0cc7e0 msgr2=0x7f965c15afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:42.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.585+0000 7f9663fc9640 1 --2- 172.21.15.47:0/2756214593 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f965c0cc7e0 0x7f965c15afc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9654009d90 tx=0x7f965402beb0 comp rx=0 tx=0).stop 2024-04-01T23:01:42.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.585+0000 7f9663fc9640 1 -- 172.21.15.47:0/2756214593 shutdown_connections 2024-04-01T23:01:42.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.585+0000 7f9663fc9640 1 --2- 172.21.15.47:0/2756214593 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f965c0cc7e0 0x7f965c15afc0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:42.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.585+0000 7f9663fc9640 1 -- 172.21.15.47:0/2756214593 >> 172.21.15.47:0/2756214593 conn(0x7f965c0cfdb0 msgr2=0x7f965c0d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:42.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.585+0000 7f9663fc9640 1 -- 172.21.15.47:0/2756214593 shutdown_connections 2024-04-01T23:01:42.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.585+0000 7f9663fc9640 1 -- 172.21.15.47:0/2756214593 wait complete. 2024-04-01T23:01:42.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.586+0000 7f9663fc9640 1 Processor -- start 2024-04-01T23:01:42.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.586+0000 7f9663fc9640 1 -- start start 2024-04-01T23:01:42.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.587+0000 7f9663fc9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f965c0c93f0 0x7f965c0b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:42.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.587+0000 7f9663fc9640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f965c0cc7e0 0x7f965c1f3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:42.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.587+0000 7f9663fc9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f965c0cee30 0x7f965c0b1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:42.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.587+0000 7f9663fc9640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f965c0ce620 con 0x7f965c0c93f0 2024-04-01T23:01:42.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.587+0000 7f9663fc9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f965c0ce340 con 0x7f965c0cee30 2024-04-01T23:01:42.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.587+0000 7f9663fc9640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f965c0cf430 con 0x7f965c0cc7e0 2024-04-01T23:01:42.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.587+0000 7f9661d65640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f965c0c93f0 0x7f965c0b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:42.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.588+0000 7f9662566640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f965c0cee30 0x7f965c0b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:42.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.588+0000 7f9661564640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f965c0cc7e0 0x7f965c1f3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:42.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.588+0000 7f9661d65640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f965c0c93f0 0x7f965c0b4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53218/0 (socket says 172.21.15.47:53218) 2024-04-01T23:01:42.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.588+0000 7f9661d65640 1 -- 172.21.15.47:0/581450170 learned_addr learned my addr 172.21.15.47:0/581450170 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:42.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.591+0000 7f9661d65640 1 -- 172.21.15.47:0/581450170 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f965c0cc7e0 msgr2=0x7f965c1f3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:42.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.591+0000 7f9661d65640 1 --2- 172.21.15.47:0/581450170 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f965c0cc7e0 0x7f965c1f3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:42.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.591+0000 7f9661d65640 1 -- 172.21.15.47:0/581450170 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f965c0cee30 msgr2=0x7f965c0b1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:42.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.591+0000 7f9661d65640 1 --2- 172.21.15.47:0/581450170 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f965c0cee30 0x7f965c0b1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:42.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.591+0000 7f9661d65640 1 -- 172.21.15.47:0/581450170 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f965c1f4000 con 0x7f965c0c93f0 2024-04-01T23:01:42.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.594+0000 7f9661d65640 1 --2- 172.21.15.47:0/581450170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f965c0c93f0 0x7f965c0b4fa0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f965800c460 tx=0x7f965800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:42.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.597+0000 7f96527fc640 1 -- 172.21.15.47:0/581450170 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9658017070 con 0x7f965c0c93f0 2024-04-01T23:01:42.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.597+0000 7f96527fc640 1 -- 172.21.15.47:0/581450170 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9658005ce0 con 0x7f965c0c93f0 2024-04-01T23:01:42.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.597+0000 7f96527fc640 1 -- 172.21.15.47:0/581450170 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96580072f0 con 0x7f965c0c93f0 2024-04-01T23:01:42.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.597+0000 7f9663fc9640 1 -- 172.21.15.47:0/581450170 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f965c14df40 con 0x7f965c0c93f0 2024-04-01T23:01:42.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.597+0000 7f9663fc9640 1 -- 172.21.15.47:0/581450170 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f965c14e500 con 0x7f965c0c93f0 2024-04-01T23:01:42.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.599+0000 7f9663fc9640 1 -- 172.21.15.47:0/581450170 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f965c068210 con 0x7f965c0c93f0 2024-04-01T23:01:42.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.617+0000 7f96527fc640 1 -- 172.21.15.47:0/581450170 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f965801a070 con 0x7f965c0c93f0 2024-04-01T23:01:42.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.618+0000 7f96527fc640 1 --2- 172.21.15.47:0/581450170 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f964006b9e0 0x7f964006dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:42.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.618+0000 7f9661564640 1 --2- 172.21.15.47:0/581450170 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f964006b9e0 0x7f964006dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:42.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.618+0000 7f9661564640 1 --2- 172.21.15.47:0/581450170 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f964006b9e0 0x7f964006dea0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f965c0b2870 tx=0x7f964c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:42.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.621+0000 7f96527fc640 1 -- 172.21.15.47:0/581450170 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f96580566c0 con 0x7f965c0c93f0 2024-04-01T23:01:42.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:42.882+0000 7f96527fc640 1 -- 172.21.15.47:0/581450170 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f9658021020 con 0x7f965c0c93f0 2024-04-01T23:01:43.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.081+0000 7f9663fc9640 1 -- 172.21.15.47:0/581450170 --> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f965c14e6d0 con 0x7f964006b9e0 2024-04-01T23:01:43.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.081+0000 7f96527fc640 1 -- 172.21.15.47:0/581450170 <== mgr.4107 v2:172.21.15.47:6800/1257047371 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f965c14e6d0 con 0x7f964006b9e0 2024-04-01T23:01:43.077 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 0 to deep-scrub 2024-04-01T23:01:43.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.084+0000 7f9663fc9640 1 -- 172.21.15.47:0/581450170 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f964006b9e0 msgr2=0x7f964006dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:43.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.084+0000 7f9663fc9640 1 --2- 172.21.15.47:0/581450170 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f964006b9e0 0x7f964006dea0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f965c0b2870 tx=0x7f964c009040 comp rx=0 tx=0).stop 2024-04-01T23:01:43.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.084+0000 7f9663fc9640 1 -- 172.21.15.47:0/581450170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f965c0c93f0 msgr2=0x7f965c0b4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:43.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.084+0000 7f9663fc9640 1 --2- 172.21.15.47:0/581450170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f965c0c93f0 0x7f965c0b4fa0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f965800c460 tx=0x7f965800c920 comp rx=0 tx=0).stop 2024-04-01T23:01:43.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.085+0000 7f9663fc9640 1 -- 172.21.15.47:0/581450170 shutdown_connections 2024-04-01T23:01:43.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.085+0000 7f9663fc9640 1 --2- 172.21.15.47:0/581450170 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f964006b9e0 0x7f964006dea0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:43.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.085+0000 7f9663fc9640 1 --2- 172.21.15.47:0/581450170 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f965c0cee30 0x7f965c0b1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:43.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.085+0000 7f9663fc9640 1 --2- 172.21.15.47:0/581450170 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f965c0cc7e0 0x7f965c1f3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:43.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.085+0000 7f9663fc9640 1 --2- 172.21.15.47:0/581450170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f965c0c93f0 0x7f965c0b4fa0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:43.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.085+0000 7f9663fc9640 1 -- 172.21.15.47:0/581450170 >> 172.21.15.47:0/581450170 conn(0x7f965c0cfdb0 msgr2=0x7f965c0c8980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:43.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.085+0000 7f9663fc9640 1 -- 172.21.15.47:0/581450170 shutdown_connections 2024-04-01T23:01:43.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.085+0000 7f9663fc9640 1 -- 172.21.15.47:0/581450170 wait complete. 2024-04-01T23:01:43.096 INFO:tasks.ceph:Scrubbing osd.1 2024-04-01T23:01:43.096 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-01T23:01:43.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.207+0000 7f7d3d3eb640 1 Processor -- start 2024-04-01T23:01:43.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.207+0000 7f7d3d3eb640 1 -- start start 2024-04-01T23:01:43.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.208+0000 7f7d3d3eb640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7d3806c230 0x7f7d3806c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:43.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.208+0000 7f7d3d3eb640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d380cf580 con 0x7f7d3815aec0 2024-04-01T23:01:43.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.208+0000 7f7d3d3eb640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d380cda50 con 0x7f7d380ca790 2024-04-01T23:01:43.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.208+0000 7f7d3d3eb640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f7d380cdd30 con 0x7f7d3806c230 2024-04-01T23:01:43.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.209+0000 7f7d36ffd640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7d3806c230 0x7f7d3806c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:43.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.209+0000 7f7d377fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f7d380ca790 0x7f7d380cabc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.47:56532/0 (socket says 172.21.15.47:56532) 2024-04-01T23:01:43.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.209+0000 7f7d377fe640 1 -- 172.21.15.47:0/1444273168 learned_addr learned my addr 172.21.15.47:0/1444273168 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T23:01:43.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.211+0000 7f7d367fc640 1 -- 172.21.15.47:0/1444273168 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2901596254 0 0) 0x7f7d380cda50 con 0x7f7d380ca790 2024-04-01T23:01:43.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.211+0000 7f7d367fc640 1 -- 172.21.15.47:0/1444273168 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d24003520 con 0x7f7d380ca790 2024-04-01T23:01:43.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.212+0000 7f7d36ffd640 1 -- 172.21.15.47:0/1444273168 >> v1:172.21.15.181:6789/0 conn(0x7f7d380ca790 legacy=0x7f7d380cabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:43.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.212+0000 7f7d36ffd640 1 -- 172.21.15.47:0/1444273168 >> v1:172.21.15.47:6789/0 conn(0x7f7d3815aec0 legacy=0x7f7d380cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:43.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.212+0000 7f7d36ffd640 1 -- 172.21.15.47:0/1444273168 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d380ce010 con 0x7f7d3806c230 2024-04-01T23:01:43.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.217+0000 7f7d36ffd640 1 --2- 172.21.15.47:0/1444273168 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d3806c230 0x7f7d3806c610 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7d280097a0 tx=0x7f7d2802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49a0d8001707c21f server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:43.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.224+0000 7f7d367fc640 1 -- 172.21.15.47:0/1444273168 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d28035020 con 0x7f7d3806c230 2024-04-01T23:01:43.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.224+0000 7f7d367fc640 1 -- 172.21.15.47:0/1444273168 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d28031830 con 0x7f7d3806c230 2024-04-01T23:01:43.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.224+0000 7f7d367fc640 1 -- 172.21.15.47:0/1444273168 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d28031c00 con 0x7f7d3806c230 2024-04-01T23:01:43.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.225+0000 7f7d3d3eb640 1 -- 172.21.15.47:0/1444273168 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d3806c230 msgr2=0x7f7d3806c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:43.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.225+0000 7f7d3d3eb640 1 --2- 172.21.15.47:0/1444273168 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d3806c230 0x7f7d3806c610 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7d280097a0 tx=0x7f7d2802b8d0 comp rx=0 tx=0).stop 2024-04-01T23:01:43.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.225+0000 7f7d3d3eb640 1 -- 172.21.15.47:0/1444273168 shutdown_connections 2024-04-01T23:01:43.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.225+0000 7f7d3d3eb640 1 --2- 172.21.15.47:0/1444273168 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d3806c230 0x7f7d3806c610 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:43.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.225+0000 7f7d3d3eb640 1 -- 172.21.15.47:0/1444273168 >> 172.21.15.47:0/1444273168 conn(0x7f7d380cfdb0 msgr2=0x7f7d380d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:43.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.225+0000 7f7d3d3eb640 1 -- 172.21.15.47:0/1444273168 shutdown_connections 2024-04-01T23:01:43.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.225+0000 7f7d3d3eb640 1 -- 172.21.15.47:0/1444273168 wait complete. 2024-04-01T23:01:43.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.226+0000 7f7d3d3eb640 1 Processor -- start 2024-04-01T23:01:43.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.226+0000 7f7d3d3eb640 1 -- start start 2024-04-01T23:01:43.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.227+0000 7f7d3d3eb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d3806c230 0x7f7d381e3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:43.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.227+0000 7f7d3d3eb640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7d380ca790 0x7f7d381e2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:43.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.227+0000 7f7d3d3eb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d3815aec0 0x7f7d381e2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:43.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.227+0000 7f7d3d3eb640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7d3815b330 con 0x7f7d3815aec0 2024-04-01T23:01:43.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.227+0000 7f7d3d3eb640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7d380ce5d0 con 0x7f7d3806c230 2024-04-01T23:01:43.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.227+0000 7f7d3d3eb640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f7d380c9740 con 0x7f7d380ca790 2024-04-01T23:01:43.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.227+0000 7f7d36ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d3806c230 0x7f7d381e3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:43.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.227+0000 7f7d2ffff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7d380ca790 0x7f7d381e2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:43.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.228+0000 7f7d36ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d3806c230 0x7f7d381e3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:48236/0 (socket says 172.21.15.47:48236) 2024-04-01T23:01:43.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.228+0000 7f7d36ffd640 1 -- 172.21.15.47:0/4103088387 learned_addr learned my addr 172.21.15.47:0/4103088387 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:43.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.231+0000 7f7d36ffd640 1 -- 172.21.15.47:0/4103088387 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7d380ca790 msgr2=0x7f7d381e2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:43.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.231+0000 7f7d36ffd640 1 --2- 172.21.15.47:0/4103088387 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7d380ca790 0x7f7d381e2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:43.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.231+0000 7f7d36ffd640 1 -- 172.21.15.47:0/4103088387 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d3815aec0 msgr2=0x7f7d381e2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:43.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.231+0000 7f7d36ffd640 1 --2- 172.21.15.47:0/4103088387 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d3815aec0 0x7f7d381e2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:43.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.231+0000 7f7d36ffd640 1 -- 172.21.15.47:0/4103088387 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d381e41d0 con 0x7f7d3806c230 2024-04-01T23:01:43.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.234+0000 7f7d36ffd640 1 --2- 172.21.15.47:0/4103088387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d3806c230 0x7f7d381e3a50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7d280098c0 tx=0x7f7d280046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:43.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.238+0000 7f7d2f7fe640 1 -- 172.21.15.47:0/4103088387 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d28040070 con 0x7f7d3806c230 2024-04-01T23:01:43.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.238+0000 7f7d2f7fe640 1 -- 172.21.15.47:0/4103088387 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d2803e070 con 0x7f7d3806c230 2024-04-01T23:01:43.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.238+0000 7f7d3d3eb640 1 -- 172.21.15.47:0/4103088387 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d381e4470 con 0x7f7d3806c230 2024-04-01T23:01:43.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.238+0000 7f7d2f7fe640 1 -- 172.21.15.47:0/4103088387 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d28035040 con 0x7f7d3806c230 2024-04-01T23:01:43.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.238+0000 7f7d3d3eb640 1 -- 172.21.15.47:0/4103088387 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d380b1b80 con 0x7f7d3806c230 2024-04-01T23:01:43.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.239+0000 7f7d3d3eb640 1 -- 172.21.15.47:0/4103088387 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7d380cda50 con 0x7f7d3806c230 2024-04-01T23:01:43.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.257+0000 7f7d2f7fe640 1 -- 172.21.15.47:0/4103088387 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f7d28038020 con 0x7f7d3806c230 2024-04-01T23:01:43.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.257+0000 7f7d2f7fe640 1 --2- 172.21.15.47:0/4103088387 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f7d1806b9e0 0x7f7d1806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:43.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.257+0000 7f7d2ffff640 1 --2- 172.21.15.47:0/4103088387 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f7d1806b9e0 0x7f7d1806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:43.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.258+0000 7f7d2ffff640 1 --2- 172.21.15.47:0/4103088387 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f7d1806b9e0 0x7f7d1806dea0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7d380c8d30 tx=0x7f7d20009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:43.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.260+0000 7f7d2f7fe640 1 -- 172.21.15.47:0/4103088387 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f7d28078730 con 0x7f7d3806c230 2024-04-01T23:01:43.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.260+0000 7f7d2f7fe640 1 --2- 172.21.15.47:0/4103088387 >> [v2:172.21.15.47:6826/3152157503,v1:172.21.15.47:6827/3152157503] conn(0x7f7d18075370 0x7f7d18077810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:43.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.260+0000 7f7d2f7fe640 1 -- 172.21.15.47:0/4103088387 --> [v2:172.21.15.47:6826/3152157503,v1:172.21.15.47:6827/3152157503] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7d18077ee0 con 0x7f7d18075370 2024-04-01T23:01:43.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.261+0000 7f7d377fe640 1 --2- 172.21.15.47:0/4103088387 >> [v2:172.21.15.47:6826/3152157503,v1:172.21.15.47:6827/3152157503] conn(0x7f7d18075370 0x7f7d18077810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:43.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.261+0000 7f7d377fe640 1 --2- 172.21.15.47:0/4103088387 >> [v2:172.21.15.47:6826/3152157503,v1:172.21.15.47:6827/3152157503] conn(0x7f7d18075370 0x7f7d18077810 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:43.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.262+0000 7f7d2f7fe640 1 -- 172.21.15.47:0/4103088387 <== osd.1 v2:172.21.15.47:6826/3152157503 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7d18077ee0 con 0x7f7d18075370 2024-04-01T23:01:43.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.275+0000 7f7d3d3eb640 1 -- 172.21.15.47:0/4103088387 --> [v2:172.21.15.47:6826/3152157503,v1:172.21.15.47:6827/3152157503] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7d38154b70 con 0x7f7d18075370 2024-04-01T23:01:43.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.276+0000 7f7d2f7fe640 1 -- 172.21.15.47:0/4103088387 <== osd.1 v2:172.21.15.47:6826/3152157503 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7d38154b70 con 0x7f7d18075370 2024-04-01T23:01:43.272 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-01T23:01:43.272 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-01T23:01:43.273 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-01T23:01:43.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.276+0000 7f7d3d3eb640 1 -- 172.21.15.47:0/4103088387 >> [v2:172.21.15.47:6826/3152157503,v1:172.21.15.47:6827/3152157503] conn(0x7f7d18075370 msgr2=0x7f7d18077810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:43.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.276+0000 7f7d3d3eb640 1 --2- 172.21.15.47:0/4103088387 >> [v2:172.21.15.47:6826/3152157503,v1:172.21.15.47:6827/3152157503] conn(0x7f7d18075370 0x7f7d18077810 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:43.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.276+0000 7f7d3d3eb640 1 -- 172.21.15.47:0/4103088387 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f7d1806b9e0 msgr2=0x7f7d1806dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:43.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.276+0000 7f7d3d3eb640 1 --2- 172.21.15.47:0/4103088387 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f7d1806b9e0 0x7f7d1806dea0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7d380c8d30 tx=0x7f7d20009040 comp rx=0 tx=0).stop 2024-04-01T23:01:43.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.276+0000 7f7d3d3eb640 1 -- 172.21.15.47:0/4103088387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d3806c230 msgr2=0x7f7d381e3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:43.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.276+0000 7f7d3d3eb640 1 --2- 172.21.15.47:0/4103088387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d3806c230 0x7f7d381e3a50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7d280098c0 tx=0x7f7d280046c0 comp rx=0 tx=0).stop 2024-04-01T23:01:43.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.276+0000 7f7d377fe640 1 -- 172.21.15.47:0/4103088387 reap_dead start 2024-04-01T23:01:43.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.276+0000 7f7d3d3eb640 1 -- 172.21.15.47:0/4103088387 shutdown_connections 2024-04-01T23:01:43.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.276+0000 7f7d3d3eb640 1 -- 172.21.15.47:0/4103088387 >> 172.21.15.47:0/4103088387 conn(0x7f7d380cfdb0 msgr2=0x7f7d380cabc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:43.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.276+0000 7f7d3d3eb640 1 -- 172.21.15.47:0/4103088387 shutdown_connections 2024-04-01T23:01:43.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.276+0000 7f7d3d3eb640 1 -- 172.21.15.47:0/4103088387 wait complete. 2024-04-01T23:01:43.283 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-01T23:01:43.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.394+0000 7f1f3501c640 1 Processor -- start 2024-04-01T23:01:43.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.394+0000 7f1f3501c640 1 -- start start 2024-04-01T23:01:43.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.395+0000 7f1f3501c640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1f300c93f0 0x7f1f300cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:43.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.395+0000 7f1f3501c640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f300cdae0 con 0x7f1f300cc0d0 2024-04-01T23:01:43.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.395+0000 7f1f3501c640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f300c97d0 con 0x7f1f3015afc0 2024-04-01T23:01:43.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.395+0000 7f1f3501c640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f1f300cdd80 con 0x7f1f300c93f0 2024-04-01T23:01:43.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.396+0000 7f1f2f59e640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f1f300cc0d0 0x7f1f300cc560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35632/0 (socket says 172.21.15.47:35632) 2024-04-01T23:01:43.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.396+0000 7f1f2f59e640 1 -- 172.21.15.47:0/258025018 learned_addr learned my addr 172.21.15.47:0/258025018 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T23:01:43.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.396+0000 7f1f2ed9d640 1 --2- 172.21.15.47:0/258025018 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1f300c93f0 0x7f1f300cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:43.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.399+0000 7f1f2dd9b640 1 -- 172.21.15.47:0/258025018 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3122562144 0 0) 0x7f1f300c97d0 con 0x7f1f3015afc0 2024-04-01T23:01:43.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.399+0000 7f1f2dd9b640 1 -- 172.21.15.47:0/258025018 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f1c003520 con 0x7f1f3015afc0 2024-04-01T23:01:43.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.399+0000 7f1f2ed9d640 1 -- 172.21.15.47:0/258025018 >> v1:172.21.15.181:6789/0 conn(0x7f1f3015afc0 legacy=0x7f1f3006c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:43.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.399+0000 7f1f2ed9d640 1 -- 172.21.15.47:0/258025018 >> v1:172.21.15.47:6789/0 conn(0x7f1f300cc0d0 legacy=0x7f1f300cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:43.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.399+0000 7f1f2ed9d640 1 -- 172.21.15.47:0/258025018 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f300ce060 con 0x7f1f300c93f0 2024-04-01T23:01:43.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.401+0000 7f1f2ed9d640 1 --2- 172.21.15.47:0/258025018 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1f300c93f0 0x7f1f300cee30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1f28009dc0 tx=0x7f1f2802be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ada1332eadcc563b server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:43.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.405+0000 7f1f2dd9b640 1 -- 172.21.15.47:0/258025018 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f28039070 con 0x7f1f300c93f0 2024-04-01T23:01:43.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.405+0000 7f1f2dd9b640 1 -- 172.21.15.47:0/258025018 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f2802cc40 con 0x7f1f300c93f0 2024-04-01T23:01:43.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.405+0000 7f1f2dd9b640 1 -- 172.21.15.47:0/258025018 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f28034440 con 0x7f1f300c93f0 2024-04-01T23:01:43.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.406+0000 7f1f3501c640 1 -- 172.21.15.47:0/258025018 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1f300c93f0 msgr2=0x7f1f300cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:43.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.406+0000 7f1f3501c640 1 --2- 172.21.15.47:0/258025018 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1f300c93f0 0x7f1f300cee30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1f28009dc0 tx=0x7f1f2802be90 comp rx=0 tx=0).stop 2024-04-01T23:01:43.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.406+0000 7f1f3501c640 1 -- 172.21.15.47:0/258025018 shutdown_connections 2024-04-01T23:01:43.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.406+0000 7f1f3501c640 1 --2- 172.21.15.47:0/258025018 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1f300c93f0 0x7f1f300cee30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:43.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.406+0000 7f1f3501c640 1 -- 172.21.15.47:0/258025018 >> 172.21.15.47:0/258025018 conn(0x7f1f300cfdb0 msgr2=0x7f1f300d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:43.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.406+0000 7f1f3501c640 1 -- 172.21.15.47:0/258025018 shutdown_connections 2024-04-01T23:01:43.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.406+0000 7f1f3501c640 1 -- 172.21.15.47:0/258025018 wait complete. 2024-04-01T23:01:43.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.408+0000 7f1f3501c640 1 Processor -- start 2024-04-01T23:01:43.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.408+0000 7f1f3501c640 1 -- start start 2024-04-01T23:01:43.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.409+0000 7f1f3501c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f300c93f0 0x7f1f300b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:43.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.409+0000 7f1f3501c640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1f300cc0d0 0x7f1f301ee010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:43.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.409+0000 7f1f3501c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f3015afc0 0x7f1f301539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:43.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.409+0000 7f1f3501c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3015b400 con 0x7f1f3015afc0 2024-04-01T23:01:43.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.409+0000 7f1f3501c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1f300ce620 con 0x7f1f300c93f0 2024-04-01T23:01:43.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.409+0000 7f1f3501c640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f1f300cf430 con 0x7f1f300cc0d0 2024-04-01T23:01:43.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.409+0000 7f1f2f59e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f3015afc0 0x7f1f301539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:43.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.409+0000 7f1f2ed9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f300c93f0 0x7f1f300b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:43.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.410+0000 7f1f2e59c640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1f300cc0d0 0x7f1f301ee010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:43.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.410+0000 7f1f2f59e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f3015afc0 0x7f1f301539d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53230/0 (socket says 172.21.15.47:53230) 2024-04-01T23:01:43.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.410+0000 7f1f2f59e640 1 -- 172.21.15.47:0/1137839914 learned_addr learned my addr 172.21.15.47:0/1137839914 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:43.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.413+0000 7f1f2ed9d640 1 -- 172.21.15.47:0/1137839914 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1f300cc0d0 msgr2=0x7f1f301ee010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:43.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.413+0000 7f1f2ed9d640 1 --2- 172.21.15.47:0/1137839914 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1f300cc0d0 0x7f1f301ee010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:43.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.413+0000 7f1f2ed9d640 1 -- 172.21.15.47:0/1137839914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f3015afc0 msgr2=0x7f1f301539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:43.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.413+0000 7f1f2ed9d640 1 --2- 172.21.15.47:0/1137839914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f3015afc0 0x7f1f301539d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:43.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.413+0000 7f1f2ed9d640 1 -- 172.21.15.47:0/1137839914 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f300c3880 con 0x7f1f300c93f0 2024-04-01T23:01:43.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.413+0000 7f1f2e59c640 1 --2- 172.21.15.47:0/1137839914 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1f300cc0d0 0x7f1f301ee010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T23:01:43.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.416+0000 7f1f2ed9d640 1 --2- 172.21.15.47:0/1137839914 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f300c93f0 0x7f1f300b3d50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1f30073780 tx=0x7f1f28004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:43.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.419+0000 7f1f277fe640 1 -- 172.21.15.47:0/1137839914 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f28044020 con 0x7f1f300c93f0 2024-04-01T23:01:43.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.419+0000 7f1f277fe640 1 -- 172.21.15.47:0/1137839914 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f28035db0 con 0x7f1f300c93f0 2024-04-01T23:01:43.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.419+0000 7f1f277fe640 1 -- 172.21.15.47:0/1137839914 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f28039040 con 0x7f1f300c93f0 2024-04-01T23:01:43.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.419+0000 7f1f3501c640 1 -- 172.21.15.47:0/1137839914 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f300c3b40 con 0x7f1f300c93f0 2024-04-01T23:01:43.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.419+0000 7f1f3501c640 1 -- 172.21.15.47:0/1137839914 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f300b3270 con 0x7f1f300c93f0 2024-04-01T23:01:43.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.420+0000 7f1f3501c640 1 -- 172.21.15.47:0/1137839914 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f30068210 con 0x7f1f300c93f0 2024-04-01T23:01:43.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.439+0000 7f1f277fe640 1 -- 172.21.15.47:0/1137839914 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f1f28047020 con 0x7f1f300c93f0 2024-04-01T23:01:43.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.440+0000 7f1f277fe640 1 --2- 172.21.15.47:0/1137839914 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f1f1006b9e0 0x7f1f1006dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:43.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.440+0000 7f1f2e59c640 1 --2- 172.21.15.47:0/1137839914 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f1f1006b9e0 0x7f1f1006dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:43.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.440+0000 7f1f2e59c640 1 --2- 172.21.15.47:0/1137839914 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f1f1006b9e0 0x7f1f1006dea0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1f18007fd0 tx=0x7f1f18009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:43.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.671+0000 7f1f277fe640 1 -- 172.21.15.47:0/1137839914 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f1f280798d0 con 0x7f1f300c93f0 2024-04-01T23:01:43.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.681+0000 7f1f277fe640 1 -- 172.21.15.47:0/1137839914 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f1f2804e030 con 0x7f1f300c93f0 2024-04-01T23:01:43.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.863+0000 7f1f3501c640 1 -- 172.21.15.47:0/1137839914 --> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f1f301548a0 con 0x7f1f1006b9e0 2024-04-01T23:01:43.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.863+0000 7f1f277fe640 1 -- 172.21.15.47:0/1137839914 <== mgr.4107 v2:172.21.15.47:6800/1257047371 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1f301548a0 con 0x7f1f1006b9e0 2024-04-01T23:01:43.860 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 1 to deep-scrub 2024-04-01T23:01:43.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.866+0000 7f1f3501c640 1 -- 172.21.15.47:0/1137839914 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f1f1006b9e0 msgr2=0x7f1f1006dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:43.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.866+0000 7f1f3501c640 1 --2- 172.21.15.47:0/1137839914 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f1f1006b9e0 0x7f1f1006dea0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1f18007fd0 tx=0x7f1f18009040 comp rx=0 tx=0).stop 2024-04-01T23:01:43.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.866+0000 7f1f3501c640 1 -- 172.21.15.47:0/1137839914 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f300c93f0 msgr2=0x7f1f300b3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:43.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.866+0000 7f1f3501c640 1 --2- 172.21.15.47:0/1137839914 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f300c93f0 0x7f1f300b3d50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1f30073780 tx=0x7f1f28004a40 comp rx=0 tx=0).stop 2024-04-01T23:01:43.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.866+0000 7f1f3501c640 1 -- 172.21.15.47:0/1137839914 shutdown_connections 2024-04-01T23:01:43.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.866+0000 7f1f3501c640 1 --2- 172.21.15.47:0/1137839914 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f1f1006b9e0 0x7f1f1006dea0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:43.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.866+0000 7f1f3501c640 1 --2- 172.21.15.47:0/1137839914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f3015afc0 0x7f1f301539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:43.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.866+0000 7f1f3501c640 1 --2- 172.21.15.47:0/1137839914 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f1f300cc0d0 0x7f1f301ee010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:43.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.866+0000 7f1f3501c640 1 --2- 172.21.15.47:0/1137839914 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f300c93f0 0x7f1f300b3d50 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:43.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.866+0000 7f1f3501c640 1 -- 172.21.15.47:0/1137839914 >> 172.21.15.47:0/1137839914 conn(0x7f1f300cfdb0 msgr2=0x7f1f300cb2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:43.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.866+0000 7f1f3501c640 1 -- 172.21.15.47:0/1137839914 shutdown_connections 2024-04-01T23:01:43.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:43.866+0000 7f1f3501c640 1 -- 172.21.15.47:0/1137839914 wait complete. 2024-04-01T23:01:43.874 INFO:tasks.ceph:Scrubbing osd.2 2024-04-01T23:01:43.874 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-01T23:01:44.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.027+0000 7f4e8df1e640 1 Processor -- start 2024-04-01T23:01:44.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.027+0000 7f4e8df1e640 1 -- start start 2024-04-01T23:01:44.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.028+0000 7f4e8df1e640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4e880c93f0 0x7f4e880cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:44.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.028+0000 7f4e8df1e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4e8815afc0 0x7f4e8806c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:44.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.028+0000 7f4e8df1e640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e880cdae0 con 0x7f4e8806c770 2024-04-01T23:01:44.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.028+0000 7f4e8df1e640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f4e880c97d0 con 0x7f4e8815afc0 2024-04-01T23:01:44.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.028+0000 7f4e8df1e640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f4e880cdd80 con 0x7f4e880c93f0 2024-04-01T23:01:44.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.029+0000 7f4e86ffd640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4e8815afc0 0x7f4e8806c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:44.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.029+0000 7f4e877fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4e880c93f0 0x7f4e880cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:44.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.029+0000 7f4e877fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4e880c93f0 0x7f4e880cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:48250/0 (socket says 172.21.15.47:48250) 2024-04-01T23:01:44.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.029+0000 7f4e877fe640 1 -- 172.21.15.47:0/596719441 learned_addr learned my addr 172.21.15.47:0/596719441 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:44.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.032+0000 7f4e877fe640 1 -- 172.21.15.47:0/596719441 >> v2:172.21.15.47:3300/0 conn(0x7f4e8815afc0 msgr2=0x7f4e8806c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:01:44.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.032+0000 7f4e877fe640 1 --2- 172.21.15.47:0/596719441 >> v2:172.21.15.47:3300/0 conn(0x7f4e8815afc0 0x7f4e8806c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:44.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.032+0000 7f4e877fe640 1 -- 172.21.15.47:0/596719441 >> v1:172.21.15.47:6789/0 conn(0x7f4e8806c770 legacy=0x7f4e880cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:01:44.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.032+0000 7f4e877fe640 1 -- 172.21.15.47:0/596719441 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e880ce060 con 0x7f4e880c93f0 2024-04-01T23:01:44.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.034+0000 7f4e877fe640 1 --2- 172.21.15.47:0/596719441 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e880c93f0 0x7f4e880cee30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4e8808d100 tx=0x7f4e7002b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf74892f19e619df server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:44.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.041+0000 7f4e867fc640 1 -- 172.21.15.47:0/596719441 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e7002e070 con 0x7f4e880c93f0 2024-04-01T23:01:44.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.041+0000 7f4e867fc640 1 -- 172.21.15.47:0/596719441 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e70037070 con 0x7f4e880c93f0 2024-04-01T23:01:44.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.041+0000 7f4e867fc640 1 -- 172.21.15.47:0/596719441 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e70031a00 con 0x7f4e880c93f0 2024-04-01T23:01:44.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.041+0000 7f4e8df1e640 1 -- 172.21.15.47:0/596719441 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e880c93f0 msgr2=0x7f4e880cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:44.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.041+0000 7f4e8df1e640 1 --2- 172.21.15.47:0/596719441 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e880c93f0 0x7f4e880cee30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4e8808d100 tx=0x7f4e7002b880 comp rx=0 tx=0).stop 2024-04-01T23:01:44.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.041+0000 7f4e8df1e640 1 -- 172.21.15.47:0/596719441 shutdown_connections 2024-04-01T23:01:44.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.041+0000 7f4e8df1e640 1 --2- 172.21.15.47:0/596719441 >> v2:172.21.15.47:3300/0 conn(0x7f4e8815afc0 0x7f4e8806c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:44.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.041+0000 7f4e8df1e640 1 --2- 172.21.15.47:0/596719441 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e880c93f0 0x7f4e880cee30 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:44.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.041+0000 7f4e8df1e640 1 -- 172.21.15.47:0/596719441 >> 172.21.15.47:0/596719441 conn(0x7f4e880cfdb0 msgr2=0x7f4e880d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:44.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.041+0000 7f4e8df1e640 1 -- 172.21.15.47:0/596719441 shutdown_connections 2024-04-01T23:01:44.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.041+0000 7f4e8df1e640 1 -- 172.21.15.47:0/596719441 wait complete. 2024-04-01T23:01:44.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.042+0000 7f4e8df1e640 1 Processor -- start 2024-04-01T23:01:44.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.043+0000 7f4e8df1e640 1 -- start start 2024-04-01T23:01:44.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.043+0000 7f4e8df1e640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4e8806c770 0x7f4e880c3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:44.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.043+0000 7f4e8df1e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e880c93f0 0x7f4e88153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:44.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.043+0000 7f4e8df1e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e8815afc0 0x7f4e88154460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:44.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.043+0000 7f4e8df1e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4e8815b400 con 0x7f4e880c93f0 2024-04-01T23:01:44.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.043+0000 7f4e8df1e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4e880ce620 con 0x7f4e8815afc0 2024-04-01T23:01:44.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.043+0000 7f4e8df1e640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f4e880cf430 con 0x7f4e8806c770 2024-04-01T23:01:44.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.044+0000 7f4e86ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e880c93f0 0x7f4e88153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:44.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.044+0000 7f4e877fe640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4e8806c770 0x7f4e880c3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:44.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.044+0000 7f4e87fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e8815afc0 0x7f4e88154460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:44.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.044+0000 7f4e87fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e8815afc0 0x7f4e88154460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:48260/0 (socket says 172.21.15.47:48260) 2024-04-01T23:01:44.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.044+0000 7f4e87fff640 1 -- 172.21.15.47:0/4221167901 learned_addr learned my addr 172.21.15.47:0/4221167901 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:44.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.044+0000 7f4e877fe640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4e8806c770 0x7f4e880c3970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:41776/0 (socket says 172.21.15.47:41776) 2024-04-01T23:01:44.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.048+0000 7f4e877fe640 1 -- 172.21.15.47:0/4221167901 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e8815afc0 msgr2=0x7f4e88154460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:44.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.048+0000 7f4e877fe640 1 --2- 172.21.15.47:0/4221167901 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4e8815afc0 0x7f4e88154460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:44.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.048+0000 7f4e877fe640 1 -- 172.21.15.47:0/4221167901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e880c93f0 msgr2=0x7f4e88153f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:44.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.048+0000 7f4e877fe640 1 --2- 172.21.15.47:0/4221167901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e880c93f0 0x7f4e88153f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:44.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.048+0000 7f4e877fe640 1 -- 172.21.15.47:0/4221167901 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e880c5d00 con 0x7f4e8806c770 2024-04-01T23:01:44.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.050+0000 7f4e877fe640 1 --2- 172.21.15.47:0/4221167901 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4e8806c770 0x7f4e880c3970 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4e70033000 tx=0x7f4e700046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:44.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.054+0000 7f4e7ffff640 1 -- 172.21.15.47:0/4221167901 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e70032880 con 0x7f4e8806c770 2024-04-01T23:01:44.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.054+0000 7f4e7ffff640 1 -- 172.21.15.47:0/4221167901 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e70032a20 con 0x7f4e8806c770 2024-04-01T23:01:44.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.054+0000 7f4e7ffff640 1 -- 172.21.15.47:0/4221167901 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e70032e10 con 0x7f4e8806c770 2024-04-01T23:01:44.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.054+0000 7f4e8df1e640 1 -- 172.21.15.47:0/4221167901 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e881e4020 con 0x7f4e8806c770 2024-04-01T23:01:44.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.054+0000 7f4e8df1e640 1 -- 172.21.15.47:0/4221167901 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e880c5fc0 con 0x7f4e8806c770 2024-04-01T23:01:44.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.054+0000 7f4e8df1e640 1 -- 172.21.15.47:0/4221167901 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4e88068210 con 0x7f4e8806c770 2024-04-01T23:01:44.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.074+0000 7f4e7ffff640 1 -- 172.21.15.47:0/4221167901 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f4e7004e440 con 0x7f4e8806c770 2024-04-01T23:01:44.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.075+0000 7f4e7ffff640 1 --2- 172.21.15.47:0/4221167901 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f4e6806b9e0 0x7f4e6806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:44.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.075+0000 7f4e86ffd640 1 --2- 172.21.15.47:0/4221167901 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f4e6806b9e0 0x7f4e6806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:44.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.075+0000 7f4e86ffd640 1 --2- 172.21.15.47:0/4221167901 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f4e6806b9e0 0x7f4e6806dea0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4e8806d510 tx=0x7f4e78009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:44.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.079+0000 7f4e7ffff640 1 -- 172.21.15.47:0/4221167901 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f4e70079100 con 0x7f4e8806c770 2024-04-01T23:01:44.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.079+0000 7f4e7ffff640 1 --2- 172.21.15.47:0/4221167901 >> [v2:172.21.15.47:6802/1003968856,v1:172.21.15.47:6803/1003968856] conn(0x7f4e68075370 0x7f4e68077810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:44.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.079+0000 7f4e7ffff640 1 -- 172.21.15.47:0/4221167901 --> [v2:172.21.15.47:6802/1003968856,v1:172.21.15.47:6803/1003968856] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4e70042e50 con 0x7f4e68075370 2024-04-01T23:01:44.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.079+0000 7f4e87fff640 1 --2- 172.21.15.47:0/4221167901 >> [v2:172.21.15.47:6802/1003968856,v1:172.21.15.47:6803/1003968856] conn(0x7f4e68075370 0x7f4e68077810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:44.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.079+0000 7f4e7ffff640 1 -- 172.21.15.47:0/4221167901 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4e70077300 con 0x7f4e8806c770 2024-04-01T23:01:44.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.079+0000 7f4e87fff640 1 --2- 172.21.15.47:0/4221167901 >> [v2:172.21.15.47:6802/1003968856,v1:172.21.15.47:6803/1003968856] conn(0x7f4e68075370 0x7f4e68077810 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:44.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.080+0000 7f4e7ffff640 1 -- 172.21.15.47:0/4221167901 <== osd.2 v2:172.21.15.47:6802/1003968856 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4e70042e50 con 0x7f4e68075370 2024-04-01T23:01:44.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.095+0000 7f4e8df1e640 1 -- 172.21.15.47:0/4221167901 --> [v2:172.21.15.47:6802/1003968856,v1:172.21.15.47:6803/1003968856] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4e8806cf00 con 0x7f4e68075370 2024-04-01T23:01:44.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.095+0000 7f4e7ffff640 1 -- 172.21.15.47:0/4221167901 <== osd.2 v2:172.21.15.47:6802/1003968856 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f4e8806cf00 con 0x7f4e68075370 2024-04-01T23:01:44.092 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-01T23:01:44.092 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-01T23:01:44.092 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-01T23:01:44.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.095+0000 7f4e8df1e640 1 -- 172.21.15.47:0/4221167901 >> [v2:172.21.15.47:6802/1003968856,v1:172.21.15.47:6803/1003968856] conn(0x7f4e68075370 msgr2=0x7f4e68077810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:44.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.095+0000 7f4e8df1e640 1 --2- 172.21.15.47:0/4221167901 >> [v2:172.21.15.47:6802/1003968856,v1:172.21.15.47:6803/1003968856] conn(0x7f4e68075370 0x7f4e68077810 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:44.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.095+0000 7f4e8df1e640 1 -- 172.21.15.47:0/4221167901 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f4e6806b9e0 msgr2=0x7f4e6806dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:44.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.095+0000 7f4e8df1e640 1 --2- 172.21.15.47:0/4221167901 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f4e6806b9e0 0x7f4e6806dea0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4e8806d510 tx=0x7f4e78009190 comp rx=0 tx=0).stop 2024-04-01T23:01:44.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.095+0000 7f4e8df1e640 1 -- 172.21.15.47:0/4221167901 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4e8806c770 msgr2=0x7f4e880c3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:44.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.095+0000 7f4e8df1e640 1 --2- 172.21.15.47:0/4221167901 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4e8806c770 0x7f4e880c3970 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4e70033000 tx=0x7f4e700046c0 comp rx=0 tx=0).stop 2024-04-01T23:01:44.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.095+0000 7f4e87fff640 1 -- 172.21.15.47:0/4221167901 reap_dead start 2024-04-01T23:01:44.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.095+0000 7f4e8df1e640 1 -- 172.21.15.47:0/4221167901 shutdown_connections 2024-04-01T23:01:44.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.095+0000 7f4e8df1e640 1 -- 172.21.15.47:0/4221167901 >> 172.21.15.47:0/4221167901 conn(0x7f4e880cfdb0 msgr2=0x7f4e880c6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:44.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.096+0000 7f4e8df1e640 1 -- 172.21.15.47:0/4221167901 shutdown_connections 2024-04-01T23:01:44.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.096+0000 7f4e8df1e640 1 -- 172.21.15.47:0/4221167901 wait complete. 2024-04-01T23:01:44.103 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-01T23:01:44.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.211+0000 7f8099d48640 1 Processor -- start 2024-04-01T23:01:44.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.211+0000 7f8099d48640 1 -- start start 2024-04-01T23:01:44.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.212+0000 7f8099d48640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f80940cac90 0x7f80940c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:44.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.212+0000 7f8099d48640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80940c99d0 con 0x7f80940c88c0 2024-04-01T23:01:44.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.212+0000 7f8099d48640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80940c9cb0 con 0x7f8094154660 2024-04-01T23:01:44.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.212+0000 7f8099d48640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f80940c3790 con 0x7f80940cac90 2024-04-01T23:01:44.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.212+0000 7f8093fff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f80940cac90 0x7f80940c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:44.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.212+0000 7f80937fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f8094154660 0x7f809415e380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.47:56552/0 (socket says 172.21.15.47:56552) 2024-04-01T23:01:44.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.213+0000 7f80937fe640 1 -- 172.21.15.47:0/2815210931 learned_addr learned my addr 172.21.15.47:0/2815210931 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T23:01:44.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.215+0000 7f80927fc640 1 -- 172.21.15.47:0/2815210931 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2077597491 0 0) 0x7f80940c9cb0 con 0x7f8094154660 2024-04-01T23:01:44.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.215+0000 7f80927fc640 1 -- 172.21.15.47:0/2815210931 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f807c003520 con 0x7f8094154660 2024-04-01T23:01:44.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.216+0000 7f8093fff640 1 -- 172.21.15.47:0/2815210931 >> v1:172.21.15.181:6789/0 conn(0x7f8094154660 legacy=0x7f809415e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:44.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.216+0000 7f8093fff640 1 -- 172.21.15.47:0/2815210931 >> v1:172.21.15.47:6789/0 conn(0x7f80940c88c0 legacy=0x7f80940ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:44.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.216+0000 7f8093fff640 1 -- 172.21.15.47:0/2815210931 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80940c9f90 con 0x7f80940cac90 2024-04-01T23:01:44.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.220+0000 7f8093fff640 1 --2- 172.21.15.47:0/2815210931 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80940cac90 0x7f80940c8d30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f808c009d90 tx=0x7f808c02bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efe0e9aa6e9992fa server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:44.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.224+0000 7f80927fc640 1 -- 172.21.15.47:0/2815210931 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f808c039070 con 0x7f80940cac90 2024-04-01T23:01:44.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.224+0000 7f80927fc640 1 -- 172.21.15.47:0/2815210931 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f808c02cd80 con 0x7f80940cac90 2024-04-01T23:01:44.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.224+0000 7f80927fc640 1 -- 172.21.15.47:0/2815210931 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f808c034660 con 0x7f80940cac90 2024-04-01T23:01:44.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.225+0000 7f8099d48640 1 -- 172.21.15.47:0/2815210931 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80940cac90 msgr2=0x7f80940c8d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:44.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.225+0000 7f8099d48640 1 --2- 172.21.15.47:0/2815210931 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80940cac90 0x7f80940c8d30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f808c009d90 tx=0x7f808c02bfd0 comp rx=0 tx=0).stop 2024-04-01T23:01:44.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.225+0000 7f8099d48640 1 -- 172.21.15.47:0/2815210931 shutdown_connections 2024-04-01T23:01:44.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.225+0000 7f8099d48640 1 --2- 172.21.15.47:0/2815210931 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80940cac90 0x7f80940c8d30 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:44.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.225+0000 7f8099d48640 1 -- 172.21.15.47:0/2815210931 >> 172.21.15.47:0/2815210931 conn(0x7f8094071310 msgr2=0x7f8094071720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:44.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.225+0000 7f8099d48640 1 -- 172.21.15.47:0/2815210931 shutdown_connections 2024-04-01T23:01:44.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.225+0000 7f8099d48640 1 -- 172.21.15.47:0/2815210931 wait complete. 2024-04-01T23:01:44.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.226+0000 7f8099d48640 1 Processor -- start 2024-04-01T23:01:44.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.227+0000 7f8099d48640 1 -- start start 2024-04-01T23:01:44.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.227+0000 7f8099d48640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f80940c88c0 0x7f8094147620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:44.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.227+0000 7f8099d48640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f80940cac90 0x7f80941596b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:44.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.227+0000 7f8099d48640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8094154660 0x7f8094159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:44.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.227+0000 7f8099d48640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f809415de60 con 0x7f8094154660 2024-04-01T23:01:44.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.227+0000 7f8099d48640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f809415ea90 con 0x7f80940cac90 2024-04-01T23:01:44.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.227+0000 7f8099d48640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f80940ca270 con 0x7f80940c88c0 2024-04-01T23:01:44.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.228+0000 7f8092ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f80940cac90 0x7f80941596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:44.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.228+0000 7f8093fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8094154660 0x7f8094159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:44.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.228+0000 7f80937fe640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f80940c88c0 0x7f8094147620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:44.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.228+0000 7f8093fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8094154660 0x7f8094159bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53276/0 (socket says 172.21.15.47:53276) 2024-04-01T23:01:44.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.228+0000 7f8093fff640 1 -- 172.21.15.47:0/592699475 learned_addr learned my addr 172.21.15.47:0/592699475 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:44.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.232+0000 7f8093fff640 1 -- 172.21.15.47:0/592699475 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f80940c88c0 msgr2=0x7f8094147620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:44.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.232+0000 7f8093fff640 1 --2- 172.21.15.47:0/592699475 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f80940c88c0 0x7f8094147620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:44.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.232+0000 7f8093fff640 1 -- 172.21.15.47:0/592699475 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f80940cac90 msgr2=0x7f80941596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:44.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.232+0000 7f8093fff640 1 --2- 172.21.15.47:0/592699475 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f80940cac90 0x7f80941596b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:44.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.232+0000 7f8093fff640 1 -- 172.21.15.47:0/592699475 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8094158d70 con 0x7f8094154660 2024-04-01T23:01:44.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.235+0000 7f8093fff640 1 --2- 172.21.15.47:0/592699475 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8094154660 0x7f8094159bf0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f808c02c5e0 tx=0x7f808c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:44.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.241+0000 7f807bfff640 1 -- 172.21.15.47:0/592699475 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f808c044020 con 0x7f8094154660 2024-04-01T23:01:44.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.241+0000 7f807bfff640 1 -- 172.21.15.47:0/592699475 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f808c03f470 con 0x7f8094154660 2024-04-01T23:01:44.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.241+0000 7f807bfff640 1 -- 172.21.15.47:0/592699475 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f808c039040 con 0x7f8094154660 2024-04-01T23:01:44.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.241+0000 7f8099d48640 1 -- 172.21.15.47:0/592699475 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f809415b850 con 0x7f8094154660 2024-04-01T23:01:44.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.241+0000 7f8099d48640 1 -- 172.21.15.47:0/592699475 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f809415be10 con 0x7f8094154660 2024-04-01T23:01:44.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.242+0000 7f8099d48640 1 -- 172.21.15.47:0/592699475 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8094068210 con 0x7f8094154660 2024-04-01T23:01:44.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.511+0000 7f807bfff640 1 -- 172.21.15.47:0/592699475 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f808c047020 con 0x7f8094154660 2024-04-01T23:01:44.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.511+0000 7f807bfff640 1 --2- 172.21.15.47:0/592699475 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f808006b9c0 0x7f808006de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:44.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.512+0000 7f80937fe640 1 --2- 172.21.15.47:0/592699475 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f808006b9c0 0x7f808006de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:44.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.512+0000 7f80937fe640 1 --2- 172.21.15.47:0/592699475 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f808006b9c0 0x7f808006de80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8088005880 tx=0x7f8088009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:44.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.525+0000 7f807bfff640 1 -- 172.21.15.47:0/592699475 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f808c079de0 con 0x7f8094154660 2024-04-01T23:01:44.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.525+0000 7f807bfff640 1 -- 172.21.15.47:0/592699475 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f808c04e070 con 0x7f8094154660 2024-04-01T23:01:44.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.723+0000 7f8099d48640 1 -- 172.21.15.47:0/592699475 --> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f809415b490 con 0x7f808006b9c0 2024-04-01T23:01:44.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.724+0000 7f807bfff640 1 -- 172.21.15.47:0/592699475 <== mgr.4107 v2:172.21.15.47:6800/1257047371 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f809415b490 con 0x7f808006b9c0 2024-04-01T23:01:44.720 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 2 to deep-scrub 2024-04-01T23:01:44.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.726+0000 7f8099d48640 1 -- 172.21.15.47:0/592699475 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f808006b9c0 msgr2=0x7f808006de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:44.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.726+0000 7f8099d48640 1 --2- 172.21.15.47:0/592699475 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f808006b9c0 0x7f808006de80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8088005880 tx=0x7f8088009040 comp rx=0 tx=0).stop 2024-04-01T23:01:44.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.726+0000 7f8099d48640 1 -- 172.21.15.47:0/592699475 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8094154660 msgr2=0x7f8094159bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:44.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.726+0000 7f8099d48640 1 --2- 172.21.15.47:0/592699475 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8094154660 0x7f8094159bf0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f808c02c5e0 tx=0x7f808c004a40 comp rx=0 tx=0).stop 2024-04-01T23:01:44.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.726+0000 7f8099d48640 1 -- 172.21.15.47:0/592699475 shutdown_connections 2024-04-01T23:01:44.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.726+0000 7f8099d48640 1 --2- 172.21.15.47:0/592699475 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f808006b9c0 0x7f808006de80 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:44.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.726+0000 7f8099d48640 1 --2- 172.21.15.47:0/592699475 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8094154660 0x7f8094159bf0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:44.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.726+0000 7f8099d48640 1 --2- 172.21.15.47:0/592699475 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f80940cac90 0x7f80941596b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:44.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.726+0000 7f8099d48640 1 --2- 172.21.15.47:0/592699475 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f80940c88c0 0x7f8094147620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:44.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.726+0000 7f8099d48640 1 -- 172.21.15.47:0/592699475 >> 172.21.15.47:0/592699475 conn(0x7f8094071310 msgr2=0x7f80940ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:44.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.726+0000 7f8099d48640 1 -- 172.21.15.47:0/592699475 shutdown_connections 2024-04-01T23:01:44.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.726+0000 7f8099d48640 1 -- 172.21.15.47:0/592699475 wait complete. 2024-04-01T23:01:44.734 INFO:tasks.ceph:Scrubbing osd.3 2024-04-01T23:01:44.735 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-01T23:01:44.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.846+0000 7f4ea8d8a640 1 Processor -- start 2024-04-01T23:01:44.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.846+0000 7f4ea8d8a640 1 -- start start 2024-04-01T23:01:44.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.848+0000 7f4ea8d8a640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ea40c93f0 0x7f4ea40cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:44.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.848+0000 7f4ea8d8a640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4ea415afc0 0x7f4ea406c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:44.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.848+0000 7f4ea8d8a640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ea40cdae0 con 0x7f4ea406c770 2024-04-01T23:01:44.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.848+0000 7f4ea8d8a640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f4ea40c97d0 con 0x7f4ea415afc0 2024-04-01T23:01:44.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.848+0000 7f4ea8d8a640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f4ea40cdd80 con 0x7f4ea40c93f0 2024-04-01T23:01:44.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.848+0000 7f4ea1d9b640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4ea415afc0 0x7f4ea406c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:44.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.848+0000 7f4ea259c640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ea40c93f0 0x7f4ea40cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:44.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.849+0000 7f4ea1d9b640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4ea415afc0 0x7f4ea406c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53288/0 (socket says 172.21.15.47:53288) 2024-04-01T23:01:44.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.849+0000 7f4ea259c640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ea40c93f0 0x7f4ea40cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:41790/0 (socket says 172.21.15.47:41790) 2024-04-01T23:01:44.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.849+0000 7f4ea1d9b640 1 -- 172.21.15.47:0/3793948207 learned_addr learned my addr 172.21.15.47:0/3793948207 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:44.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.851+0000 7f4ea259c640 1 -- 172.21.15.47:0/3793948207 >> v2:172.21.15.47:3300/0 conn(0x7f4ea415afc0 msgr2=0x7f4ea406c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:01:44.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.851+0000 7f4ea259c640 1 --2- 172.21.15.47:0/3793948207 >> v2:172.21.15.47:3300/0 conn(0x7f4ea415afc0 0x7f4ea406c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:44.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.851+0000 7f4ea259c640 1 -- 172.21.15.47:0/3793948207 >> v1:172.21.15.47:6789/0 conn(0x7f4ea406c770 legacy=0x7f4ea40cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:44.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.851+0000 7f4ea259c640 1 -- 172.21.15.47:0/3793948207 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ea40ce060 con 0x7f4ea40c93f0 2024-04-01T23:01:44.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.853+0000 7f4ea259c640 1 --2- 172.21.15.47:0/3793948207 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ea40c93f0 0x7f4ea40cee30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4e940097a0 tx=0x7f4e9402b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb3b20d560e78b75 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:44.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.857+0000 7f4ea159a640 1 -- 172.21.15.47:0/3793948207 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e940315a0 con 0x7f4ea40c93f0 2024-04-01T23:01:44.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.857+0000 7f4ea159a640 1 -- 172.21.15.47:0/3793948207 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e94037070 con 0x7f4ea40c93f0 2024-04-01T23:01:44.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.857+0000 7f4ea159a640 1 -- 172.21.15.47:0/3793948207 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e94031960 con 0x7f4ea40c93f0 2024-04-01T23:01:44.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.858+0000 7f4ea8d8a640 1 -- 172.21.15.47:0/3793948207 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ea40c93f0 msgr2=0x7f4ea40cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:44.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.858+0000 7f4ea8d8a640 1 --2- 172.21.15.47:0/3793948207 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ea40c93f0 0x7f4ea40cee30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4e940097a0 tx=0x7f4e9402b840 comp rx=0 tx=0).stop 2024-04-01T23:01:44.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.858+0000 7f4ea8d8a640 1 -- 172.21.15.47:0/3793948207 shutdown_connections 2024-04-01T23:01:44.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.858+0000 7f4ea8d8a640 1 --2- 172.21.15.47:0/3793948207 >> v2:172.21.15.47:3300/0 conn(0x7f4ea415afc0 0x7f4ea406c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:44.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.858+0000 7f4ea8d8a640 1 --2- 172.21.15.47:0/3793948207 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ea40c93f0 0x7f4ea40cee30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:44.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.858+0000 7f4ea8d8a640 1 -- 172.21.15.47:0/3793948207 >> 172.21.15.47:0/3793948207 conn(0x7f4ea40cfdb0 msgr2=0x7f4ea40d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:44.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.858+0000 7f4ea8d8a640 1 -- 172.21.15.47:0/3793948207 shutdown_connections 2024-04-01T23:01:44.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.858+0000 7f4ea8d8a640 1 -- 172.21.15.47:0/3793948207 wait complete. 2024-04-01T23:01:44.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.859+0000 7f4ea8d8a640 1 Processor -- start 2024-04-01T23:01:44.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.859+0000 7f4ea8d8a640 1 -- start start 2024-04-01T23:01:44.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.860+0000 7f4ea8d8a640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ea406c770 0x7f4ea40b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:44.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.860+0000 7f4ea8d8a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ea40c93f0 0x7f4ea40adfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:44.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.860+0000 7f4ea8d8a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ea415afc0 0x7f4ea40ae520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:44.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.860+0000 7f4ea8d8a640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea415b400 con 0x7f4ea40c93f0 2024-04-01T23:01:44.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.860+0000 7f4ea8d8a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea40ce620 con 0x7f4ea415afc0 2024-04-01T23:01:44.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.860+0000 7f4ea8d8a640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f4ea40cf430 con 0x7f4ea406c770 2024-04-01T23:01:44.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.860+0000 7f4ea1d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ea40c93f0 0x7f4ea40adfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:44.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.861+0000 7f4ea1d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ea40c93f0 0x7f4ea40adfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53292/0 (socket says 172.21.15.47:53292) 2024-04-01T23:01:44.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.861+0000 7f4ea1d9b640 1 -- 172.21.15.47:0/2784558383 learned_addr learned my addr 172.21.15.47:0/2784558383 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:44.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.861+0000 7f4ea259c640 1 --2- 172.21.15.47:0/2784558383 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ea406c770 0x7f4ea40b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:44.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.861+0000 7f4ea2d9d640 1 --2- 172.21.15.47:0/2784558383 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ea415afc0 0x7f4ea40ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:44.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.864+0000 7f4ea1d9b640 1 -- 172.21.15.47:0/2784558383 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ea406c770 msgr2=0x7f4ea40b08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:44.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.864+0000 7f4ea1d9b640 1 --2- 172.21.15.47:0/2784558383 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f4ea406c770 0x7f4ea40b08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:44.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.864+0000 7f4ea1d9b640 1 -- 172.21.15.47:0/2784558383 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ea415afc0 msgr2=0x7f4ea40ae520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:44.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.864+0000 7f4ea1d9b640 1 --2- 172.21.15.47:0/2784558383 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ea415afc0 0x7f4ea40ae520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:44.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.864+0000 7f4ea1d9b640 1 -- 172.21.15.47:0/2784558383 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ea41f3370 con 0x7f4ea40c93f0 2024-04-01T23:01:44.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.867+0000 7f4ea1d9b640 1 --2- 172.21.15.47:0/2784558383 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ea40c93f0 0x7f4ea40adfe0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c00e840 tx=0x7f4e8c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:44.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.872+0000 7f4e9affd640 1 -- 172.21.15.47:0/2784558383 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c017070 con 0x7f4ea40c93f0 2024-04-01T23:01:44.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.872+0000 7f4e9affd640 1 -- 172.21.15.47:0/2784558383 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e8c00c8e0 con 0x7f4ea40c93f0 2024-04-01T23:01:44.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.872+0000 7f4ea8d8a640 1 -- 172.21.15.47:0/2784558383 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ea40c5af0 con 0x7f4ea40c93f0 2024-04-01T23:01:44.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.872+0000 7f4e9affd640 1 -- 172.21.15.47:0/2784558383 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c00ccd0 con 0x7f4ea40c93f0 2024-04-01T23:01:44.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.872+0000 7f4ea8d8a640 1 -- 172.21.15.47:0/2784558383 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ea41f38f0 con 0x7f4ea40c93f0 2024-04-01T23:01:44.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.872+0000 7f4ea8d8a640 1 -- 172.21.15.47:0/2784558383 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4ea406cf00 con 0x7f4ea40c93f0 2024-04-01T23:01:44.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.897+0000 7f4e9affd640 1 -- 172.21.15.47:0/2784558383 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f4e8c01a070 con 0x7f4ea40c93f0 2024-04-01T23:01:44.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.898+0000 7f4e9affd640 1 --2- 172.21.15.47:0/2784558383 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f4e8406b9c0 0x7f4e8406de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:44.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.898+0000 7f4ea259c640 1 --2- 172.21.15.47:0/2784558383 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f4e8406b9c0 0x7f4e8406de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:44.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.898+0000 7f4ea259c640 1 --2- 172.21.15.47:0/2784558383 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f4e8406b9c0 0x7f4e8406de80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4e94036000 tx=0x7f4e9403d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:44.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.902+0000 7f4e9affd640 1 -- 172.21.15.47:0/2784558383 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f4e8c057060 con 0x7f4ea40c93f0 2024-04-01T23:01:44.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.902+0000 7f4e9affd640 1 --2- 172.21.15.47:0/2784558383 >> [v2:172.21.15.47:6818/2845699561,v1:172.21.15.47:6819/2845699561] conn(0x7f4e84075350 0x7f4e840777f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:44.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.902+0000 7f4e9affd640 1 -- 172.21.15.47:0/2784558383 --> [v2:172.21.15.47:6818/2845699561,v1:172.21.15.47:6819/2845699561] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4e8c022e50 con 0x7f4e84075350 2024-04-01T23:01:44.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.902+0000 7f4e9affd640 1 -- 172.21.15.47:0/2784558383 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4e8c055260 con 0x7f4ea40c93f0 2024-04-01T23:01:44.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.902+0000 7f4ea2d9d640 1 --2- 172.21.15.47:0/2784558383 >> [v2:172.21.15.47:6818/2845699561,v1:172.21.15.47:6819/2845699561] conn(0x7f4e84075350 0x7f4e840777f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:44.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.902+0000 7f4ea2d9d640 1 --2- 172.21.15.47:0/2784558383 >> [v2:172.21.15.47:6818/2845699561,v1:172.21.15.47:6819/2845699561] conn(0x7f4e84075350 0x7f4e840777f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:44.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.903+0000 7f4e9affd640 1 -- 172.21.15.47:0/2784558383 <== osd.3 v2:172.21.15.47:6818/2845699561 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4e8c022e50 con 0x7f4e84075350 2024-04-01T23:01:44.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.916+0000 7f4ea8d8a640 1 -- 172.21.15.47:0/2784558383 --> [v2:172.21.15.47:6818/2845699561,v1:172.21.15.47:6819/2845699561] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4ea40cf7b0 con 0x7f4e84075350 2024-04-01T23:01:44.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.916+0000 7f4e9affd640 1 -- 172.21.15.47:0/2784558383 <== osd.3 v2:172.21.15.47:6818/2845699561 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f4ea40cf7b0 con 0x7f4e84075350 2024-04-01T23:01:44.912 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-01T23:01:44.912 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-01T23:01:44.913 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-01T23:01:44.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.917+0000 7f4ea8d8a640 1 -- 172.21.15.47:0/2784558383 >> [v2:172.21.15.47:6818/2845699561,v1:172.21.15.47:6819/2845699561] conn(0x7f4e84075350 msgr2=0x7f4e840777f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:44.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.917+0000 7f4ea8d8a640 1 --2- 172.21.15.47:0/2784558383 >> [v2:172.21.15.47:6818/2845699561,v1:172.21.15.47:6819/2845699561] conn(0x7f4e84075350 0x7f4e840777f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:44.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.917+0000 7f4ea8d8a640 1 -- 172.21.15.47:0/2784558383 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f4e8406b9c0 msgr2=0x7f4e8406de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:44.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.917+0000 7f4ea8d8a640 1 --2- 172.21.15.47:0/2784558383 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f4e8406b9c0 0x7f4e8406de80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4e94036000 tx=0x7f4e9403d040 comp rx=0 tx=0).stop 2024-04-01T23:01:44.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.917+0000 7f4ea8d8a640 1 -- 172.21.15.47:0/2784558383 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ea40c93f0 msgr2=0x7f4ea40adfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:44.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.917+0000 7f4ea8d8a640 1 --2- 172.21.15.47:0/2784558383 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ea40c93f0 0x7f4ea40adfe0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c00e840 tx=0x7f4e8c00ed00 comp rx=0 tx=0).stop 2024-04-01T23:01:44.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.917+0000 7f4ea2d9d640 1 -- 172.21.15.47:0/2784558383 reap_dead start 2024-04-01T23:01:44.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.917+0000 7f4ea8d8a640 1 -- 172.21.15.47:0/2784558383 shutdown_connections 2024-04-01T23:01:44.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.917+0000 7f4ea8d8a640 1 -- 172.21.15.47:0/2784558383 >> 172.21.15.47:0/2784558383 conn(0x7f4ea40cfdb0 msgr2=0x7f4ea415a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:44.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.917+0000 7f4ea8d8a640 1 -- 172.21.15.47:0/2784558383 shutdown_connections 2024-04-01T23:01:44.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:44.917+0000 7f4ea8d8a640 1 -- 172.21.15.47:0/2784558383 wait complete. 2024-04-01T23:01:44.924 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-01T23:01:45.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.042+0000 7f2f1013e640 1 Processor -- start 2024-04-01T23:01:45.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.042+0000 7f2f1013e640 1 -- start start 2024-04-01T23:01:45.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.043+0000 7f2f1013e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2f080c8560 0x7f2f08158c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:45.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.043+0000 7f2f1013e640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2f08071850 0x7f2f080c2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:45.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.043+0000 7f2f1013e640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f0815c6a0 con 0x7f2f08071470 2024-04-01T23:01:45.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.043+0000 7f2f1013e640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f2f08159170 con 0x7f2f080c8560 2024-04-01T23:01:45.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.043+0000 7f2f1013e640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f2f0815b840 con 0x7f2f08071850 2024-04-01T23:01:45.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.043+0000 7f2f0d6d9640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2f080c8560 0x7f2f08158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:45.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.043+0000 7f2f0e6db640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2f08071850 0x7f2f080c2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:45.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.044+0000 7f2f0d6d9640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2f080c8560 0x7f2f08158c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53294/0 (socket says 172.21.15.47:53294) 2024-04-01T23:01:45.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.044+0000 7f2f0d6d9640 1 -- 172.21.15.47:0/2408073468 learned_addr learned my addr 172.21.15.47:0/2408073468 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:45.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.046+0000 7f2f0d6d9640 1 -- 172.21.15.47:0/2408073468 >> v2:172.21.15.181:3300/0 conn(0x7f2f08071850 msgr2=0x7f2f080c2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:01:45.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.046+0000 7f2f0d6d9640 1 --2- 172.21.15.47:0/2408073468 >> v2:172.21.15.181:3300/0 conn(0x7f2f08071850 0x7f2f080c2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:45.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.046+0000 7f2f0d6d9640 1 -- 172.21.15.47:0/2408073468 >> v1:172.21.15.181:6789/0 conn(0x7f2f08071470 legacy=0x7f2f08151db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:45.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.046+0000 7f2f0d6d9640 1 -- 172.21.15.47:0/2408073468 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f0815bb20 con 0x7f2f080c8560 2024-04-01T23:01:45.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.048+0000 7f2f0d6d9640 1 --2- 172.21.15.47:0/2408073468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f080c8560 0x7f2f08158c30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2f080c8aa0 tx=0x7f2ef802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7ad46b58348beaf server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:45.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.052+0000 7f2f0ced8640 1 -- 172.21.15.47:0/2408073468 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8034070 con 0x7f2f080c8560 2024-04-01T23:01:45.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.052+0000 7f2f0ced8640 1 -- 172.21.15.47:0/2408073468 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ef8030860 con 0x7f2f080c8560 2024-04-01T23:01:45.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.052+0000 7f2f0ced8640 1 -- 172.21.15.47:0/2408073468 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8030c30 con 0x7f2f080c8560 2024-04-01T23:01:45.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.052+0000 7f2f1013e640 1 -- 172.21.15.47:0/2408073468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f080c8560 msgr2=0x7f2f08158c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:45.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.052+0000 7f2f1013e640 1 --2- 172.21.15.47:0/2408073468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f080c8560 0x7f2f08158c30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2f080c8aa0 tx=0x7f2ef802b9a0 comp rx=0 tx=0).stop 2024-04-01T23:01:45.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.053+0000 7f2f1013e640 1 -- 172.21.15.47:0/2408073468 shutdown_connections 2024-04-01T23:01:45.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.053+0000 7f2f1013e640 1 --2- 172.21.15.47:0/2408073468 >> v2:172.21.15.181:3300/0 conn(0x7f2f08071850 0x7f2f080c2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:45.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.053+0000 7f2f1013e640 1 --2- 172.21.15.47:0/2408073468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f080c8560 0x7f2f08158c30 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:45.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.053+0000 7f2f1013e640 1 -- 172.21.15.47:0/2408073468 >> 172.21.15.47:0/2408073468 conn(0x7f2f0806b500 msgr2=0x7f2f0806f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:45.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.053+0000 7f2f1013e640 1 -- 172.21.15.47:0/2408073468 shutdown_connections 2024-04-01T23:01:45.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.053+0000 7f2f1013e640 1 -- 172.21.15.47:0/2408073468 wait complete. 2024-04-01T23:01:45.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.054+0000 7f2f1013e640 1 Processor -- start 2024-04-01T23:01:45.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.054+0000 7f2f1013e640 1 -- start start 2024-04-01T23:01:45.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.054+0000 7f2f1013e640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2f08071470 0x7f2f081eef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:45.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.054+0000 7f2f1013e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f08071850 0x7f2f081e45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:45.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.054+0000 7f2f1013e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f080c8560 0x7f2f080b1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:45.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.054+0000 7f2f1013e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0815c3c0 con 0x7f2f080c8560 2024-04-01T23:01:45.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.054+0000 7f2f1013e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0815c0e0 con 0x7f2f08071850 2024-04-01T23:01:45.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.054+0000 7f2f1013e640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f2f081524c0 con 0x7f2f08071470 2024-04-01T23:01:45.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.055+0000 7f2f0e6db640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f080c8560 0x7f2f080b1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:45.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.055+0000 7f2f0d6d9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f08071850 0x7f2f081e45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:45.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.055+0000 7f2f0deda640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2f08071470 0x7f2f081eef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:45.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.055+0000 7f2f0e6db640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f080c8560 0x7f2f080b1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53304/0 (socket says 172.21.15.47:53304) 2024-04-01T23:01:45.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.055+0000 7f2f0e6db640 1 -- 172.21.15.47:0/169600806 learned_addr learned my addr 172.21.15.47:0/169600806 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:45.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.059+0000 7f2f0d6d9640 1 -- 172.21.15.47:0/169600806 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2f08071470 msgr2=0x7f2f081eef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:45.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.059+0000 7f2f0d6d9640 1 --2- 172.21.15.47:0/169600806 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2f08071470 0x7f2f081eef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:45.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.059+0000 7f2f0d6d9640 1 -- 172.21.15.47:0/169600806 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f080c8560 msgr2=0x7f2f080b1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:45.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.059+0000 7f2f0d6d9640 1 --2- 172.21.15.47:0/169600806 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f080c8560 0x7f2f080b1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:45.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.059+0000 7f2f0d6d9640 1 -- 172.21.15.47:0/169600806 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f08156340 con 0x7f2f08071850 2024-04-01T23:01:45.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.061+0000 7f2f0d6d9640 1 --2- 172.21.15.47:0/169600806 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f08071850 0x7f2f081e45d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8033000 tx=0x7f2ef80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:45.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.065+0000 7f2efe7fc640 1 -- 172.21.15.47:0/169600806 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8034040 con 0x7f2f08071850 2024-04-01T23:01:45.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.065+0000 7f2efe7fc640 1 -- 172.21.15.47:0/169600806 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ef8039d90 con 0x7f2f08071850 2024-04-01T23:01:45.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.065+0000 7f2efe7fc640 1 -- 172.21.15.47:0/169600806 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8043650 con 0x7f2f08071850 2024-04-01T23:01:45.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.065+0000 7f2f1013e640 1 -- 172.21.15.47:0/169600806 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f0814f6b0 con 0x7f2f08071850 2024-04-01T23:01:45.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.065+0000 7f2f1013e640 1 -- 172.21.15.47:0/169600806 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f0814fc70 con 0x7f2f08071850 2024-04-01T23:01:45.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.066+0000 7f2f1013e640 1 -- 172.21.15.47:0/169600806 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f08068920 con 0x7f2f08071850 2024-04-01T23:01:45.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.083+0000 7f2efe7fc640 1 -- 172.21.15.47:0/169600806 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f2ef804a060 con 0x7f2f08071850 2024-04-01T23:01:45.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.084+0000 7f2efe7fc640 1 --2- 172.21.15.47:0/169600806 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f2eec06b9e0 0x7f2eec06dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:45.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.084+0000 7f2f0deda640 1 --2- 172.21.15.47:0/169600806 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f2eec06b9e0 0x7f2eec06dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:45.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.084+0000 7f2f0deda640 1 --2- 172.21.15.47:0/169600806 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f2eec06b9e0 0x7f2eec06dea0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2f04001780 tx=0x7f2f04009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:45.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.088+0000 7f2efe7fc640 1 -- 172.21.15.47:0/169600806 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f2ef80791c0 con 0x7f2f08071850 2024-04-01T23:01:45.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.327+0000 7f2efe7fc640 1 -- 172.21.15.47:0/169600806 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f2ef803e070 con 0x7f2f08071850 2024-04-01T23:01:45.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.515+0000 7f2f1013e640 1 -- 172.21.15.47:0/169600806 --> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f2f08070000 con 0x7f2eec06b9e0 2024-04-01T23:01:45.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.516+0000 7f2efe7fc640 1 -- 172.21.15.47:0/169600806 <== mgr.4107 v2:172.21.15.47:6800/1257047371 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2f08070000 con 0x7f2eec06b9e0 2024-04-01T23:01:45.512 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 3 to deep-scrub 2024-04-01T23:01:45.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.519+0000 7f2f1013e640 1 -- 172.21.15.47:0/169600806 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f2eec06b9e0 msgr2=0x7f2eec06dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:45.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.519+0000 7f2f1013e640 1 --2- 172.21.15.47:0/169600806 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f2eec06b9e0 0x7f2eec06dea0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2f04001780 tx=0x7f2f04009040 comp rx=0 tx=0).stop 2024-04-01T23:01:45.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.519+0000 7f2f1013e640 1 -- 172.21.15.47:0/169600806 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f08071850 msgr2=0x7f2f081e45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:45.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.519+0000 7f2f1013e640 1 --2- 172.21.15.47:0/169600806 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f08071850 0x7f2f081e45d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8033000 tx=0x7f2ef80046c0 comp rx=0 tx=0).stop 2024-04-01T23:01:45.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.519+0000 7f2f1013e640 1 -- 172.21.15.47:0/169600806 shutdown_connections 2024-04-01T23:01:45.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.519+0000 7f2f1013e640 1 --2- 172.21.15.47:0/169600806 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f2eec06b9e0 0x7f2eec06dea0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:45.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.519+0000 7f2f1013e640 1 --2- 172.21.15.47:0/169600806 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f080c8560 0x7f2f080b1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:45.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.519+0000 7f2f1013e640 1 --2- 172.21.15.47:0/169600806 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f08071850 0x7f2f081e45d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:45.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.519+0000 7f2f1013e640 1 --2- 172.21.15.47:0/169600806 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f2f08071470 0x7f2f081eef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:45.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.519+0000 7f2f1013e640 1 -- 172.21.15.47:0/169600806 >> 172.21.15.47:0/169600806 conn(0x7f2f0806b500 msgr2=0x7f2f080cda80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:45.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.519+0000 7f2f1013e640 1 -- 172.21.15.47:0/169600806 shutdown_connections 2024-04-01T23:01:45.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.519+0000 7f2f1013e640 1 -- 172.21.15.47:0/169600806 wait complete. 2024-04-01T23:01:45.530 INFO:tasks.ceph:Scrubbing osd.4 2024-04-01T23:01:45.530 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-01T23:01:45.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.648+0000 7f3d58180640 1 Processor -- start 2024-04-01T23:01:45.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.649+0000 7f3d58180640 1 -- start start 2024-04-01T23:01:45.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.649+0000 7f3d58180640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3d500c93f0 0x7f3d500cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:45.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.649+0000 7f3d58180640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3d500cc0d0 0x7f3d500cc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:45.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.649+0000 7f3d58180640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d500ccaa0 con 0x7f3d5015afc0 2024-04-01T23:01:45.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.649+0000 7f3d58180640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f3d500cdae0 con 0x7f3d500c93f0 2024-04-01T23:01:45.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.649+0000 7f3d58180640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f3d500c97d0 con 0x7f3d500cc0d0 2024-04-01T23:01:45.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.650+0000 7f3d55f1c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3d500c93f0 0x7f3d500cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:45.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.650+0000 7f3d5671d640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3d500cc0d0 0x7f3d500cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:45.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.650+0000 7f3d55f1c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3d500c93f0 0x7f3d500cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:48296/0 (socket says 172.21.15.47:48296) 2024-04-01T23:01:45.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.650+0000 7f3d55f1c640 1 -- 172.21.15.47:0/1528823457 learned_addr learned my addr 172.21.15.47:0/1528823457 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:45.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.653+0000 7f3d5671d640 1 -- 172.21.15.47:0/1528823457 >> v2:172.21.15.181:3300/0 conn(0x7f3d500c93f0 msgr2=0x7f3d500cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:01:45.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.653+0000 7f3d5671d640 1 --2- 172.21.15.47:0/1528823457 >> v2:172.21.15.181:3300/0 conn(0x7f3d500c93f0 0x7f3d500cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:45.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.653+0000 7f3d5671d640 1 -- 172.21.15.47:0/1528823457 >> v1:172.21.15.181:6789/0 conn(0x7f3d5015afc0 legacy=0x7f3d5006c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:45.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.653+0000 7f3d5671d640 1 -- 172.21.15.47:0/1528823457 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d500cdd80 con 0x7f3d500cc0d0 2024-04-01T23:01:45.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.655+0000 7f3d5671d640 1 --2- 172.21.15.47:0/1528823457 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3d500cc0d0 0x7f3d500cc560 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3d48009d90 tx=0x7f3d4802be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65487dba5f4c35e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:45.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.657+0000 7f3d54f1a640 1 -- 172.21.15.47:0/1528823457 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d48039070 con 0x7f3d500cc0d0 2024-04-01T23:01:45.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.658+0000 7f3d54f1a640 1 -- 172.21.15.47:0/1528823457 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d4802cbc0 con 0x7f3d500cc0d0 2024-04-01T23:01:45.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.659+0000 7f3d58180640 1 -- 172.21.15.47:0/1528823457 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3d500cc0d0 msgr2=0x7f3d500cc560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:45.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.659+0000 7f3d58180640 1 --2- 172.21.15.47:0/1528823457 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3d500cc0d0 0x7f3d500cc560 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3d48009d90 tx=0x7f3d4802be10 comp rx=0 tx=0).stop 2024-04-01T23:01:45.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.659+0000 7f3d58180640 1 -- 172.21.15.47:0/1528823457 shutdown_connections 2024-04-01T23:01:45.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.659+0000 7f3d58180640 1 --2- 172.21.15.47:0/1528823457 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3d500cc0d0 0x7f3d500cc560 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:45.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.659+0000 7f3d58180640 1 --2- 172.21.15.47:0/1528823457 >> v2:172.21.15.181:3300/0 conn(0x7f3d500c93f0 0x7f3d500cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:45.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.659+0000 7f3d58180640 1 -- 172.21.15.47:0/1528823457 >> 172.21.15.47:0/1528823457 conn(0x7f3d500cfdb0 msgr2=0x7f3d500d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:45.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.659+0000 7f3d58180640 1 -- 172.21.15.47:0/1528823457 shutdown_connections 2024-04-01T23:01:45.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.659+0000 7f3d58180640 1 -- 172.21.15.47:0/1528823457 wait complete. 2024-04-01T23:01:45.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.660+0000 7f3d58180640 1 Processor -- start 2024-04-01T23:01:45.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.660+0000 7f3d58180640 1 -- start start 2024-04-01T23:01:45.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.661+0000 7f3d58180640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3d500c93f0 0x7f3d501f3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:45.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.661+0000 7f3d58180640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d500cc0d0 0x7f3d500b2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:45.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.661+0000 7f3d58180640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d5015afc0 0x7f3d500b0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:45.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.661+0000 7f3d58180640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3d500ce620 con 0x7f3d5015afc0 2024-04-01T23:01:45.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.661+0000 7f3d58180640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3d500ce340 con 0x7f3d500cc0d0 2024-04-01T23:01:45.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.661+0000 7f3d58180640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f3d5015b400 con 0x7f3d500c93f0 2024-04-01T23:01:45.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.662+0000 7f3d5571b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d500cc0d0 0x7f3d500b2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:45.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.662+0000 7f3d5571b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d500cc0d0 0x7f3d500b2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:48298/0 (socket says 172.21.15.47:48298) 2024-04-01T23:01:45.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.662+0000 7f3d5571b640 1 -- 172.21.15.47:0/3208664812 learned_addr learned my addr 172.21.15.47:0/3208664812 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:45.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.662+0000 7f3d55f1c640 1 --2- 172.21.15.47:0/3208664812 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3d500c93f0 0x7f3d501f3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:45.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.666+0000 7f3d5571b640 1 -- 172.21.15.47:0/3208664812 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3d500c93f0 msgr2=0x7f3d501f3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:45.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.666+0000 7f3d5571b640 1 --2- 172.21.15.47:0/3208664812 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f3d500c93f0 0x7f3d501f3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:45.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.666+0000 7f3d5571b640 1 -- 172.21.15.47:0/3208664812 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d5015afc0 msgr2=0x7f3d500b0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:45.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.666+0000 7f3d5571b640 1 --2- 172.21.15.47:0/3208664812 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d5015afc0 0x7f3d500b0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:45.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.666+0000 7f3d5571b640 1 -- 172.21.15.47:0/3208664812 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d501f4240 con 0x7f3d500cc0d0 2024-04-01T23:01:45.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.669+0000 7f3d5571b640 1 --2- 172.21.15.47:0/3208664812 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d500cc0d0 0x7f3d500b2750 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3d4000c3f0 tx=0x7f3d4000c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:45.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.673+0000 7f3d467fc640 1 -- 172.21.15.47:0/3208664812 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d400052d0 con 0x7f3d500cc0d0 2024-04-01T23:01:45.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.673+0000 7f3d467fc640 1 -- 172.21.15.47:0/3208664812 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d40005490 con 0x7f3d500cc0d0 2024-04-01T23:01:45.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.673+0000 7f3d58180640 1 -- 172.21.15.47:0/3208664812 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d500b5280 con 0x7f3d500cc0d0 2024-04-01T23:01:45.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.673+0000 7f3d467fc640 1 -- 172.21.15.47:0/3208664812 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d40007260 con 0x7f3d500cc0d0 2024-04-01T23:01:45.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.673+0000 7f3d58180640 1 -- 172.21.15.47:0/3208664812 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d500b38a0 con 0x7f3d500cc0d0 2024-04-01T23:01:45.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.674+0000 7f3d58180640 1 -- 172.21.15.47:0/3208664812 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3d5014f2e0 con 0x7f3d500cc0d0 2024-04-01T23:01:45.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.743+0000 7f3d467fc640 1 -- 172.21.15.47:0/3208664812 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f3d40007400 con 0x7f3d500cc0d0 2024-04-01T23:01:45.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.743+0000 7f3d467fc640 1 --2- 172.21.15.47:0/3208664812 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f3d3406b990 0x7f3d3406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:45.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.743+0000 7f3d55f1c640 1 --2- 172.21.15.47:0/3208664812 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f3d3406b990 0x7f3d3406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:45.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.744+0000 7f3d55f1c640 1 --2- 172.21.15.47:0/3208664812 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f3d3406b990 0x7f3d3406de50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c009bd0 tx=0x7f3d4c009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:45.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.745+0000 7f3d467fc640 1 -- 172.21.15.47:0/3208664812 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f3d40056aa0 con 0x7f3d500cc0d0 2024-04-01T23:01:45.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.745+0000 7f3d467fc640 1 --2- 172.21.15.47:0/3208664812 >> [v2:172.21.15.181:6808/2961538461,v1:172.21.15.181:6809/2961538461] conn(0x7f3d340752a0 0x7f3d34077740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:45.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.745+0000 7f3d467fc640 1 -- 172.21.15.47:0/3208664812 --> [v2:172.21.15.181:6808/2961538461,v1:172.21.15.181:6809/2961538461] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3d40006e70 con 0x7f3d340752a0 2024-04-01T23:01:45.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.745+0000 7f3d467fc640 1 -- 172.21.15.47:0/3208664812 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3d40054ca0 con 0x7f3d500cc0d0 2024-04-01T23:01:45.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.746+0000 7f3d5671d640 1 --2- 172.21.15.47:0/3208664812 >> [v2:172.21.15.181:6808/2961538461,v1:172.21.15.181:6809/2961538461] conn(0x7f3d340752a0 0x7f3d34077740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:45.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.746+0000 7f3d5671d640 1 --2- 172.21.15.47:0/3208664812 >> [v2:172.21.15.181:6808/2961538461,v1:172.21.15.181:6809/2961538461] conn(0x7f3d340752a0 0x7f3d34077740 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:45.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.747+0000 7f3d467fc640 1 -- 172.21.15.47:0/3208664812 <== osd.4 v2:172.21.15.181:6808/2961538461 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3d40006e70 con 0x7f3d340752a0 2024-04-01T23:01:45.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.760+0000 7f3d58180640 1 -- 172.21.15.47:0/3208664812 --> [v2:172.21.15.181:6808/2961538461,v1:172.21.15.181:6809/2961538461] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3d501f4520 con 0x7f3d340752a0 2024-04-01T23:01:45.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.761+0000 7f3d467fc640 1 -- 172.21.15.47:0/3208664812 <== osd.4 v2:172.21.15.181:6808/2961538461 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3d501f4520 con 0x7f3d340752a0 2024-04-01T23:01:45.757 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-01T23:01:45.757 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-01T23:01:45.757 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-01T23:01:45.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.761+0000 7f3d58180640 1 -- 172.21.15.47:0/3208664812 >> [v2:172.21.15.181:6808/2961538461,v1:172.21.15.181:6809/2961538461] conn(0x7f3d340752a0 msgr2=0x7f3d34077740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:45.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.761+0000 7f3d58180640 1 --2- 172.21.15.47:0/3208664812 >> [v2:172.21.15.181:6808/2961538461,v1:172.21.15.181:6809/2961538461] conn(0x7f3d340752a0 0x7f3d34077740 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:45.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.761+0000 7f3d58180640 1 -- 172.21.15.47:0/3208664812 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f3d3406b990 msgr2=0x7f3d3406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:45.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.761+0000 7f3d58180640 1 --2- 172.21.15.47:0/3208664812 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f3d3406b990 0x7f3d3406de50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c009bd0 tx=0x7f3d4c009240 comp rx=0 tx=0).stop 2024-04-01T23:01:45.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.761+0000 7f3d58180640 1 -- 172.21.15.47:0/3208664812 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d500cc0d0 msgr2=0x7f3d500b2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:45.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.761+0000 7f3d58180640 1 --2- 172.21.15.47:0/3208664812 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d500cc0d0 0x7f3d500b2750 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3d4000c3f0 tx=0x7f3d4000c8b0 comp rx=0 tx=0).stop 2024-04-01T23:01:45.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.761+0000 7f3d5671d640 1 -- 172.21.15.47:0/3208664812 reap_dead start 2024-04-01T23:01:45.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.761+0000 7f3d58180640 1 -- 172.21.15.47:0/3208664812 shutdown_connections 2024-04-01T23:01:45.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.761+0000 7f3d58180640 1 -- 172.21.15.47:0/3208664812 >> 172.21.15.47:0/3208664812 conn(0x7f3d500cfdb0 msgr2=0x7f3d500d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:45.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.761+0000 7f3d58180640 1 -- 172.21.15.47:0/3208664812 shutdown_connections 2024-04-01T23:01:45.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.761+0000 7f3d58180640 1 -- 172.21.15.47:0/3208664812 wait complete. 2024-04-01T23:01:45.768 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-01T23:01:45.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.875+0000 7fb13b3c9640 1 Processor -- start 2024-04-01T23:01:45.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.875+0000 7fb13b3c9640 1 -- start start 2024-04-01T23:01:45.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.876+0000 7fb13b3c9640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb1340c93f0 0x7fb1340cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:45.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.876+0000 7fb13b3c9640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1340cdae0 con 0x7fb13415afc0 2024-04-01T23:01:45.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.876+0000 7fb13b3c9640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1340c97d0 con 0x7fb1340cc0d0 2024-04-01T23:01:45.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.876+0000 7fb13b3c9640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fb1340cdd80 con 0x7fb1340c93f0 2024-04-01T23:01:45.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.877+0000 7fb139165640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb1340c93f0 0x7fb1340cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:45.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.877+0000 7fb138964640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fb13415afc0 0x7fb13406c230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35668/0 (socket says 172.21.15.47:35668) 2024-04-01T23:01:45.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.877+0000 7fb138964640 1 -- 172.21.15.47:0/3756990510 learned_addr learned my addr 172.21.15.47:0/3756990510 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T23:01:45.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.880+0000 7fb12bfff640 1 -- 172.21.15.47:0/3756990510 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 933908507 0 0) 0x7fb1340cdae0 con 0x7fb13415afc0 2024-04-01T23:01:45.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.880+0000 7fb12bfff640 1 -- 172.21.15.47:0/3756990510 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb120003520 con 0x7fb13415afc0 2024-04-01T23:01:45.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.880+0000 7fb139165640 1 -- 172.21.15.47:0/3756990510 >> v1:172.21.15.181:6789/0 conn(0x7fb1340cc0d0 legacy=0x7fb1340cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:45.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.880+0000 7fb139165640 1 -- 172.21.15.47:0/3756990510 >> v1:172.21.15.47:6789/0 conn(0x7fb13415afc0 legacy=0x7fb13406c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:45.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.880+0000 7fb139165640 1 -- 172.21.15.47:0/3756990510 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1340ce060 con 0x7fb1340c93f0 2024-04-01T23:01:45.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.884+0000 7fb139165640 1 --2- 172.21.15.47:0/3756990510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1340c93f0 0x7fb1340cee30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb1300097a0 tx=0x7fb13002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73760a7bc77e3a86 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:45.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.888+0000 7fb12bfff640 1 -- 172.21.15.47:0/3756990510 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb130035020 con 0x7fb1340c93f0 2024-04-01T23:01:45.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.888+0000 7fb12bfff640 1 -- 172.21.15.47:0/3756990510 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb130031830 con 0x7fb1340c93f0 2024-04-01T23:01:45.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.888+0000 7fb12bfff640 1 -- 172.21.15.47:0/3756990510 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb130031c00 con 0x7fb1340c93f0 2024-04-01T23:01:45.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.889+0000 7fb13b3c9640 1 -- 172.21.15.47:0/3756990510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1340c93f0 msgr2=0x7fb1340cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:45.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.889+0000 7fb13b3c9640 1 --2- 172.21.15.47:0/3756990510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1340c93f0 0x7fb1340cee30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb1300097a0 tx=0x7fb13002b8d0 comp rx=0 tx=0).stop 2024-04-01T23:01:45.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.889+0000 7fb13b3c9640 1 -- 172.21.15.47:0/3756990510 shutdown_connections 2024-04-01T23:01:45.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.889+0000 7fb13b3c9640 1 --2- 172.21.15.47:0/3756990510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1340c93f0 0x7fb1340cee30 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:45.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.889+0000 7fb13b3c9640 1 -- 172.21.15.47:0/3756990510 >> 172.21.15.47:0/3756990510 conn(0x7fb1340cfdb0 msgr2=0x7fb1340d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:45.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.889+0000 7fb13b3c9640 1 -- 172.21.15.47:0/3756990510 shutdown_connections 2024-04-01T23:01:45.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.889+0000 7fb13b3c9640 1 -- 172.21.15.47:0/3756990510 wait complete. 2024-04-01T23:01:45.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.890+0000 7fb13b3c9640 1 Processor -- start 2024-04-01T23:01:45.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.890+0000 7fb13b3c9640 1 -- start start 2024-04-01T23:01:45.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.891+0000 7fb13b3c9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1340c93f0 0x7fb1341e05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:45.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.891+0000 7fb13b3c9640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb1340cc0d0 0x7fb1340c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:45.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.891+0000 7fb13b3c9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb13415afc0 0x7fb1341e35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:45.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.891+0000 7fb13b3c9640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb13415b400 con 0x7fb13415afc0 2024-04-01T23:01:45.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.891+0000 7fb13b3c9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb1340ce620 con 0x7fb1340c93f0 2024-04-01T23:01:45.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.891+0000 7fb13b3c9640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb1340cf430 con 0x7fb1340cc0d0 2024-04-01T23:01:45.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.891+0000 7fb139966640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb13415afc0 0x7fb1341e35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:45.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.892+0000 7fb139165640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1340c93f0 0x7fb1341e05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:45.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.892+0000 7fb138964640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb1340cc0d0 0x7fb1340c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:45.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.892+0000 7fb139966640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb13415afc0 0x7fb1341e35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53324/0 (socket says 172.21.15.47:53324) 2024-04-01T23:01:45.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.892+0000 7fb139966640 1 -- 172.21.15.47:0/3131358378 learned_addr learned my addr 172.21.15.47:0/3131358378 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:45.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.895+0000 7fb139165640 1 -- 172.21.15.47:0/3131358378 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb1340cc0d0 msgr2=0x7fb1340c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:45.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.895+0000 7fb139165640 1 --2- 172.21.15.47:0/3131358378 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb1340cc0d0 0x7fb1340c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:45.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.895+0000 7fb139165640 1 -- 172.21.15.47:0/3131358378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb13415afc0 msgr2=0x7fb1341e35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:45.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.895+0000 7fb139165640 1 --2- 172.21.15.47:0/3131358378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb13415afc0 0x7fb1341e35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:45.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.895+0000 7fb139165640 1 -- 172.21.15.47:0/3131358378 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb13415a620 con 0x7fb1340c93f0 2024-04-01T23:01:45.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.897+0000 7fb139165640 1 --2- 172.21.15.47:0/3131358378 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1340c93f0 0x7fb1341e05c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb130033000 tx=0x7fb1300046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:45.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.901+0000 7fb129ffb640 1 -- 172.21.15.47:0/3131358378 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb130041070 con 0x7fb1340c93f0 2024-04-01T23:01:45.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.901+0000 7fb129ffb640 1 -- 172.21.15.47:0/3131358378 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb13003b920 con 0x7fb1340c93f0 2024-04-01T23:01:45.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.901+0000 7fb13b3c9640 1 -- 172.21.15.47:0/3131358378 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1341f0ff0 con 0x7fb1340c93f0 2024-04-01T23:01:45.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.901+0000 7fb129ffb640 1 -- 172.21.15.47:0/3131358378 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb130035040 con 0x7fb1340c93f0 2024-04-01T23:01:45.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.901+0000 7fb13b3c9640 1 -- 172.21.15.47:0/3131358378 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1341e3de0 con 0x7fb1340c93f0 2024-04-01T23:01:45.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:45.902+0000 7fb13b3c9640 1 -- 172.21.15.47:0/3131358378 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb134068210 con 0x7fb1340c93f0 2024-04-01T23:01:46.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.147+0000 7fb129ffb640 1 -- 172.21.15.47:0/3131358378 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7fb13004c060 con 0x7fb1340c93f0 2024-04-01T23:01:46.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.148+0000 7fb129ffb640 1 --2- 172.21.15.47:0/3131358378 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fb11806ba10 0x7fb11806ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:46.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.148+0000 7fb138964640 1 --2- 172.21.15.47:0/3131358378 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fb11806ba10 0x7fb11806ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:46.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.148+0000 7fb138964640 1 --2- 172.21.15.47:0/3131358378 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fb11806ba10 0x7fb11806ded0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb13415ab00 tx=0x7fb124009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:46.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.151+0000 7fb129ffb640 1 -- 172.21.15.47:0/3131358378 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fb1300789e0 con 0x7fb1340c93f0 2024-04-01T23:01:46.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.162+0000 7fb129ffb640 1 -- 172.21.15.47:0/3131358378 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fb13007a940 con 0x7fb1340c93f0 2024-04-01T23:01:46.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.343+0000 7fb13b3c9640 1 -- 172.21.15.47:0/3131358378 --> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fb1340ccdd0 con 0x7fb11806ba10 2024-04-01T23:01:46.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.344+0000 7fb129ffb640 1 -- 172.21.15.47:0/3131358378 <== mgr.4107 v2:172.21.15.47:6800/1257047371 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb1340ccdd0 con 0x7fb11806ba10 2024-04-01T23:01:46.340 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 4 to deep-scrub 2024-04-01T23:01:46.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.346+0000 7fb13b3c9640 1 -- 172.21.15.47:0/3131358378 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fb11806ba10 msgr2=0x7fb11806ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:46.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.346+0000 7fb13b3c9640 1 --2- 172.21.15.47:0/3131358378 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fb11806ba10 0x7fb11806ded0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb13415ab00 tx=0x7fb124009040 comp rx=0 tx=0).stop 2024-04-01T23:01:46.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.346+0000 7fb13b3c9640 1 -- 172.21.15.47:0/3131358378 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1340c93f0 msgr2=0x7fb1341e05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:46.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.346+0000 7fb13b3c9640 1 --2- 172.21.15.47:0/3131358378 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1340c93f0 0x7fb1341e05c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb130033000 tx=0x7fb1300046c0 comp rx=0 tx=0).stop 2024-04-01T23:01:46.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.346+0000 7fb13b3c9640 1 -- 172.21.15.47:0/3131358378 shutdown_connections 2024-04-01T23:01:46.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.346+0000 7fb13b3c9640 1 --2- 172.21.15.47:0/3131358378 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fb11806ba10 0x7fb11806ded0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:46.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.346+0000 7fb13b3c9640 1 --2- 172.21.15.47:0/3131358378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb13415afc0 0x7fb1341e35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:46.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.346+0000 7fb13b3c9640 1 --2- 172.21.15.47:0/3131358378 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb1340cc0d0 0x7fb1340c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:46.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.346+0000 7fb13b3c9640 1 --2- 172.21.15.47:0/3131358378 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1340c93f0 0x7fb1341e05c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:46.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.346+0000 7fb13b3c9640 1 -- 172.21.15.47:0/3131358378 >> 172.21.15.47:0/3131358378 conn(0x7fb1340cfdb0 msgr2=0x7fb134159e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:46.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.346+0000 7fb13b3c9640 1 -- 172.21.15.47:0/3131358378 shutdown_connections 2024-04-01T23:01:46.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.346+0000 7fb13b3c9640 1 -- 172.21.15.47:0/3131358378 wait complete. 2024-04-01T23:01:46.354 INFO:tasks.ceph:Scrubbing osd.5 2024-04-01T23:01:46.354 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-01T23:01:46.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.467+0000 7fbf7caae640 1 Processor -- start 2024-04-01T23:01:46.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.467+0000 7fbf7caae640 1 -- start start 2024-04-01T23:01:46.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.468+0000 7fbf7caae640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fbf78150fb0 0x7fbf780c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:46.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.468+0000 7fbf7caae640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf78072be0 0x7fbf780c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:46.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.468+0000 7fbf7caae640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf780c4400 con 0x7fbf780727a0 2024-04-01T23:01:46.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.468+0000 7fbf7caae640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fbf780c6720 con 0x7fbf78150fb0 2024-04-01T23:01:46.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.468+0000 7fbf7caae640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fbf780c46e0 con 0x7fbf78072be0 2024-04-01T23:01:46.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.469+0000 7fbf75d9b640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fbf780727a0 0x7fbf78156e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35674/0 (socket says 172.21.15.47:35674) 2024-04-01T23:01:46.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.469+0000 7fbf75d9b640 1 -- 172.21.15.47:0/3483710038 learned_addr learned my addr 172.21.15.47:0/3483710038 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T23:01:46.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.469+0000 7fbf76d9d640 1 --2- 172.21.15.47:0/3483710038 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf78072be0 0x7fbf780c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:46.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.469+0000 7fbf7659c640 1 --2- 172.21.15.47:0/3483710038 >> v2:172.21.15.181:3300/0 conn(0x7fbf78150fb0 0x7fbf780c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:46.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.471+0000 7fbf76d9d640 1 -- 172.21.15.47:0/3483710038 >> v2:172.21.15.181:3300/0 conn(0x7fbf78150fb0 msgr2=0x7fbf780c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:01:46.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.471+0000 7fbf76d9d640 1 --2- 172.21.15.47:0/3483710038 >> v2:172.21.15.181:3300/0 conn(0x7fbf78150fb0 0x7fbf780c3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:46.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.471+0000 7fbf76d9d640 1 -- 172.21.15.47:0/3483710038 >> v1:172.21.15.47:6789/0 conn(0x7fbf780727a0 legacy=0x7fbf78156e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:46.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.471+0000 7fbf76d9d640 1 -- 172.21.15.47:0/3483710038 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf780c60d0 con 0x7fbf78072be0 2024-04-01T23:01:46.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.471+0000 7fbf7559a640 1 -- 172.21.15.47:0/3483710038 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1436070910 0 0) 0x7fbf780c4400 con 0x7fbf780727a0 2024-04-01T23:01:46.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.471+0000 7fbf7659c640 1 --2- 172.21.15.47:0/3483710038 >> v2:172.21.15.181:3300/0 conn(0x7fbf78150fb0 0x7fbf780c3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T23:01:46.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.474+0000 7fbf76d9d640 1 --2- 172.21.15.47:0/3483710038 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf78072be0 0x7fbf780c71c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbf70009d90 tx=0x7fbf7002bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e52d28dc5afa20ce server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:46.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.477+0000 7fbf7559a640 1 -- 172.21.15.47:0/3483710038 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf70039070 con 0x7fbf78072be0 2024-04-01T23:01:46.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.477+0000 7fbf7559a640 1 -- 172.21.15.47:0/3483710038 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf7002cce0 con 0x7fbf78072be0 2024-04-01T23:01:46.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.477+0000 7fbf7559a640 1 -- 172.21.15.47:0/3483710038 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf70034660 con 0x7fbf78072be0 2024-04-01T23:01:46.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.478+0000 7fbf7caae640 1 -- 172.21.15.47:0/3483710038 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf78072be0 msgr2=0x7fbf780c71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:46.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.478+0000 7fbf7caae640 1 --2- 172.21.15.47:0/3483710038 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf78072be0 0x7fbf780c71c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbf70009d90 tx=0x7fbf7002bf30 comp rx=0 tx=0).stop 2024-04-01T23:01:46.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.478+0000 7fbf7caae640 1 -- 172.21.15.47:0/3483710038 shutdown_connections 2024-04-01T23:01:46.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.478+0000 7fbf7caae640 1 --2- 172.21.15.47:0/3483710038 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf78072be0 0x7fbf780c71c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:46.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.478+0000 7fbf7caae640 1 --2- 172.21.15.47:0/3483710038 >> v2:172.21.15.181:3300/0 conn(0x7fbf78150fb0 0x7fbf780c3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:46.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.478+0000 7fbf7caae640 1 -- 172.21.15.47:0/3483710038 >> 172.21.15.47:0/3483710038 conn(0x7fbf78061fb0 msgr2=0x7fbf780701d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:46.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.478+0000 7fbf7caae640 1 -- 172.21.15.47:0/3483710038 shutdown_connections 2024-04-01T23:01:46.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.478+0000 7fbf7caae640 1 -- 172.21.15.47:0/3483710038 wait complete. 2024-04-01T23:01:46.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.480+0000 7fbf7caae640 1 Processor -- start 2024-04-01T23:01:46.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.480+0000 7fbf7caae640 1 -- start start 2024-04-01T23:01:46.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.481+0000 7fbf7caae640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbf780727a0 0x7fbf7806c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:46.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.481+0000 7fbf7caae640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf78072be0 0x7fbf78141b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:46.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.481+0000 7fbf7caae640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf78150fb0 0x7fbf78142080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:46.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.481+0000 7fbf7caae640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbf780c6bb0 con 0x7fbf78150fb0 2024-04-01T23:01:46.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.481+0000 7fbf7caae640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fbf78157540 con 0x7fbf780727a0 2024-04-01T23:01:46.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.481+0000 7fbf7caae640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fbf78151390 con 0x7fbf78072be0 2024-04-01T23:01:46.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.482+0000 7fbf75d9b640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf78072be0 0x7fbf78141b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:46.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.482+0000 7fbf7659c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbf780727a0 0x7fbf7806c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:46.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.482+0000 7fbf76d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf78150fb0 0x7fbf78142080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:46.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.482+0000 7fbf75d9b640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf78072be0 0x7fbf78141b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:41832/0 (socket says 172.21.15.47:41832) 2024-04-01T23:01:46.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.482+0000 7fbf7659c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbf780727a0 0x7fbf7806c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:48320/0 (socket says 172.21.15.47:48320) 2024-04-01T23:01:46.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.482+0000 7fbf75d9b640 1 -- 172.21.15.47:0/1352480016 learned_addr learned my addr 172.21.15.47:0/1352480016 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:46.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.486+0000 7fbf7659c640 1 -- 172.21.15.47:0/1352480016 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf78072be0 msgr2=0x7fbf78141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:46.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.486+0000 7fbf7659c640 1 --2- 172.21.15.47:0/1352480016 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fbf78072be0 0x7fbf78141b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:46.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.486+0000 7fbf7659c640 1 -- 172.21.15.47:0/1352480016 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf78150fb0 msgr2=0x7fbf78142080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:46.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.486+0000 7fbf7659c640 1 --2- 172.21.15.47:0/1352480016 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf78150fb0 0x7fbf78142080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:46.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.486+0000 7fbf7659c640 1 -- 172.21.15.47:0/1352480016 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf781ef7f0 con 0x7fbf780727a0 2024-04-01T23:01:46.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.488+0000 7fbf7659c640 1 --2- 172.21.15.47:0/1352480016 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbf780727a0 0x7fbf7806c7b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbf6800e870 tx=0x7fbf6800ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:46.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.492+0000 7fbf66ffd640 1 -- 172.21.15.47:0/1352480016 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf68017070 con 0x7fbf780727a0 2024-04-01T23:01:46.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.492+0000 7fbf66ffd640 1 -- 172.21.15.47:0/1352480016 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf6800c940 con 0x7fbf780727a0 2024-04-01T23:01:46.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.492+0000 7fbf66ffd640 1 -- 172.21.15.47:0/1352480016 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6800cd10 con 0x7fbf780727a0 2024-04-01T23:01:46.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.492+0000 7fbf7caae640 1 -- 172.21.15.47:0/1352480016 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf781efad0 con 0x7fbf780727a0 2024-04-01T23:01:46.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.492+0000 7fbf7caae640 1 -- 172.21.15.47:0/1352480016 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf78146750 con 0x7fbf780727a0 2024-04-01T23:01:46.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.493+0000 7fbf7caae640 1 -- 172.21.15.47:0/1352480016 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbf780ccff0 con 0x7fbf780727a0 2024-04-01T23:01:46.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.511+0000 7fbf66ffd640 1 -- 172.21.15.47:0/1352480016 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7fbf6801a070 con 0x7fbf780727a0 2024-04-01T23:01:46.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.511+0000 7fbf66ffd640 1 --2- 172.21.15.47:0/1352480016 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fbf5806b990 0x7fbf5806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:46.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.511+0000 7fbf75d9b640 1 --2- 172.21.15.47:0/1352480016 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fbf5806b990 0x7fbf5806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:46.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.512+0000 7fbf75d9b640 1 --2- 172.21.15.47:0/1352480016 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fbf5806b990 0x7fbf5806de50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbf781480d0 tx=0x7fbf6c007e10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:46.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.515+0000 7fbf66ffd640 1 -- 172.21.15.47:0/1352480016 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fbf68057400 con 0x7fbf780727a0 2024-04-01T23:01:46.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.515+0000 7fbf66ffd640 1 --2- 172.21.15.47:0/1352480016 >> [v2:172.21.15.181:6816/2161566540,v1:172.21.15.181:6817/2161566540] conn(0x7fbf580752a0 0x7fbf58077740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:46.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.515+0000 7fbf66ffd640 1 -- 172.21.15.47:0/1352480016 --> [v2:172.21.15.181:6816/2161566540,v1:172.21.15.181:6817/2161566540] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbf58077e10 con 0x7fbf580752a0 2024-04-01T23:01:46.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.515+0000 7fbf76d9d640 1 --2- 172.21.15.47:0/1352480016 >> [v2:172.21.15.181:6816/2161566540,v1:172.21.15.181:6817/2161566540] conn(0x7fbf580752a0 0x7fbf58077740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:46.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.516+0000 7fbf76d9d640 1 --2- 172.21.15.47:0/1352480016 >> [v2:172.21.15.181:6816/2161566540,v1:172.21.15.181:6817/2161566540] conn(0x7fbf580752a0 0x7fbf58077740 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:46.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.516+0000 7fbf66ffd640 1 -- 172.21.15.47:0/1352480016 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbf68055600 con 0x7fbf780727a0 2024-04-01T23:01:46.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.517+0000 7fbf66ffd640 1 -- 172.21.15.47:0/1352480016 <== osd.5 v2:172.21.15.181:6816/2161566540 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbf58077e10 con 0x7fbf580752a0 2024-04-01T23:01:46.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.530+0000 7fbf7caae640 1 -- 172.21.15.47:0/1352480016 --> [v2:172.21.15.181:6816/2161566540,v1:172.21.15.181:6817/2161566540] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbf78157c70 con 0x7fbf580752a0 2024-04-01T23:01:46.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.531+0000 7fbf66ffd640 1 -- 172.21.15.47:0/1352480016 <== osd.5 v2:172.21.15.181:6816/2161566540 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbf78157c70 con 0x7fbf580752a0 2024-04-01T23:01:46.527 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-01T23:01:46.527 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-01T23:01:46.528 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-01T23:01:46.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.531+0000 7fbf7caae640 1 -- 172.21.15.47:0/1352480016 >> [v2:172.21.15.181:6816/2161566540,v1:172.21.15.181:6817/2161566540] conn(0x7fbf580752a0 msgr2=0x7fbf58077740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:46.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.531+0000 7fbf7caae640 1 --2- 172.21.15.47:0/1352480016 >> [v2:172.21.15.181:6816/2161566540,v1:172.21.15.181:6817/2161566540] conn(0x7fbf580752a0 0x7fbf58077740 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:46.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.531+0000 7fbf7caae640 1 -- 172.21.15.47:0/1352480016 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fbf5806b990 msgr2=0x7fbf5806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:46.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.531+0000 7fbf7caae640 1 --2- 172.21.15.47:0/1352480016 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fbf5806b990 0x7fbf5806de50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbf781480d0 tx=0x7fbf6c007e10 comp rx=0 tx=0).stop 2024-04-01T23:01:46.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.531+0000 7fbf7caae640 1 -- 172.21.15.47:0/1352480016 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbf780727a0 msgr2=0x7fbf7806c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:46.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.531+0000 7fbf7caae640 1 --2- 172.21.15.47:0/1352480016 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbf780727a0 0x7fbf7806c7b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbf6800e870 tx=0x7fbf6800ed30 comp rx=0 tx=0).stop 2024-04-01T23:01:46.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.531+0000 7fbf76d9d640 1 -- 172.21.15.47:0/1352480016 reap_dead start 2024-04-01T23:01:46.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.531+0000 7fbf7caae640 1 -- 172.21.15.47:0/1352480016 shutdown_connections 2024-04-01T23:01:46.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.531+0000 7fbf7caae640 1 -- 172.21.15.47:0/1352480016 >> 172.21.15.47:0/1352480016 conn(0x7fbf78061fb0 msgr2=0x7fbf780c7090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:46.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.531+0000 7fbf7caae640 1 -- 172.21.15.47:0/1352480016 shutdown_connections 2024-04-01T23:01:46.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.531+0000 7fbf7caae640 1 -- 172.21.15.47:0/1352480016 wait complete. 2024-04-01T23:01:46.538 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-01T23:01:46.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.651+0000 7f0bf086f640 1 Processor -- start 2024-04-01T23:01:46.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.651+0000 7f0bf086f640 1 -- start start 2024-04-01T23:01:46.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.652+0000 7f0bf086f640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0bec0cc7e0 0x7f0bec15afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:46.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.652+0000 7f0bf086f640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bec0cdae0 con 0x7f0bec0c93f0 2024-04-01T23:01:46.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.652+0000 7f0bf086f640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bec0c97d0 con 0x7f0bec0cee30 2024-04-01T23:01:46.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.652+0000 7f0bf086f640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f0bec15b500 con 0x7f0bec0cc7e0 2024-04-01T23:01:46.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.693+0000 7f0bead9d640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0bec0cc7e0 0x7f0bec15afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:46.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.694+0000 7f0bea59c640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f0bec0c93f0 0x7f0bec06c230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35690/0 (socket says 172.21.15.47:35690) 2024-04-01T23:01:46.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.694+0000 7f0bea59c640 1 -- 172.21.15.47:0/2425887356 learned_addr learned my addr 172.21.15.47:0/2425887356 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T23:01:46.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.697+0000 7f0be959a640 1 -- 172.21.15.47:0/2425887356 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2825583243 0 0) 0x7f0bec0cdae0 con 0x7f0bec0c93f0 2024-04-01T23:01:46.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.697+0000 7f0be959a640 1 -- 172.21.15.47:0/2425887356 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0bd4003520 con 0x7f0bec0c93f0 2024-04-01T23:01:46.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.698+0000 7f0bead9d640 1 -- 172.21.15.47:0/2425887356 >> v1:172.21.15.181:6789/0 conn(0x7f0bec0cee30 legacy=0x7f0bec0cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:46.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.698+0000 7f0bead9d640 1 -- 172.21.15.47:0/2425887356 >> v1:172.21.15.47:6789/0 conn(0x7f0bec0c93f0 legacy=0x7f0bec06c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:46.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.698+0000 7f0bead9d640 1 -- 172.21.15.47:0/2425887356 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bec0cdd80 con 0x7f0bec0cc7e0 2024-04-01T23:01:46.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.701+0000 7f0bead9d640 1 --2- 172.21.15.47:0/2425887356 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0bec0cc7e0 0x7f0bec15afc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0be4009dc0 tx=0x7f0be402be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e6f7dc43998460 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:46.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.704+0000 7f0be959a640 1 -- 172.21.15.47:0/2425887356 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be4039070 con 0x7f0bec0cc7e0 2024-04-01T23:01:46.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.704+0000 7f0be959a640 1 -- 172.21.15.47:0/2425887356 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0be402cc40 con 0x7f0bec0cc7e0 2024-04-01T23:01:46.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.704+0000 7f0be959a640 1 -- 172.21.15.47:0/2425887356 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be4034440 con 0x7f0bec0cc7e0 2024-04-01T23:01:46.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.705+0000 7f0bf086f640 1 -- 172.21.15.47:0/2425887356 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0bec0cc7e0 msgr2=0x7f0bec15afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:46.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.705+0000 7f0bf086f640 1 --2- 172.21.15.47:0/2425887356 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0bec0cc7e0 0x7f0bec15afc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0be4009dc0 tx=0x7f0be402be90 comp rx=0 tx=0).stop 2024-04-01T23:01:46.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.705+0000 7f0bf086f640 1 -- 172.21.15.47:0/2425887356 shutdown_connections 2024-04-01T23:01:46.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.705+0000 7f0bf086f640 1 --2- 172.21.15.47:0/2425887356 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0bec0cc7e0 0x7f0bec15afc0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:46.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.705+0000 7f0bf086f640 1 -- 172.21.15.47:0/2425887356 >> 172.21.15.47:0/2425887356 conn(0x7f0bec0cfdb0 msgr2=0x7f0bec0d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:46.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.705+0000 7f0bf086f640 1 -- 172.21.15.47:0/2425887356 shutdown_connections 2024-04-01T23:01:46.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.705+0000 7f0bf086f640 1 -- 172.21.15.47:0/2425887356 wait complete. 2024-04-01T23:01:46.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.706+0000 7f0bf086f640 1 Processor -- start 2024-04-01T23:01:46.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.706+0000 7f0bf086f640 1 -- start start 2024-04-01T23:01:46.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.707+0000 7f0bf086f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0bec0c93f0 0x7f0bec1f0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:46.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.707+0000 7f0bf086f640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0bec0cc7e0 0x7f0bec1540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:46.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.707+0000 7f0bf086f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0bec0cee30 0x7f0bec1f3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:46.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.707+0000 7f0bf086f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0bec0ce620 con 0x7f0bec0cee30 2024-04-01T23:01:46.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.707+0000 7f0bf086f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0bec0ce340 con 0x7f0bec0c93f0 2024-04-01T23:01:46.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.707+0000 7f0bf086f640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f0bec0cf430 con 0x7f0bec0cc7e0 2024-04-01T23:01:46.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.708+0000 7f0bead9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0bec0cee30 0x7f0bec1f3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:46.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.708+0000 7f0be9d9b640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0bec0cc7e0 0x7f0bec1540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:46.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.708+0000 7f0bea59c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0bec0c93f0 0x7f0bec1f0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:46.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.708+0000 7f0bead9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0bec0cee30 0x7f0bec1f3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53340/0 (socket says 172.21.15.47:53340) 2024-04-01T23:01:46.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.708+0000 7f0bead9d640 1 -- 172.21.15.47:0/1467126581 learned_addr learned my addr 172.21.15.47:0/1467126581 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:46.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.711+0000 7f0bead9d640 1 -- 172.21.15.47:0/1467126581 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0bec0cc7e0 msgr2=0x7f0bec1540c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:46.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.711+0000 7f0bead9d640 1 --2- 172.21.15.47:0/1467126581 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0bec0cc7e0 0x7f0bec1540c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:46.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.711+0000 7f0bead9d640 1 -- 172.21.15.47:0/1467126581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0bec0c93f0 msgr2=0x7f0bec1f0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:46.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.711+0000 7f0bead9d640 1 --2- 172.21.15.47:0/1467126581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0bec0c93f0 0x7f0bec1f0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:46.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.711+0000 7f0bead9d640 1 -- 172.21.15.47:0/1467126581 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bec14f6f0 con 0x7f0bec0cee30 2024-04-01T23:01:46.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.714+0000 7f0bead9d640 1 --2- 172.21.15.47:0/1467126581 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0bec0cee30 0x7f0bec1f3a40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0be402c4a0 tx=0x7f0be4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:46.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.717+0000 7f0bdaffd640 1 -- 172.21.15.47:0/1467126581 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be4044020 con 0x7f0bec0cee30 2024-04-01T23:01:46.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.717+0000 7f0bdaffd640 1 -- 172.21.15.47:0/1467126581 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0be4035cf0 con 0x7f0bec0cee30 2024-04-01T23:01:46.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.717+0000 7f0bdaffd640 1 -- 172.21.15.47:0/1467126581 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be4039040 con 0x7f0bec0cee30 2024-04-01T23:01:46.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.717+0000 7f0bf086f640 1 -- 172.21.15.47:0/1467126581 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bec14f9d0 con 0x7f0bec0cee30 2024-04-01T23:01:46.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.717+0000 7f0bf086f640 1 -- 172.21.15.47:0/1467126581 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bec14ff90 con 0x7f0bec0cee30 2024-04-01T23:01:46.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.718+0000 7f0bf086f640 1 -- 172.21.15.47:0/1467126581 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bec0c6960 con 0x7f0bec0cee30 2024-04-01T23:01:46.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.986+0000 7f0bdaffd640 1 -- 172.21.15.47:0/1467126581 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f0be4047020 con 0x7f0bec0cee30 2024-04-01T23:01:46.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.987+0000 7f0bdaffd640 1 --2- 172.21.15.47:0/1467126581 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f0bcc06b9e0 0x7f0bcc06dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:46.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.987+0000 7f0bea59c640 1 --2- 172.21.15.47:0/1467126581 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f0bcc06b9e0 0x7f0bcc06dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:46.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:46.987+0000 7f0bea59c640 1 --2- 172.21.15.47:0/1467126581 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f0bcc06b9e0 0x7f0bcc06dea0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc005880 tx=0x7f0bdc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:46.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.001+0000 7f0bdaffd640 1 -- 172.21.15.47:0/1467126581 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f0be4079f30 con 0x7f0bec0cee30 2024-04-01T23:01:46.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.001+0000 7f0bdaffd640 1 -- 172.21.15.47:0/1467126581 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f0bec0c6960 con 0x7f0bec0cee30 2024-04-01T23:01:47.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.186+0000 7f0bf086f640 1 -- 172.21.15.47:0/1467126581 --> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f0bec068210 con 0x7f0bcc06b9e0 2024-04-01T23:01:47.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.186+0000 7f0bdaffd640 1 -- 172.21.15.47:0/1467126581 <== mgr.4107 v2:172.21.15.47:6800/1257047371 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0bec068210 con 0x7f0bcc06b9e0 2024-04-01T23:01:47.182 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 5 to deep-scrub 2024-04-01T23:01:47.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.188+0000 7f0bf086f640 1 -- 172.21.15.47:0/1467126581 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f0bcc06b9e0 msgr2=0x7f0bcc06dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:47.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.188+0000 7f0bf086f640 1 --2- 172.21.15.47:0/1467126581 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f0bcc06b9e0 0x7f0bcc06dea0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc005880 tx=0x7f0bdc009040 comp rx=0 tx=0).stop 2024-04-01T23:01:47.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.188+0000 7f0bf086f640 1 -- 172.21.15.47:0/1467126581 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0bec0cee30 msgr2=0x7f0bec1f3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:47.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.188+0000 7f0bf086f640 1 --2- 172.21.15.47:0/1467126581 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0bec0cee30 0x7f0bec1f3a40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0be402c4a0 tx=0x7f0be4004a40 comp rx=0 tx=0).stop 2024-04-01T23:01:47.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.188+0000 7f0bf086f640 1 -- 172.21.15.47:0/1467126581 shutdown_connections 2024-04-01T23:01:47.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.188+0000 7f0bf086f640 1 --2- 172.21.15.47:0/1467126581 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f0bcc06b9e0 0x7f0bcc06dea0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:47.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.188+0000 7f0bf086f640 1 --2- 172.21.15.47:0/1467126581 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0bec0cee30 0x7f0bec1f3a40 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:47.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.188+0000 7f0bf086f640 1 --2- 172.21.15.47:0/1467126581 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f0bec0cc7e0 0x7f0bec1540c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:47.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.188+0000 7f0bf086f640 1 --2- 172.21.15.47:0/1467126581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0bec0c93f0 0x7f0bec1f0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:47.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.188+0000 7f0bf086f640 1 -- 172.21.15.47:0/1467126581 >> 172.21.15.47:0/1467126581 conn(0x7f0bec0cfdb0 msgr2=0x7f0bec0d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:47.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.188+0000 7f0bf086f640 1 -- 172.21.15.47:0/1467126581 shutdown_connections 2024-04-01T23:01:47.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.188+0000 7f0bf086f640 1 -- 172.21.15.47:0/1467126581 wait complete. 2024-04-01T23:01:47.196 INFO:tasks.ceph:Scrubbing osd.6 2024-04-01T23:01:47.196 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-01T23:01:47.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.308+0000 7fb724fe5640 1 Processor -- start 2024-04-01T23:01:47.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.308+0000 7fb724fe5640 1 -- start start 2024-04-01T23:01:47.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.308+0000 7fb724fe5640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb7200c93f0 0x7fb7200cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:47.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.308+0000 7fb724fe5640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb72015afc0 0x7fb72006c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:47.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.308+0000 7fb724fe5640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7200cdae0 con 0x7fb72006c770 2024-04-01T23:01:47.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.308+0000 7fb724fe5640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fb7200c97d0 con 0x7fb7200c93f0 2024-04-01T23:01:47.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.308+0000 7fb724fe5640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fb7200cdd80 con 0x7fb72015afc0 2024-04-01T23:01:47.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.309+0000 7fb71e59c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb7200c93f0 0x7fb7200cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:47.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.309+0000 7fb717fff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb72015afc0 0x7fb72006c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:47.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.309+0000 7fb71e59c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb7200c93f0 0x7fb7200cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53352/0 (socket says 172.21.15.47:53352) 2024-04-01T23:01:47.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.309+0000 7fb71e59c640 1 -- 172.21.15.47:0/3359486643 learned_addr learned my addr 172.21.15.47:0/3359486643 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:47.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.311+0000 7fb71e59c640 1 -- 172.21.15.47:0/3359486643 >> v2:172.21.15.181:3300/0 conn(0x7fb72015afc0 msgr2=0x7fb72006c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:01:47.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.311+0000 7fb71e59c640 1 --2- 172.21.15.47:0/3359486643 >> v2:172.21.15.181:3300/0 conn(0x7fb72015afc0 0x7fb72006c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:47.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.311+0000 7fb71e59c640 1 -- 172.21.15.47:0/3359486643 >> v1:172.21.15.181:6789/0 conn(0x7fb72006c770 legacy=0x7fb7200cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:47.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.311+0000 7fb71e59c640 1 -- 172.21.15.47:0/3359486643 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7200ce060 con 0x7fb7200c93f0 2024-04-01T23:01:47.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.313+0000 7fb71e59c640 1 --2- 172.21.15.47:0/3359486643 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7200c93f0 0x7fb7200cee30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb72008cd20 tx=0x7fb71002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7c087c0a322d10f server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:47.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.317+0000 7fb71dd9b640 1 -- 172.21.15.47:0/3359486643 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb710035020 con 0x7fb7200c93f0 2024-04-01T23:01:47.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.317+0000 7fb71dd9b640 1 -- 172.21.15.47:0/3359486643 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb710031870 con 0x7fb7200c93f0 2024-04-01T23:01:47.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.317+0000 7fb71dd9b640 1 -- 172.21.15.47:0/3359486643 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb710031c40 con 0x7fb7200c93f0 2024-04-01T23:01:47.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.318+0000 7fb724fe5640 1 -- 172.21.15.47:0/3359486643 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7200c93f0 msgr2=0x7fb7200cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:47.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.318+0000 7fb724fe5640 1 --2- 172.21.15.47:0/3359486643 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7200c93f0 0x7fb7200cee30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb72008cd20 tx=0x7fb71002b910 comp rx=0 tx=0).stop 2024-04-01T23:01:47.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.318+0000 7fb724fe5640 1 -- 172.21.15.47:0/3359486643 shutdown_connections 2024-04-01T23:01:47.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.318+0000 7fb724fe5640 1 --2- 172.21.15.47:0/3359486643 >> v2:172.21.15.181:3300/0 conn(0x7fb72015afc0 0x7fb72006c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:47.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.318+0000 7fb724fe5640 1 --2- 172.21.15.47:0/3359486643 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7200c93f0 0x7fb7200cee30 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:47.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.318+0000 7fb724fe5640 1 -- 172.21.15.47:0/3359486643 >> 172.21.15.47:0/3359486643 conn(0x7fb7200cfdb0 msgr2=0x7fb7200d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:47.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.318+0000 7fb724fe5640 1 -- 172.21.15.47:0/3359486643 shutdown_connections 2024-04-01T23:01:47.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.318+0000 7fb724fe5640 1 -- 172.21.15.47:0/3359486643 wait complete. 2024-04-01T23:01:47.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.320+0000 7fb724fe5640 1 Processor -- start 2024-04-01T23:01:47.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.320+0000 7fb724fe5640 1 -- start start 2024-04-01T23:01:47.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.320+0000 7fb724fe5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb72006c770 0x7fb7201e3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:47.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.320+0000 7fb724fe5640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb7200c93f0 0x7fb7201e15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:47.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.320+0000 7fb724fe5640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb72015afc0 0x7fb7200c6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:47.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.320+0000 7fb724fe5640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb72015b400 con 0x7fb72006c770 2024-04-01T23:01:47.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.320+0000 7fb724fe5640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb7200ce620 con 0x7fb72015afc0 2024-04-01T23:01:47.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.320+0000 7fb724fe5640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb7200cf430 con 0x7fb7200c93f0 2024-04-01T23:01:47.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.321+0000 7fb71e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb72006c770 0x7fb7201e3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:47.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.321+0000 7fb71ed9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb72015afc0 0x7fb7200c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:47.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.321+0000 7fb717fff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb7200c93f0 0x7fb7201e15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:47.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.321+0000 7fb71e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb72006c770 0x7fb7201e3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53354/0 (socket says 172.21.15.47:53354) 2024-04-01T23:01:47.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.321+0000 7fb71e59c640 1 -- 172.21.15.47:0/2682385306 learned_addr learned my addr 172.21.15.47:0/2682385306 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:47.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.324+0000 7fb71e59c640 1 -- 172.21.15.47:0/2682385306 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb7200c93f0 msgr2=0x7fb7201e15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:47.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.324+0000 7fb71e59c640 1 --2- 172.21.15.47:0/2682385306 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb7200c93f0 0x7fb7201e15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:47.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.324+0000 7fb71e59c640 1 -- 172.21.15.47:0/2682385306 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb72015afc0 msgr2=0x7fb7200c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:47.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.324+0000 7fb71e59c640 1 --2- 172.21.15.47:0/2682385306 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb72015afc0 0x7fb7200c6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:47.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.324+0000 7fb71e59c640 1 -- 172.21.15.47:0/2682385306 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7200b5820 con 0x7fb72006c770 2024-04-01T23:01:47.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.327+0000 7fb71e59c640 1 --2- 172.21.15.47:0/2682385306 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb72006c770 0x7fb7201e3440 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb71002b950 tx=0x7fb7100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:47.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.330+0000 7fb716ffd640 1 -- 172.21.15.47:0/2682385306 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb710040070 con 0x7fb72006c770 2024-04-01T23:01:47.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.330+0000 7fb716ffd640 1 -- 172.21.15.47:0/2682385306 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb710030d00 con 0x7fb72006c770 2024-04-01T23:01:47.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.330+0000 7fb716ffd640 1 -- 172.21.15.47:0/2682385306 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb710035040 con 0x7fb72006c770 2024-04-01T23:01:47.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.330+0000 7fb724fe5640 1 -- 172.21.15.47:0/2682385306 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7201f0560 con 0x7fb72006c770 2024-04-01T23:01:47.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.330+0000 7fb724fe5640 1 -- 172.21.15.47:0/2682385306 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7201f0ae0 con 0x7fb72006c770 2024-04-01T23:01:47.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.331+0000 7fb724fe5640 1 -- 172.21.15.47:0/2682385306 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb720068210 con 0x7fb72006c770 2024-04-01T23:01:47.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.351+0000 7fb716ffd640 1 -- 172.21.15.47:0/2682385306 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7fb71004b060 con 0x7fb72006c770 2024-04-01T23:01:47.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.351+0000 7fb716ffd640 1 --2- 172.21.15.47:0/2682385306 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fb70006b9e0 0x7fb70006dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:47.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.351+0000 7fb717fff640 1 --2- 172.21.15.47:0/2682385306 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fb70006b9e0 0x7fb70006dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:47.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.352+0000 7fb717fff640 1 --2- 172.21.15.47:0/2682385306 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fb70006b9e0 0x7fb70006dea0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb708009aa0 tx=0x7fb708009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:47.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.354+0000 7fb716ffd640 1 -- 172.21.15.47:0/2682385306 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fb7100790b0 con 0x7fb72006c770 2024-04-01T23:01:47.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.354+0000 7fb716ffd640 1 --2- 172.21.15.47:0/2682385306 >> [v2:172.21.15.181:6800/3792144865,v1:172.21.15.181:6801/3792144865] conn(0x7fb700075370 0x7fb700077810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:47.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.354+0000 7fb716ffd640 1 -- 172.21.15.47:0/2682385306 --> [v2:172.21.15.181:6800/3792144865,v1:172.21.15.181:6801/3792144865] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb71000af30 con 0x7fb700075370 2024-04-01T23:01:47.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.354+0000 7fb71ed9d640 1 --2- 172.21.15.47:0/2682385306 >> [v2:172.21.15.181:6800/3792144865,v1:172.21.15.181:6801/3792144865] conn(0x7fb700075370 0x7fb700077810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:47.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.355+0000 7fb71ed9d640 1 --2- 172.21.15.47:0/2682385306 >> [v2:172.21.15.181:6800/3792144865,v1:172.21.15.181:6801/3792144865] conn(0x7fb700075370 0x7fb700077810 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:47.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.355+0000 7fb716ffd640 1 -- 172.21.15.47:0/2682385306 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb7100772b0 con 0x7fb72006c770 2024-04-01T23:01:47.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.355+0000 7fb716ffd640 1 -- 172.21.15.47:0/2682385306 <== osd.6 v2:172.21.15.181:6800/3792144865 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb71000af30 con 0x7fb700075370 2024-04-01T23:01:47.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.370+0000 7fb724fe5640 1 -- 172.21.15.47:0/2682385306 --> [v2:172.21.15.181:6800/3792144865,v1:172.21.15.181:6801/3792144865] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb72006cf00 con 0x7fb700075370 2024-04-01T23:01:47.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.371+0000 7fb716ffd640 1 -- 172.21.15.47:0/2682385306 <== osd.6 v2:172.21.15.181:6800/3792144865 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb72006cf00 con 0x7fb700075370 2024-04-01T23:01:47.367 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-01T23:01:47.367 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-01T23:01:47.367 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-01T23:01:47.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.371+0000 7fb724fe5640 1 -- 172.21.15.47:0/2682385306 >> [v2:172.21.15.181:6800/3792144865,v1:172.21.15.181:6801/3792144865] conn(0x7fb700075370 msgr2=0x7fb700077810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:47.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.371+0000 7fb724fe5640 1 --2- 172.21.15.47:0/2682385306 >> [v2:172.21.15.181:6800/3792144865,v1:172.21.15.181:6801/3792144865] conn(0x7fb700075370 0x7fb700077810 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:47.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.371+0000 7fb724fe5640 1 -- 172.21.15.47:0/2682385306 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fb70006b9e0 msgr2=0x7fb70006dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:47.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.371+0000 7fb724fe5640 1 --2- 172.21.15.47:0/2682385306 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fb70006b9e0 0x7fb70006dea0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb708009aa0 tx=0x7fb708009190 comp rx=0 tx=0).stop 2024-04-01T23:01:47.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.371+0000 7fb724fe5640 1 -- 172.21.15.47:0/2682385306 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb72006c770 msgr2=0x7fb7201e3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:47.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.371+0000 7fb724fe5640 1 --2- 172.21.15.47:0/2682385306 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb72006c770 0x7fb7201e3440 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb71002b950 tx=0x7fb7100046c0 comp rx=0 tx=0).stop 2024-04-01T23:01:47.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.371+0000 7fb71ed9d640 1 -- 172.21.15.47:0/2682385306 reap_dead start 2024-04-01T23:01:47.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.371+0000 7fb724fe5640 1 -- 172.21.15.47:0/2682385306 shutdown_connections 2024-04-01T23:01:47.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.371+0000 7fb724fe5640 1 -- 172.21.15.47:0/2682385306 >> 172.21.15.47:0/2682385306 conn(0x7fb7200cfdb0 msgr2=0x7fb7200cb2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:47.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.372+0000 7fb724fe5640 1 -- 172.21.15.47:0/2682385306 shutdown_connections 2024-04-01T23:01:47.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.372+0000 7fb724fe5640 1 -- 172.21.15.47:0/2682385306 wait complete. 2024-04-01T23:01:47.378 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-01T23:01:47.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.486+0000 7fdf553bc640 1 Processor -- start 2024-04-01T23:01:47.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.487+0000 7fdf553bc640 1 -- start start 2024-04-01T23:01:47.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.487+0000 7fdf553bc640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fdf50070830 0x7fdf500c3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:47.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.487+0000 7fdf553bc640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fdf50150ce0 0x7fdf50151170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:47.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.487+0000 7fdf553bc640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf500c47f0 con 0x7fdf50070450 2024-04-01T23:01:47.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.487+0000 7fdf553bc640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fdf500c6b60 con 0x7fdf50070830 2024-04-01T23:01:47.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.487+0000 7fdf553bc640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fdf500c6230 con 0x7fdf50150ce0 2024-04-01T23:01:47.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.488+0000 7fdf47fff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fdf50070830 0x7fdf500c3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:47.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.488+0000 7fdf4f7fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fdf50150ce0 0x7fdf50151170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:47.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.488+0000 7fdf47fff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fdf50070830 0x7fdf500c3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53364/0 (socket says 172.21.15.47:53364) 2024-04-01T23:01:47.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.488+0000 7fdf47fff640 1 -- 172.21.15.47:0/3895539075 learned_addr learned my addr 172.21.15.47:0/3895539075 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:47.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.491+0000 7fdf47fff640 1 -- 172.21.15.47:0/3895539075 >> v2:172.21.15.181:3300/0 conn(0x7fdf50150ce0 msgr2=0x7fdf50151170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:01:47.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.491+0000 7fdf47fff640 1 --2- 172.21.15.47:0/3895539075 >> v2:172.21.15.181:3300/0 conn(0x7fdf50150ce0 0x7fdf50151170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:47.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.491+0000 7fdf47fff640 1 -- 172.21.15.47:0/3895539075 >> v1:172.21.15.181:6789/0 conn(0x7fdf50070450 legacy=0x7fdf500c9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:01:47.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.491+0000 7fdf47fff640 1 -- 172.21.15.47:0/3895539075 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf500c6510 con 0x7fdf50070830 2024-04-01T23:01:47.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.493+0000 7fdf47fff640 1 --2- 172.21.15.47:0/3895539075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf50070830 0x7fdf500c3ed0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdf500c6090 tx=0x7fdf3802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55cee749ae2d254 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:47.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.497+0000 7fdf4e7fc640 1 -- 172.21.15.47:0/3895539075 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf38034070 con 0x7fdf50070830 2024-04-01T23:01:47.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.497+0000 7fdf4e7fc640 1 -- 172.21.15.47:0/3895539075 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf38030860 con 0x7fdf50070830 2024-04-01T23:01:47.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.497+0000 7fdf4e7fc640 1 -- 172.21.15.47:0/3895539075 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf38030c30 con 0x7fdf50070830 2024-04-01T23:01:47.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.498+0000 7fdf553bc640 1 -- 172.21.15.47:0/3895539075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf50070830 msgr2=0x7fdf500c3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:47.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.498+0000 7fdf553bc640 1 --2- 172.21.15.47:0/3895539075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf50070830 0x7fdf500c3ed0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdf500c6090 tx=0x7fdf3802b9a0 comp rx=0 tx=0).stop 2024-04-01T23:01:47.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.498+0000 7fdf553bc640 1 -- 172.21.15.47:0/3895539075 shutdown_connections 2024-04-01T23:01:47.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.498+0000 7fdf553bc640 1 --2- 172.21.15.47:0/3895539075 >> v2:172.21.15.181:3300/0 conn(0x7fdf50150ce0 0x7fdf50151170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:47.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.498+0000 7fdf553bc640 1 --2- 172.21.15.47:0/3895539075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf50070830 0x7fdf500c3ed0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:47.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.498+0000 7fdf553bc640 1 -- 172.21.15.47:0/3895539075 >> 172.21.15.47:0/3895539075 conn(0x7fdf50072a10 msgr2=0x7fdf5006e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:47.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.498+0000 7fdf553bc640 1 -- 172.21.15.47:0/3895539075 shutdown_connections 2024-04-01T23:01:47.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.498+0000 7fdf553bc640 1 -- 172.21.15.47:0/3895539075 wait complete. 2024-04-01T23:01:47.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.499+0000 7fdf553bc640 1 Processor -- start 2024-04-01T23:01:47.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.499+0000 7fdf553bc640 1 -- start start 2024-04-01T23:01:47.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.500+0000 7fdf553bc640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdf50070450 0x7fdf501f0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:47.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.500+0000 7fdf553bc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf50070830 0x7fdf5006c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:47.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.500+0000 7fdf553bc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf50150ce0 0x7fdf501490d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:47.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.500+0000 7fdf553bc640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdf500c4c50 con 0x7fdf50150ce0 2024-04-01T23:01:47.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.500+0000 7fdf553bc640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fdf500c4ad0 con 0x7fdf50070830 2024-04-01T23:01:47.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.500+0000 7fdf553bc640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fdf500c4410 con 0x7fdf50070450 2024-04-01T23:01:47.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.501+0000 7fdf47fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf50070830 0x7fdf5006c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:47.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.501+0000 7fdf47fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf50070830 0x7fdf5006c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:48378/0 (socket says 172.21.15.47:48378) 2024-04-01T23:01:47.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.501+0000 7fdf47fff640 1 -- 172.21.15.47:0/4007838907 learned_addr learned my addr 172.21.15.47:0/4007838907 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:47.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.502+0000 7fdf4f7fe640 1 --2- 172.21.15.47:0/4007838907 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf50150ce0 0x7fdf501490d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:47.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.503+0000 7fdf4effd640 1 --2- 172.21.15.47:0/4007838907 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdf50070450 0x7fdf501f0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:47.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.504+0000 7fdf47fff640 1 -- 172.21.15.47:0/4007838907 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdf50070450 msgr2=0x7fdf501f0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:47.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.504+0000 7fdf47fff640 1 --2- 172.21.15.47:0/4007838907 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdf50070450 0x7fdf501f0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:47.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.504+0000 7fdf47fff640 1 -- 172.21.15.47:0/4007838907 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf50150ce0 msgr2=0x7fdf501490d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:47.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.504+0000 7fdf47fff640 1 --2- 172.21.15.47:0/4007838907 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf50150ce0 0x7fdf501490d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:47.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.504+0000 7fdf47fff640 1 -- 172.21.15.47:0/4007838907 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf5014f370 con 0x7fdf50070830 2024-04-01T23:01:47.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.507+0000 7fdf47fff640 1 --2- 172.21.15.47:0/4007838907 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf50070830 0x7fdf5006c500 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdf38000c00 tx=0x7fdf38004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:47.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.512+0000 7fdf477fe640 1 -- 172.21.15.47:0/4007838907 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf38048070 con 0x7fdf50070830 2024-04-01T23:01:47.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.512+0000 7fdf477fe640 1 -- 172.21.15.47:0/4007838907 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf38030660 con 0x7fdf50070830 2024-04-01T23:01:47.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.512+0000 7fdf477fe640 1 -- 172.21.15.47:0/4007838907 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf38034040 con 0x7fdf50070830 2024-04-01T23:01:47.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.512+0000 7fdf553bc640 1 -- 172.21.15.47:0/4007838907 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf5014f650 con 0x7fdf50070830 2024-04-01T23:01:47.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.512+0000 7fdf553bc640 1 -- 172.21.15.47:0/4007838907 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf5014bd80 con 0x7fdf50070830 2024-04-01T23:01:47.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.513+0000 7fdf553bc640 1 -- 172.21.15.47:0/4007838907 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf50068920 con 0x7fdf50070830 2024-04-01T23:01:47.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.533+0000 7fdf477fe640 1 -- 172.21.15.47:0/4007838907 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7fdf3804b070 con 0x7fdf50070830 2024-04-01T23:01:47.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.533+0000 7fdf477fe640 1 --2- 172.21.15.47:0/4007838907 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fdf3006ba10 0x7fdf3006ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:47.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.534+0000 7fdf4effd640 1 --2- 172.21.15.47:0/4007838907 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fdf3006ba10 0x7fdf3006ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:47.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.534+0000 7fdf4effd640 1 --2- 172.21.15.47:0/4007838907 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fdf3006ba10 0x7fdf3006ded0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdf40004ea0 tx=0x7fdf40009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:47.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.537+0000 7fdf477fe640 1 -- 172.21.15.47:0/4007838907 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fdf38030810 con 0x7fdf50070830 2024-04-01T23:01:47.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.772+0000 7fdf477fe640 1 -- 172.21.15.47:0/4007838907 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fdf38052020 con 0x7fdf50070830 2024-04-01T23:01:47.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.956+0000 7fdf553bc640 1 -- 172.21.15.47:0/4007838907 --> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fdf50154ec0 con 0x7fdf3006ba10 2024-04-01T23:01:47.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.957+0000 7fdf477fe640 1 -- 172.21.15.47:0/4007838907 <== mgr.4107 v2:172.21.15.47:6800/1257047371 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fdf50154ec0 con 0x7fdf3006ba10 2024-04-01T23:01:47.953 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 6 to deep-scrub 2024-04-01T23:01:47.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.959+0000 7fdf553bc640 1 -- 172.21.15.47:0/4007838907 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fdf3006ba10 msgr2=0x7fdf3006ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:47.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.959+0000 7fdf553bc640 1 --2- 172.21.15.47:0/4007838907 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fdf3006ba10 0x7fdf3006ded0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdf40004ea0 tx=0x7fdf40009040 comp rx=0 tx=0).stop 2024-04-01T23:01:47.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.959+0000 7fdf553bc640 1 -- 172.21.15.47:0/4007838907 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf50070830 msgr2=0x7fdf5006c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:47.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.959+0000 7fdf553bc640 1 --2- 172.21.15.47:0/4007838907 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf50070830 0x7fdf5006c500 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdf38000c00 tx=0x7fdf38004730 comp rx=0 tx=0).stop 2024-04-01T23:01:47.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.959+0000 7fdf553bc640 1 -- 172.21.15.47:0/4007838907 shutdown_connections 2024-04-01T23:01:47.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.959+0000 7fdf553bc640 1 --2- 172.21.15.47:0/4007838907 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fdf3006ba10 0x7fdf3006ded0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:47.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.959+0000 7fdf553bc640 1 --2- 172.21.15.47:0/4007838907 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf50150ce0 0x7fdf501490d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:47.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.959+0000 7fdf553bc640 1 --2- 172.21.15.47:0/4007838907 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf50070830 0x7fdf5006c500 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:47.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.959+0000 7fdf553bc640 1 --2- 172.21.15.47:0/4007838907 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fdf50070450 0x7fdf501f0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:47.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.959+0000 7fdf553bc640 1 -- 172.21.15.47:0/4007838907 >> 172.21.15.47:0/4007838907 conn(0x7fdf50072a10 msgr2=0x7fdf500c70c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:47.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.959+0000 7fdf553bc640 1 -- 172.21.15.47:0/4007838907 shutdown_connections 2024-04-01T23:01:47.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:47.959+0000 7fdf553bc640 1 -- 172.21.15.47:0/4007838907 wait complete. 2024-04-01T23:01:47.966 INFO:tasks.ceph:Scrubbing osd.7 2024-04-01T23:01:47.967 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-01T23:01:48.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.078+0000 7f60afd7a640 1 Processor -- start 2024-04-01T23:01:48.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.079+0000 7f60afd7a640 1 -- start start 2024-04-01T23:01:48.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.079+0000 7f60afd7a640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f60a80cee30 0x7f60a815afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:48.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.079+0000 7f60afd7a640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f60a80cc0d0 0x7f60a80cc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:48.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.079+0000 7f60afd7a640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60a80cdae0 con 0x7f60a80c93f0 2024-04-01T23:01:48.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.079+0000 7f60afd7a640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f60a815b500 con 0x7f60a80cc0d0 2024-04-01T23:01:48.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.079+0000 7f60afd7a640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f60a80cca60 con 0x7f60a80cee30 2024-04-01T23:01:48.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.080+0000 7f60ad315640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f60a80cee30 0x7f60a815afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:48.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.080+0000 7f60ad315640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f60a80cee30 0x7f60a815afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:48382/0 (socket says 172.21.15.47:48382) 2024-04-01T23:01:48.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.080+0000 7f60ad315640 1 -- 172.21.15.47:0/228284921 learned_addr learned my addr 172.21.15.47:0/228284921 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:48.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.083+0000 7f60ad315640 1 -- 172.21.15.47:0/228284921 >> v2:172.21.15.47:3300/0 conn(0x7f60a80cc0d0 msgr2=0x7f60a80cc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:01:48.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.083+0000 7f60ad315640 1 --2- 172.21.15.47:0/228284921 >> v2:172.21.15.47:3300/0 conn(0x7f60a80cc0d0 0x7f60a80cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:48.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.083+0000 7f60ad315640 1 -- 172.21.15.47:0/228284921 >> v1:172.21.15.181:6789/0 conn(0x7f60a80c93f0 legacy=0x7f60a806c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:48.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.083+0000 7f60ad315640 1 -- 172.21.15.47:0/228284921 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60a80c97d0 con 0x7f60a80cee30 2024-04-01T23:01:48.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.088+0000 7f60ad315640 1 --2- 172.21.15.47:0/228284921 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f60a80cee30 0x7f60a815afc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f60a808cd20 tx=0x7f609802b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d54083bda8164ab server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:48.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.092+0000 7f60acb14640 1 -- 172.21.15.47:0/228284921 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6098035020 con 0x7f60a80cee30 2024-04-01T23:01:48.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.092+0000 7f60acb14640 1 -- 172.21.15.47:0/228284921 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6098031870 con 0x7f60a80cee30 2024-04-01T23:01:48.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.092+0000 7f60acb14640 1 -- 172.21.15.47:0/228284921 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6098031c40 con 0x7f60a80cee30 2024-04-01T23:01:48.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.093+0000 7f60afd7a640 1 -- 172.21.15.47:0/228284921 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f60a80cee30 msgr2=0x7f60a815afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:48.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.093+0000 7f60afd7a640 1 --2- 172.21.15.47:0/228284921 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f60a80cee30 0x7f60a815afc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f60a808cd20 tx=0x7f609802b910 comp rx=0 tx=0).stop 2024-04-01T23:01:48.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.093+0000 7f60afd7a640 1 -- 172.21.15.47:0/228284921 shutdown_connections 2024-04-01T23:01:48.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.093+0000 7f60afd7a640 1 --2- 172.21.15.47:0/228284921 >> v2:172.21.15.47:3300/0 conn(0x7f60a80cc0d0 0x7f60a80cc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:48.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.093+0000 7f60afd7a640 1 --2- 172.21.15.47:0/228284921 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f60a80cee30 0x7f60a815afc0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:48.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.093+0000 7f60afd7a640 1 -- 172.21.15.47:0/228284921 >> 172.21.15.47:0/228284921 conn(0x7f60a80cfdb0 msgr2=0x7f60a80d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:48.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.093+0000 7f60afd7a640 1 -- 172.21.15.47:0/228284921 shutdown_connections 2024-04-01T23:01:48.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.093+0000 7f60afd7a640 1 -- 172.21.15.47:0/228284921 wait complete. 2024-04-01T23:01:48.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.094+0000 7f60afd7a640 1 Processor -- start 2024-04-01T23:01:48.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.094+0000 7f60afd7a640 1 -- start start 2024-04-01T23:01:48.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.095+0000 7f60afd7a640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f60a80c93f0 0x7f60a80aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:48.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.095+0000 7f60afd7a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f60a80cc0d0 0x7f60a80c5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:48.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.095+0000 7f60afd7a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60a80cee30 0x7f60a80b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:48.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.095+0000 7f60afd7a640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f60a80ce340 con 0x7f60a80cee30 2024-04-01T23:01:48.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.095+0000 7f60afd7a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f60a80ce060 con 0x7f60a80cc0d0 2024-04-01T23:01:48.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.095+0000 7f60afd7a640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f60a80ce620 con 0x7f60a80c93f0 2024-04-01T23:01:48.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.095+0000 7f60ae317640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60a80cee30 0x7f60a80b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:48.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.095+0000 7f60adb16640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f60a80c93f0 0x7f60a80aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:48.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.096+0000 7f60ae317640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60a80cee30 0x7f60a80b4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53396/0 (socket says 172.21.15.47:53396) 2024-04-01T23:01:48.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.096+0000 7f60ae317640 1 -- 172.21.15.47:0/3235068363 learned_addr learned my addr 172.21.15.47:0/3235068363 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:48.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.096+0000 7f60ad315640 1 --2- 172.21.15.47:0/3235068363 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f60a80cc0d0 0x7f60a80c5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:48.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.099+0000 7f60ae317640 1 -- 172.21.15.47:0/3235068363 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f60a80c93f0 msgr2=0x7f60a80aef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:48.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.099+0000 7f60ae317640 1 --2- 172.21.15.47:0/3235068363 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f60a80c93f0 0x7f60a80aef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:48.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.099+0000 7f60ae317640 1 -- 172.21.15.47:0/3235068363 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f60a80cc0d0 msgr2=0x7f60a80c5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:48.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.099+0000 7f60ae317640 1 --2- 172.21.15.47:0/3235068363 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f60a80cc0d0 0x7f60a80c5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:48.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.099+0000 7f60ae317640 1 -- 172.21.15.47:0/3235068363 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60a80b1780 con 0x7f60a80cee30 2024-04-01T23:01:48.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.101+0000 7f60ae317640 1 --2- 172.21.15.47:0/3235068363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60a80cee30 0x7f60a80b4f70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f60a000b970 tx=0x7f60a000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:48.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.105+0000 7f609e7fc640 1 -- 172.21.15.47:0/3235068363 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a0019070 con 0x7f60a80cee30 2024-04-01T23:01:48.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.105+0000 7f609e7fc640 1 -- 172.21.15.47:0/3235068363 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60a000cb60 con 0x7f60a80cee30 2024-04-01T23:01:48.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.105+0000 7f609e7fc640 1 -- 172.21.15.47:0/3235068363 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a0014440 con 0x7f60a80cee30 2024-04-01T23:01:48.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.105+0000 7f60afd7a640 1 -- 172.21.15.47:0/3235068363 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60a80c6020 con 0x7f60a80cee30 2024-04-01T23:01:48.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.105+0000 7f60afd7a640 1 -- 172.21.15.47:0/3235068363 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60a81f08a0 con 0x7f60a80cee30 2024-04-01T23:01:48.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.106+0000 7f60afd7a640 1 -- 172.21.15.47:0/3235068363 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f60a81f03f0 con 0x7f60a80cee30 2024-04-01T23:01:48.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.124+0000 7f609e7fc640 1 -- 172.21.15.47:0/3235068363 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f60a001c070 con 0x7f60a80cee30 2024-04-01T23:01:48.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.125+0000 7f609e7fc640 1 --2- 172.21.15.47:0/3235068363 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f608c06b9e0 0x7f608c06dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:48.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.125+0000 7f60adb16640 1 --2- 172.21.15.47:0/3235068363 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f608c06b9e0 0x7f608c06dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:48.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.125+0000 7f60adb16640 1 --2- 172.21.15.47:0/3235068363 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f608c06b9e0 0x7f608c06dea0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f60a4000f60 tx=0x7f60a4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:48.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.128+0000 7f609e7fc640 1 -- 172.21.15.47:0/3235068363 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f60a0057240 con 0x7f60a80cee30 2024-04-01T23:01:48.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.129+0000 7f609e7fc640 1 --2- 172.21.15.47:0/3235068363 >> [v2:172.21.15.181:6824/1760995885,v1:172.21.15.181:6825/1760995885] conn(0x7f608c075380 0x7f608c077820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:48.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.129+0000 7f609e7fc640 1 -- 172.21.15.47:0/3235068363 --> [v2:172.21.15.181:6824/1760995885,v1:172.21.15.181:6825/1760995885] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f60a0010e50 con 0x7f608c075380 2024-04-01T23:01:48.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.129+0000 7f60ad315640 1 --2- 172.21.15.47:0/3235068363 >> [v2:172.21.15.181:6824/1760995885,v1:172.21.15.181:6825/1760995885] conn(0x7f608c075380 0x7f608c077820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:48.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.129+0000 7f60ad315640 1 --2- 172.21.15.47:0/3235068363 >> [v2:172.21.15.181:6824/1760995885,v1:172.21.15.181:6825/1760995885] conn(0x7f608c075380 0x7f608c077820 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:48.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.130+0000 7f609e7fc640 1 -- 172.21.15.47:0/3235068363 <== osd.7 v2:172.21.15.181:6824/1760995885 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f60a0010e50 con 0x7f608c075380 2024-04-01T23:01:48.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.130+0000 7f609e7fc640 1 -- 172.21.15.47:0/3235068363 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f60a0055440 con 0x7f60a80cee30 2024-04-01T23:01:48.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.143+0000 7f60afd7a640 1 -- 172.21.15.47:0/3235068363 --> [v2:172.21.15.181:6824/1760995885,v1:172.21.15.181:6825/1760995885] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f60a8068210 con 0x7f608c075380 2024-04-01T23:01:48.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.144+0000 7f609e7fc640 1 -- 172.21.15.47:0/3235068363 <== osd.7 v2:172.21.15.181:6824/1760995885 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f60a8068210 con 0x7f608c075380 2024-04-01T23:01:48.140 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-01T23:01:48.140 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-01T23:01:48.140 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-01T23:01:48.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.144+0000 7f60afd7a640 1 -- 172.21.15.47:0/3235068363 >> [v2:172.21.15.181:6824/1760995885,v1:172.21.15.181:6825/1760995885] conn(0x7f608c075380 msgr2=0x7f608c077820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:48.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.144+0000 7f60afd7a640 1 --2- 172.21.15.47:0/3235068363 >> [v2:172.21.15.181:6824/1760995885,v1:172.21.15.181:6825/1760995885] conn(0x7f608c075380 0x7f608c077820 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:48.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.144+0000 7f60afd7a640 1 -- 172.21.15.47:0/3235068363 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f608c06b9e0 msgr2=0x7f608c06dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:48.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.144+0000 7f60afd7a640 1 --2- 172.21.15.47:0/3235068363 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f608c06b9e0 0x7f608c06dea0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f60a4000f60 tx=0x7f60a4009040 comp rx=0 tx=0).stop 2024-04-01T23:01:48.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.144+0000 7f60afd7a640 1 -- 172.21.15.47:0/3235068363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60a80cee30 msgr2=0x7f60a80b4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:48.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.144+0000 7f60afd7a640 1 --2- 172.21.15.47:0/3235068363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60a80cee30 0x7f60a80b4f70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f60a000b970 tx=0x7f60a000be30 comp rx=0 tx=0).stop 2024-04-01T23:01:48.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.144+0000 7f60ae317640 1 -- 172.21.15.47:0/3235068363 reap_dead start 2024-04-01T23:01:48.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.144+0000 7f60afd7a640 1 -- 172.21.15.47:0/3235068363 shutdown_connections 2024-04-01T23:01:48.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.144+0000 7f60afd7a640 1 -- 172.21.15.47:0/3235068363 >> 172.21.15.47:0/3235068363 conn(0x7f60a80cfdb0 msgr2=0x7f60a8154130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:48.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.144+0000 7f60afd7a640 1 -- 172.21.15.47:0/3235068363 shutdown_connections 2024-04-01T23:01:48.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.144+0000 7f60afd7a640 1 -- 172.21.15.47:0/3235068363 wait complete. 2024-04-01T23:01:48.151 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-01T23:01:48.198 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T23:01:48.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.258+0000 7f4129125640 1 Processor -- start 2024-04-01T23:01:48.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.258+0000 7f4129125640 1 -- start start 2024-04-01T23:01:48.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.259+0000 7f4129125640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f41240c93f0 0x7f41240cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:48.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.259+0000 7f4129125640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f41240cc0d0 0x7f41240cc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:48.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.259+0000 7f4129125640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41240ccaa0 con 0x7f412415afc0 2024-04-01T23:01:48.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.259+0000 7f4129125640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f41240cdae0 con 0x7f41240cc0d0 2024-04-01T23:01:48.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.259+0000 7f4129125640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f41240c97d0 con 0x7f41240c93f0 2024-04-01T23:01:48.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.259+0000 7f4122d9d640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f41240c93f0 0x7f41240cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:48.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.259+0000 7f412359e640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f41240cc0d0 0x7f41240cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:48.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.260+0000 7f412359e640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f41240cc0d0 0x7f41240cc560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:48404/0 (socket says 172.21.15.47:48404) 2024-04-01T23:01:48.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.260+0000 7f412359e640 1 -- 172.21.15.47:0/2971703217 learned_addr learned my addr 172.21.15.47:0/2971703217 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:48.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.262+0000 7f4122d9d640 1 -- 172.21.15.47:0/2971703217 >> v2:172.21.15.181:3300/0 conn(0x7f41240cc0d0 msgr2=0x7f41240cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:01:48.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.262+0000 7f4122d9d640 1 --2- 172.21.15.47:0/2971703217 >> v2:172.21.15.181:3300/0 conn(0x7f41240cc0d0 0x7f41240cc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:48.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.262+0000 7f4122d9d640 1 -- 172.21.15.47:0/2971703217 >> v1:172.21.15.181:6789/0 conn(0x7f412415afc0 legacy=0x7f412406c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:01:48.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.262+0000 7f4122d9d640 1 -- 172.21.15.47:0/2971703217 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41240cdd80 con 0x7f41240c93f0 2024-04-01T23:01:48.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.264+0000 7f4122d9d640 1 --2- 172.21.15.47:0/2971703217 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f41240c93f0 0x7f41240cee30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f41180097a0 tx=0x7f411802b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0a56508b28656ef server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:48.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.268+0000 7f4121d9b640 1 -- 172.21.15.47:0/2971703217 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4118038070 con 0x7f41240c93f0 2024-04-01T23:01:48.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.268+0000 7f4121d9b640 1 -- 172.21.15.47:0/2971703217 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4118031700 con 0x7f41240c93f0 2024-04-01T23:01:48.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.268+0000 7f4121d9b640 1 -- 172.21.15.47:0/2971703217 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4118031ad0 con 0x7f41240c93f0 2024-04-01T23:01:48.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.268+0000 7f4129125640 1 -- 172.21.15.47:0/2971703217 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f41240c93f0 msgr2=0x7f41240cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:48.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.268+0000 7f4129125640 1 --2- 172.21.15.47:0/2971703217 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f41240c93f0 0x7f41240cee30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f41180097a0 tx=0x7f411802b7a0 comp rx=0 tx=0).stop 2024-04-01T23:01:48.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.268+0000 7f4129125640 1 -- 172.21.15.47:0/2971703217 shutdown_connections 2024-04-01T23:01:48.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.268+0000 7f4129125640 1 --2- 172.21.15.47:0/2971703217 >> v2:172.21.15.181:3300/0 conn(0x7f41240cc0d0 0x7f41240cc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:48.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.268+0000 7f4129125640 1 --2- 172.21.15.47:0/2971703217 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f41240c93f0 0x7f41240cee30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:48.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.268+0000 7f4129125640 1 -- 172.21.15.47:0/2971703217 >> 172.21.15.47:0/2971703217 conn(0x7f41240cfdb0 msgr2=0x7f41240d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:48.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.268+0000 7f4129125640 1 -- 172.21.15.47:0/2971703217 shutdown_connections 2024-04-01T23:01:48.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.268+0000 7f4129125640 1 -- 172.21.15.47:0/2971703217 wait complete. 2024-04-01T23:01:48.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.270+0000 7f4129125640 1 Processor -- start 2024-04-01T23:01:48.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.270+0000 7f4129125640 1 -- start start 2024-04-01T23:01:48.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.271+0000 7f4129125640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f41240c93f0 0x7f41240c3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:48.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.271+0000 7f4129125640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41240cc0d0 0x7f4124154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:48.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.271+0000 7f4129125640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f412415afc0 0x7f41241e2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:48.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.271+0000 7f4129125640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f41240ce620 con 0x7f41240cc0d0 2024-04-01T23:01:48.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.271+0000 7f4129125640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f41240ce340 con 0x7f412415afc0 2024-04-01T23:01:48.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.271+0000 7f4129125640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f412415b400 con 0x7f41240c93f0 2024-04-01T23:01:48.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.271+0000 7f412359e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f412415afc0 0x7f41241e2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:48.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.271+0000 7f4122d9d640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f41240c93f0 0x7f41240c3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:48.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.271+0000 7f412259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41240cc0d0 0x7f4124154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:48.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.271+0000 7f412359e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f412415afc0 0x7f41241e2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:48420/0 (socket says 172.21.15.47:48420) 2024-04-01T23:01:48.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.271+0000 7f412359e640 1 -- 172.21.15.47:0/939831617 learned_addr learned my addr 172.21.15.47:0/939831617 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:48.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.275+0000 7f4122d9d640 1 -- 172.21.15.47:0/939831617 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f412415afc0 msgr2=0x7f41241e2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:48.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.275+0000 7f4122d9d640 1 --2- 172.21.15.47:0/939831617 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f412415afc0 0x7f41241e2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:48.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.275+0000 7f4122d9d640 1 -- 172.21.15.47:0/939831617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41240cc0d0 msgr2=0x7f4124154250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:48.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.275+0000 7f4122d9d640 1 --2- 172.21.15.47:0/939831617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41240cc0d0 0x7f4124154250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:48.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.275+0000 7f4122d9d640 1 -- 172.21.15.47:0/939831617 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41240b19a0 con 0x7f41240c93f0 2024-04-01T23:01:48.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.278+0000 7f4122d9d640 1 --2- 172.21.15.47:0/939831617 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f41240c93f0 0x7f41240c3820 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4118033000 tx=0x7f41180046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:48.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.281+0000 7f410b7fe640 1 -- 172.21.15.47:0/939831617 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4118042070 con 0x7f41240c93f0 2024-04-01T23:01:48.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.281+0000 7f410b7fe640 1 -- 172.21.15.47:0/939831617 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f411803d890 con 0x7f41240c93f0 2024-04-01T23:01:48.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.281+0000 7f4129125640 1 -- 172.21.15.47:0/939831617 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41240b00b0 con 0x7f41240c93f0 2024-04-01T23:01:48.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.281+0000 7f410b7fe640 1 -- 172.21.15.47:0/939831617 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4118038040 con 0x7f41240c93f0 2024-04-01T23:01:48.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.281+0000 7f4129125640 1 -- 172.21.15.47:0/939831617 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f41240b0650 con 0x7f41240c93f0 2024-04-01T23:01:48.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.282+0000 7f4129125640 1 -- 172.21.15.47:0/939831617 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4124068210 con 0x7f41240c93f0 2024-04-01T23:01:48.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.301+0000 7f410b7fe640 1 -- 172.21.15.47:0/939831617 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f411803b070 con 0x7f41240c93f0 2024-04-01T23:01:48.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.301+0000 7f410b7fe640 1 --2- 172.21.15.47:0/939831617 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f411006b9e0 0x7f411006dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:48.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.301+0000 7f412259c640 1 --2- 172.21.15.47:0/939831617 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f411006b9e0 0x7f411006dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:48.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.302+0000 7f412259c640 1 --2- 172.21.15.47:0/939831617 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f411006b9e0 0x7f411006dea0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f41240c7b40 tx=0x7f4114009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:48.358 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T23:01:48.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.536+0000 7f410b7fe640 1 -- 172.21.15.47:0/939831617 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f4118078b40 con 0x7f41240c93f0 2024-04-01T23:01:48.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.548+0000 7f410b7fe640 1 -- 172.21.15.47:0/939831617 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f4118030070 con 0x7f41240c93f0 2024-04-01T23:01:48.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.731+0000 7f4129125640 1 -- 172.21.15.47:0/939831617 --> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f41240c3d60 con 0x7f411006b9e0 2024-04-01T23:01:48.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.731+0000 7f410b7fe640 1 -- 172.21.15.47:0/939831617 <== mgr.4107 v2:172.21.15.47:6800/1257047371 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f41240c3d60 con 0x7f411006b9e0 2024-04-01T23:01:48.727 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 7 to deep-scrub 2024-04-01T23:01:48.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.733+0000 7f4129125640 1 -- 172.21.15.47:0/939831617 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f411006b9e0 msgr2=0x7f411006dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:48.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.733+0000 7f4129125640 1 --2- 172.21.15.47:0/939831617 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f411006b9e0 0x7f411006dea0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f41240c7b40 tx=0x7f4114009060 comp rx=0 tx=0).stop 2024-04-01T23:01:48.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.733+0000 7f4129125640 1 -- 172.21.15.47:0/939831617 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f41240c93f0 msgr2=0x7f41240c3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:48.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.733+0000 7f4129125640 1 --2- 172.21.15.47:0/939831617 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f41240c93f0 0x7f41240c3820 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4118033000 tx=0x7f41180046c0 comp rx=0 tx=0).stop 2024-04-01T23:01:48.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.734+0000 7f4129125640 1 -- 172.21.15.47:0/939831617 shutdown_connections 2024-04-01T23:01:48.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.734+0000 7f4129125640 1 --2- 172.21.15.47:0/939831617 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f411006b9e0 0x7f411006dea0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:48.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.734+0000 7f4129125640 1 --2- 172.21.15.47:0/939831617 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f412415afc0 0x7f41241e2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:48.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.734+0000 7f4129125640 1 --2- 172.21.15.47:0/939831617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41240cc0d0 0x7f4124154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:48.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.734+0000 7f4129125640 1 --2- 172.21.15.47:0/939831617 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f41240c93f0 0x7f41240c3820 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:48.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.734+0000 7f4129125640 1 -- 172.21.15.47:0/939831617 >> 172.21.15.47:0/939831617 conn(0x7f41240cfdb0 msgr2=0x7f41240d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:48.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.734+0000 7f4129125640 1 -- 172.21.15.47:0/939831617 shutdown_connections 2024-04-01T23:01:48.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.734+0000 7f4129125640 1 -- 172.21.15.47:0/939831617 wait complete. 2024-04-01T23:01:48.741 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T23:01:48.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.847+0000 7fb821678640 1 Processor -- start 2024-04-01T23:01:48.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.847+0000 7fb821678640 1 -- start start 2024-04-01T23:01:48.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.848+0000 7fb821678640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb81c06c290 0x7fb81c15a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:48.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.848+0000 7fb821678640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb81c0cb650 0x7fb81c06c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:48.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.848+0000 7fb821678640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb81c0cab50 con 0x7fb81c0cbd30 2024-04-01T23:01:48.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.848+0000 7fb821678640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fb81c0cb1c0 con 0x7fb81c0cb650 2024-04-01T23:01:48.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.848+0000 7fb821678640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb81c0cba70 con 0x7fb81c06c290 2024-04-01T23:01:48.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.848+0000 7fb81a7fc640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb81c0cb650 0x7fb81c06c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:48.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.849+0000 7fb81affd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb81c06c290 0x7fb81c15a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:48.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.849+0000 7fb81b7fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fb81c0cbd30 0x7fb81c0ca440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.47:56618/0 (socket says 172.21.15.47:56618) 2024-04-01T23:01:48.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.849+0000 7fb81b7fe640 1 -- 172.21.15.47:0/1886786076 learned_addr learned my addr 172.21.15.47:0/1886786076 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T23:01:48.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.851+0000 7fb81a7fc640 1 -- 172.21.15.47:0/1886786076 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb81c06c290 msgr2=0x7fb81c15a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:01:48.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.851+0000 7fb81a7fc640 1 --2- 172.21.15.47:0/1886786076 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb81c06c290 0x7fb81c15a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:48.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.851+0000 7fb81a7fc640 1 -- 172.21.15.47:0/1886786076 >> v1:172.21.15.181:6789/0 conn(0x7fb81c0cbd30 legacy=0x7fb81c0ca440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:48.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.851+0000 7fb81a7fc640 1 -- 172.21.15.47:0/1886786076 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb81c0cce10 con 0x7fb81c0cb650 2024-04-01T23:01:48.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.854+0000 7fb81a7fc640 1 --2- 172.21.15.47:0/1886786076 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb81c0cb650 0x7fb81c06c670 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb8040097a0 tx=0x7fb80402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=895be8603c7ca430 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:48.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.858+0000 7fb819ffb640 1 -- 172.21.15.47:0/1886786076 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb804034070 con 0x7fb81c0cb650 2024-04-01T23:01:48.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.858+0000 7fb819ffb640 1 -- 172.21.15.47:0/1886786076 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb804030610 con 0x7fb81c0cb650 2024-04-01T23:01:48.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.858+0000 7fb819ffb640 1 -- 172.21.15.47:0/1886786076 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8040309e0 con 0x7fb81c0cb650 2024-04-01T23:01:48.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.859+0000 7fb821678640 1 -- 172.21.15.47:0/1886786076 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb81c0cb650 msgr2=0x7fb81c06c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:48.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.859+0000 7fb821678640 1 --2- 172.21.15.47:0/1886786076 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb81c0cb650 0x7fb81c06c670 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb8040097a0 tx=0x7fb80402b960 comp rx=0 tx=0).stop 2024-04-01T23:01:48.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.859+0000 7fb821678640 1 -- 172.21.15.47:0/1886786076 shutdown_connections 2024-04-01T23:01:48.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.859+0000 7fb821678640 1 --2- 172.21.15.47:0/1886786076 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb81c0cb650 0x7fb81c06c670 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:48.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.859+0000 7fb821678640 1 --2- 172.21.15.47:0/1886786076 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb81c06c290 0x7fb81c15a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:48.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.859+0000 7fb821678640 1 -- 172.21.15.47:0/1886786076 >> 172.21.15.47:0/1886786076 conn(0x7fb81c0b15f0 msgr2=0x7fb81c0b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:48.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.859+0000 7fb821678640 1 -- 172.21.15.47:0/1886786076 shutdown_connections 2024-04-01T23:01:48.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.859+0000 7fb821678640 1 -- 172.21.15.47:0/1886786076 wait complete. 2024-04-01T23:01:48.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.860+0000 7fb821678640 1 Processor -- start 2024-04-01T23:01:48.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.860+0000 7fb821678640 1 -- start start 2024-04-01T23:01:48.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.861+0000 7fb821678640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb81c06c290 0x7fb81c1559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:48.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.861+0000 7fb821678640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb81c0cb650 0x7fb81c1565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:48.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.861+0000 7fb821678640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb81c0cbd30 0x7fb81c156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:48.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.861+0000 7fb821678640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb81c0ccb30 con 0x7fb81c0cbd30 2024-04-01T23:01:48.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.861+0000 7fb821678640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb81c0cc850 con 0x7fb81c0cb650 2024-04-01T23:01:48.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.861+0000 7fb821678640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fb81c0cae50 con 0x7fb81c06c290 2024-04-01T23:01:48.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.861+0000 7fb81b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb81c0cbd30 0x7fb81c156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:48.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.861+0000 7fb81a7fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb81c0cb650 0x7fb81c1565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:48.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.861+0000 7fb81affd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb81c06c290 0x7fb81c1559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:48.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.862+0000 7fb81b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb81c0cbd30 0x7fb81c156b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53424/0 (socket says 172.21.15.47:53424) 2024-04-01T23:01:48.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.862+0000 7fb81b7fe640 1 -- 172.21.15.47:0/2294875234 learned_addr learned my addr 172.21.15.47:0/2294875234 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:01:48.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.865+0000 7fb81b7fe640 1 -- 172.21.15.47:0/2294875234 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb81c06c290 msgr2=0x7fb81c1559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:48.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.865+0000 7fb81b7fe640 1 --2- 172.21.15.47:0/2294875234 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb81c06c290 0x7fb81c1559d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:48.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.865+0000 7fb81b7fe640 1 -- 172.21.15.47:0/2294875234 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb81c0cb650 msgr2=0x7fb81c1565d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:48.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.865+0000 7fb81b7fe640 1 --2- 172.21.15.47:0/2294875234 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb81c0cb650 0x7fb81c1565d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:48.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.865+0000 7fb81b7fe640 1 -- 172.21.15.47:0/2294875234 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb81c0b2ea0 con 0x7fb81c0cbd30 2024-04-01T23:01:48.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.867+0000 7fb81b7fe640 1 --2- 172.21.15.47:0/2294875234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb81c0cbd30 0x7fb81c156b10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb81400cbc0 tx=0x7fb81400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:48.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.871+0000 7fb8137fe640 1 -- 172.21.15.47:0/2294875234 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb814017070 con 0x7fb81c0cbd30 2024-04-01T23:01:48.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.871+0000 7fb8137fe640 1 -- 172.21.15.47:0/2294875234 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb81400ad40 con 0x7fb81c0cbd30 2024-04-01T23:01:48.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.871+0000 7fb8137fe640 1 -- 172.21.15.47:0/2294875234 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb814012600 con 0x7fb81c0cbd30 2024-04-01T23:01:48.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.871+0000 7fb821678640 1 -- 172.21.15.47:0/2294875234 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb81c1f0f30 con 0x7fb81c0cbd30 2024-04-01T23:01:48.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.871+0000 7fb821678640 1 -- 172.21.15.47:0/2294875234 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb81c0b52f0 con 0x7fb81c0cbd30 2024-04-01T23:01:48.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:48.872+0000 7fb821678640 1 -- 172.21.15.47:0/2294875234 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb81c1592e0 con 0x7fb81c0cbd30 2024-04-01T23:01:49.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:49.204+0000 7fb8137fe640 1 -- 172.21.15.47:0/2294875234 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7fb81401a070 con 0x7fb81c0cbd30 2024-04-01T23:01:49.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:49.204+0000 7fb8137fe640 1 --2- 172.21.15.47:0/2294875234 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fb7fc06b990 0x7fb7fc06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:01:49.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:49.205+0000 7fb81affd640 1 --2- 172.21.15.47:0/2294875234 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fb7fc06b990 0x7fb7fc06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:01:49.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:49.205+0000 7fb81affd640 1 --2- 172.21.15.47:0/2294875234 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fb7fc06b990 0x7fb7fc06de50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb80c009aa0 tx=0x7fb80c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:01:49.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:49.231+0000 7fb8137fe640 1 -- 172.21.15.47:0/2294875234 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fb814057110 con 0x7fb81c0cbd30 2024-04-01T23:01:49.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:49.231+0000 7fb8137fe640 1 -- 172.21.15.47:0/2294875234 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fb81c1592e0 con 0x7fb81c0cbd30 2024-04-01T23:01:49.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:49.427+0000 7fb821678640 1 -- 172.21.15.47:0/2294875234 --> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb81c068210 con 0x7fb7fc06b990 2024-04-01T23:01:49.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:49.434+0000 7fb8137fe640 1 -- 172.21.15.47:0/2294875234 <== mgr.4107 v2:172.21.15.47:6800/1257047371 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+330793 (secure 0 0 0) 0x7fb81c068210 con 0x7fb7fc06b990 2024-04-01T23:01:49.434 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T23:01:49.436 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-01T23:01:49.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:49.438+0000 7fb821678640 1 -- 172.21.15.47:0/2294875234 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fb7fc06b990 msgr2=0x7fb7fc06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:49.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:49.438+0000 7fb821678640 1 --2- 172.21.15.47:0/2294875234 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fb7fc06b990 0x7fb7fc06de50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb80c009aa0 tx=0x7fb80c009190 comp rx=0 tx=0).stop 2024-04-01T23:01:49.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:49.438+0000 7fb821678640 1 -- 172.21.15.47:0/2294875234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb81c0cbd30 msgr2=0x7fb81c156b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:01:49.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:49.438+0000 7fb821678640 1 --2- 172.21.15.47:0/2294875234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb81c0cbd30 0x7fb81c156b10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb81400cbc0 tx=0x7fb81400a430 comp rx=0 tx=0).stop 2024-04-01T23:01:49.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:49.438+0000 7fb821678640 1 -- 172.21.15.47:0/2294875234 shutdown_connections 2024-04-01T23:01:49.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:49.438+0000 7fb821678640 1 --2- 172.21.15.47:0/2294875234 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fb7fc06b990 0x7fb7fc06de50 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:49.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:49.438+0000 7fb821678640 1 --2- 172.21.15.47:0/2294875234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb81c0cbd30 0x7fb81c156b10 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:49.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:49.438+0000 7fb821678640 1 --2- 172.21.15.47:0/2294875234 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb81c0cb650 0x7fb81c1565d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:49.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:49.438+0000 7fb821678640 1 --2- 172.21.15.47:0/2294875234 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fb81c06c290 0x7fb81c1559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:01:49.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:49.438+0000 7fb821678640 1 -- 172.21.15.47:0/2294875234 >> 172.21.15.47:0/2294875234 conn(0x7fb81c0b15f0 msgr2=0x7fb81c0b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:01:49.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:49.438+0000 7fb821678640 1 -- 172.21.15.47:0/2294875234 shutdown_connections 2024-04-01T23:01:49.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:01:49.438+0000 7fb821678640 1 -- 172.21.15.47:0/2294875234 wait complete. 2024-04-01T23:01:49.447 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":880,"stamp":"2024-04-01T23:01:49.140846+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":37236956,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":932,"num_read_kb":976,"num_write":13954,"num_write_kb":334382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14573,"ondisk_log_size":14573,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":361328,"kb_used_data":49456,"kb_used_omap":12,"kb_used_meta":311795,"kb_avail":754613392,"statfs":{"total":773094113280,"available":772724113408,"internally_reserved":0,"allocated":50642944,"data_stored":75426104,"data_compressed":7309368,"data_compressed_allocated":11001856,"data_compressed_original":37232640,"omap_allocated":12751,"internal_metadata":319278641},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1986,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002454"},"pg_stats":[{"pgid":"2.1f","version":"27'644","reported_seq":692,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:44.760747+0000","last_change":"2024-04-01T23:01:44.760798+0000","last_active":"2024-04-01T23:01:44.760747+0000","last_peered":"2024-04-01T23:01:44.760747+0000","last_clean":"2024-04-01T23:01:44.760747+0000","last_became_active":"2024-04-01T22:33:26.849009+0000","last_became_peered":"2024-04-01T22:33:26.849009+0000","last_unstale":"2024-04-01T23:01:44.760747+0000","last_undegraded":"2024-04-01T23:01:44.760747+0000","last_fullsized":"2024-04-01T23:01:44.760747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'644","last_scrub_stamp":"2024-04-01T23:01:44.760645+0000","last_deep_scrub":"27'644","last_deep_scrub_stamp":"2024-04-01T23:01:44.760645+0000","last_clean_scrub_stamp":"2024-04-01T23:01:44.760645+0000","objects_scrubbed":3,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:46:30.270552+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":638,"num_write_kb":4397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'23","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.707547+0000","last_change":"2024-04-01T22:33:27.919006+0000","last_active":"2024-04-01T23:01:32.707547+0000","last_peered":"2024-04-01T23:01:32.707547+0000","last_clean":"2024-04-01T23:01:32.707547+0000","last_became_active":"2024-04-01T22:33:27.918702+0000","last_became_peered":"2024-04-01T22:33:27.918702+0000","last_unstale":"2024-04-01T23:01:32.707547+0000","last_undegraded":"2024-04-01T23:01:32.707547+0000","last_fullsized":"2024-04-01T23:01:32.707547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'149","reported_seq":179,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:59.650334+0000","last_change":"2024-04-01T22:33:33.255162+0000","last_active":"2024-04-01T23:00:59.650334+0000","last_peered":"2024-04-01T23:00:59.650334+0000","last_clean":"2024-04-01T23:00:59.650334+0000","last_became_active":"2024-04-01T22:33:33.254187+0000","last_became_peered":"2024-04-01T22:33:33.254187+0000","last_unstale":"2024-04-01T23:00:59.650334+0000","last_undegraded":"2024-04-01T23:00:59.650334+0000","last_fullsized":"2024-04-01T23:00:59.650334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":7671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'717","reported_seq":758,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.405533+0000","last_change":"2024-04-01T22:33:26.855377+0000","last_active":"2024-04-01T23:01:32.405533+0000","last_peered":"2024-04-01T23:01:32.405533+0000","last_clean":"2024-04-01T23:01:32.405533+0000","last_became_active":"2024-04-01T22:33:26.855119+0000","last_became_peered":"2024-04-01T22:33:26.855119+0000","last_unstale":"2024-04-01T23:01:32.405533+0000","last_undegraded":"2024-04-01T23:01:32.405533+0000","last_fullsized":"2024-04-01T23:01:32.405533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":714,"num_write_kb":4525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'35","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.807790+0000","last_change":"2024-04-01T22:33:27.974175+0000","last_active":"2024-04-01T23:01:32.807790+0000","last_peered":"2024-04-01T23:01:32.807790+0000","last_clean":"2024-04-01T23:01:32.807790+0000","last_became_active":"2024-04-01T22:33:27.973915+0000","last_became_peered":"2024-04-01T22:33:27.973915+0000","last_unstale":"2024-04-01T23:01:32.807790+0000","last_undegraded":"2024-04-01T23:01:32.807790+0000","last_fullsized":"2024-04-01T23:01:32.807790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'127","reported_seq":157,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:00.686982+0000","last_change":"2024-04-01T22:33:32.853556+0000","last_active":"2024-04-01T23:01:00.686982+0000","last_peered":"2024-04-01T23:01:00.686982+0000","last_clean":"2024-04-01T23:01:00.686982+0000","last_became_active":"2024-04-01T22:33:32.853215+0000","last_became_peered":"2024-04-01T22:33:32.853215+0000","last_unstale":"2024-04-01T23:01:00.686982+0000","last_undegraded":"2024-04-01T23:01:00.686982+0000","last_fullsized":"2024-04-01T23:01:00.686982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":8638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'1188","reported_seq":1225,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:22.425341+0000","last_change":"2024-04-01T22:33:26.849967+0000","last_active":"2024-04-01T23:01:22.425341+0000","last_peered":"2024-04-01T23:01:22.425341+0000","last_clean":"2024-04-01T23:01:22.425341+0000","last_became_active":"2024-04-01T22:33:26.849432+0000","last_became_peered":"2024-04-01T22:33:26.849432+0000","last_unstale":"2024-04-01T23:01:22.425341+0000","last_undegraded":"2024-04-01T23:01:22.425341+0000","last_fullsized":"2024-04-01T23:01:22.425341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":1188,"log_dups_size":0,"ondisk_log_size":1188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:47:18.407469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1179,"num_write_kb":8891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'25","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:37.272648+0000","last_change":"2024-04-01T22:34:05.289795+0000","last_active":"2024-04-01T23:01:37.272648+0000","last_peered":"2024-04-01T23:01:37.272648+0000","last_clean":"2024-04-01T23:01:37.272648+0000","last_became_active":"2024-04-01T22:34:05.289454+0000","last_became_peered":"2024-04-01T22:34:05.289454+0000","last_unstale":"2024-04-01T23:01:37.272648+0000","last_undegraded":"2024-04-01T23:01:37.272648+0000","last_fullsized":"2024-04-01T23:01:37.272648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"27'122","reported_seq":152,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:02.340628+0000","last_change":"2024-04-01T22:33:32.847230+0000","last_active":"2024-04-01T23:01:02.340628+0000","last_peered":"2024-04-01T23:01:02.340628+0000","last_clean":"2024-04-01T23:01:02.340628+0000","last_became_active":"2024-04-01T22:33:32.846382+0000","last_became_peered":"2024-04-01T22:33:32.846382+0000","last_unstale":"2024-04-01T23:01:02.340628+0000","last_undegraded":"2024-04-01T23:01:02.340628+0000","last_fullsized":"2024-04-01T23:01:02.340628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":10048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'7","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:16.444748+0000","last_change":"2024-04-01T22:33:26.852784+0000","last_active":"2024-04-01T23:01:16.444748+0000","last_peered":"2024-04-01T23:01:16.444748+0000","last_clean":"2024-04-01T23:01:16.444748+0000","last_became_active":"2024-04-01T22:33:26.852530+0000","last_became_peered":"2024-04-01T22:33:26.852530+0000","last_unstale":"2024-04-01T23:01:16.444748+0000","last_undegraded":"2024-04-01T23:01:16.444748+0000","last_fullsized":"2024-04-01T23:01:16.444748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:39:29.846272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'45","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.685563+0000","last_change":"2024-04-01T22:33:27.974358+0000","last_active":"2024-04-01T23:01:32.685563+0000","last_peered":"2024-04-01T23:01:32.685563+0000","last_clean":"2024-04-01T23:01:32.685563+0000","last_became_active":"2024-04-01T22:33:27.974117+0000","last_became_peered":"2024-04-01T22:33:27.974117+0000","last_unstale":"2024-04-01T23:01:32.685563+0000","last_undegraded":"2024-04-01T23:01:32.685563+0000","last_fullsized":"2024-04-01T23:01:32.685563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'133","reported_seq":163,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:02.340581+0000","last_change":"2024-04-01T22:33:32.844681+0000","last_active":"2024-04-01T23:01:02.340581+0000","last_peered":"2024-04-01T23:01:02.340581+0000","last_clean":"2024-04-01T23:01:02.340581+0000","last_became_active":"2024-04-01T22:33:32.844334+0000","last_became_peered":"2024-04-01T22:33:32.844334+0000","last_unstale":"2024-04-01T23:01:02.340581+0000","last_undegraded":"2024-04-01T23:01:02.340581+0000","last_fullsized":"2024-04-01T23:01:02.340581+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":7546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'27","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.682016+0000","last_change":"2024-04-01T22:33:27.918822+0000","last_active":"2024-04-01T23:01:32.682016+0000","last_peered":"2024-04-01T23:01:32.682016+0000","last_clean":"2024-04-01T23:01:32.682016+0000","last_became_active":"2024-04-01T22:33:27.918466+0000","last_became_peered":"2024-04-01T22:33:27.918466+0000","last_unstale":"2024-04-01T23:01:32.682016+0000","last_undegraded":"2024-04-01T23:01:32.682016+0000","last_fullsized":"2024-04-01T23:01:32.682016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:43:57.121738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'506","reported_seq":544,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:09.155923+0000","last_change":"2024-04-01T22:33:26.850443+0000","last_active":"2024-04-01T23:01:09.155923+0000","last_peered":"2024-04-01T23:01:09.155923+0000","last_clean":"2024-04-01T23:01:09.155923+0000","last_became_active":"2024-04-01T22:33:26.849954+0000","last_became_peered":"2024-04-01T22:33:26.849954+0000","last_unstale":"2024-04-01T23:01:09.155923+0000","last_undegraded":"2024-04-01T23:01:09.155923+0000","last_fullsized":"2024-04-01T23:01:09.155923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:49:51.408086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":502,"num_write_kb":4355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'101","reported_seq":132,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.933392+0000","last_change":"2024-04-01T22:33:32.853569+0000","last_active":"2024-04-01T23:00:58.933392+0000","last_peered":"2024-04-01T23:00:58.933392+0000","last_clean":"2024-04-01T23:00:58.933392+0000","last_became_active":"2024-04-01T22:33:32.853185+0000","last_became_peered":"2024-04-01T22:33:32.853185+0000","last_unstale":"2024-04-01T23:00:58.933392+0000","last_undegraded":"2024-04-01T23:00:58.933392+0000","last_fullsized":"2024-04-01T23:00:58.933392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":9107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'34","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:47.222116+0000","last_change":"2024-04-01T23:01:47.222139+0000","last_active":"2024-04-01T23:01:47.222116+0000","last_peered":"2024-04-01T23:01:47.222116+0000","last_clean":"2024-04-01T23:01:47.222116+0000","last_became_active":"2024-04-01T22:33:27.949518+0000","last_became_peered":"2024-04-01T22:33:27.949518+0000","last_unstale":"2024-04-01T23:01:47.222116+0000","last_undegraded":"2024-04-01T23:01:47.222116+0000","last_fullsized":"2024-04-01T23:01:47.222116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'34","last_scrub_stamp":"2024-04-01T23:01:47.222046+0000","last_deep_scrub":"27'34","last_deep_scrub_stamp":"2024-04-01T23:01:47.222046+0000","last_clean_scrub_stamp":"2024-04-01T23:01:47.222046+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:18:45.782553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'2","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:37.506102+0000","last_change":"2024-04-01T22:33:26.856856+0000","last_active":"2024-04-01T23:01:37.506102+0000","last_peered":"2024-04-01T23:01:37.506102+0000","last_clean":"2024-04-01T23:01:37.506102+0000","last_became_active":"2024-04-01T22:33:26.856591+0000","last_became_peered":"2024-04-01T22:33:26.856591+0000","last_unstale":"2024-04-01T23:01:37.506102+0000","last_undegraded":"2024-04-01T23:01:37.506102+0000","last_fullsized":"2024-04-01T23:01:37.506102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'141","reported_seq":172,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:55.231853+0000","last_change":"2024-04-01T22:33:32.847352+0000","last_active":"2024-04-01T23:00:55.231853+0000","last_peered":"2024-04-01T23:00:55.231853+0000","last_clean":"2024-04-01T23:00:55.231853+0000","last_became_active":"2024-04-01T22:33:32.846849+0000","last_became_peered":"2024-04-01T22:33:32.846849+0000","last_unstale":"2024-04-01T23:00:55.231853+0000","last_undegraded":"2024-04-01T23:00:55.231853+0000","last_fullsized":"2024-04-01T23:00:55.231853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":7884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'32","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:37.405925+0000","last_change":"2024-04-01T22:33:27.855387+0000","last_active":"2024-04-01T23:01:37.405925+0000","last_peered":"2024-04-01T23:01:37.405925+0000","last_clean":"2024-04-01T23:01:37.405925+0000","last_became_active":"2024-04-01T22:33:27.855123+0000","last_became_peered":"2024-04-01T22:33:27.855123+0000","last_unstale":"2024-04-01T23:01:37.405925+0000","last_undegraded":"2024-04-01T23:01:37.405925+0000","last_fullsized":"2024-04-01T23:01:37.405925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'1","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:46.484865+0000","last_change":"2024-04-01T23:01:46.484889+0000","last_active":"2024-04-01T23:01:46.484865+0000","last_peered":"2024-04-01T23:01:46.484865+0000","last_clean":"2024-04-01T23:01:46.484865+0000","last_became_active":"2024-04-01T22:33:26.847904+0000","last_became_peered":"2024-04-01T22:33:26.847904+0000","last_unstale":"2024-04-01T23:01:46.484865+0000","last_undegraded":"2024-04-01T23:01:46.484865+0000","last_fullsized":"2024-04-01T23:01:46.484865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2024-04-01T23:01:46.484795+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2024-04-01T23:01:46.484795+0000","last_clean_scrub_stamp":"2024-04-01T23:01:46.484795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:36:04.466738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'122","reported_seq":147,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:12.270910+0000","last_change":"2024-04-01T22:34:05.290215+0000","last_active":"2024-04-01T23:01:12.270910+0000","last_peered":"2024-04-01T23:01:12.270910+0000","last_clean":"2024-04-01T23:01:12.270910+0000","last_became_active":"2024-04-01T22:34:05.289769+0000","last_became_peered":"2024-04-01T22:34:05.289769+0000","last_unstale":"2024-04-01T23:01:12.270910+0000","last_undegraded":"2024-04-01T23:01:12.270910+0000","last_fullsized":"2024-04-01T23:01:12.270910+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":7582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,7],"acting":[2,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"27'32","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:37.344179+0000","last_change":"2024-04-01T22:33:27.868997+0000","last_active":"2024-04-01T23:01:37.344179+0000","last_peered":"2024-04-01T23:01:37.344179+0000","last_clean":"2024-04-01T23:01:37.344179+0000","last_became_active":"2024-04-01T22:33:27.868713+0000","last_became_peered":"2024-04-01T22:33:27.868713+0000","last_unstale":"2024-04-01T23:01:37.344179+0000","last_undegraded":"2024-04-01T23:01:37.344179+0000","last_fullsized":"2024-04-01T23:01:37.344179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'5","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:25.553755+0000","last_change":"2024-04-01T22:33:26.848037+0000","last_active":"2024-04-01T23:01:25.553755+0000","last_peered":"2024-04-01T23:01:25.553755+0000","last_clean":"2024-04-01T23:01:25.553755+0000","last_became_active":"2024-04-01T22:33:26.847736+0000","last_became_peered":"2024-04-01T22:33:26.847736+0000","last_unstale":"2024-04-01T23:01:25.553755+0000","last_undegraded":"2024-04-01T23:01:25.553755+0000","last_fullsized":"2024-04-01T23:01:25.553755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:56:04.675231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'108","reported_seq":139,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:00.660427+0000","last_change":"2024-04-01T22:33:32.847015+0000","last_active":"2024-04-01T23:01:00.660427+0000","last_peered":"2024-04-01T23:01:00.660427+0000","last_clean":"2024-04-01T23:01:00.660427+0000","last_became_active":"2024-04-01T22:33:32.846639+0000","last_became_peered":"2024-04-01T22:33:32.846639+0000","last_unstale":"2024-04-01T23:01:00.660427+0000","last_undegraded":"2024-04-01T23:01:00.660427+0000","last_fullsized":"2024-04-01T23:01:00.660427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":8005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'39","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:46.748393+0000","last_change":"2024-04-01T23:01:46.748431+0000","last_active":"2024-04-01T23:01:46.748393+0000","last_peered":"2024-04-01T23:01:46.748393+0000","last_clean":"2024-04-01T23:01:46.748393+0000","last_became_active":"2024-04-01T22:33:27.947735+0000","last_became_peered":"2024-04-01T22:33:27.947735+0000","last_unstale":"2024-04-01T23:01:46.748393+0000","last_undegraded":"2024-04-01T23:01:46.748393+0000","last_fullsized":"2024-04-01T23:01:46.748393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2024-04-01T23:01:46.748288+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2024-04-01T23:01:46.748288+0000","last_clean_scrub_stamp":"2024-04-01T23:01:46.748288+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:39:37.652214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'9","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:26.524501+0000","last_change":"2024-04-01T22:33:26.849404+0000","last_active":"2024-04-01T23:01:26.524501+0000","last_peered":"2024-04-01T23:01:26.524501+0000","last_clean":"2024-04-01T23:01:26.524501+0000","last_became_active":"2024-04-01T22:33:26.849086+0000","last_became_peered":"2024-04-01T22:33:26.849086+0000","last_unstale":"2024-04-01T23:01:26.524501+0000","last_undegraded":"2024-04-01T23:01:26.524501+0000","last_fullsized":"2024-04-01T23:01:26.524501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:41:58.838710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'117","reported_seq":149,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:59.623390+0000","last_change":"2024-04-01T22:33:33.249726+0000","last_active":"2024-04-01T23:00:59.623390+0000","last_peered":"2024-04-01T23:00:59.623390+0000","last_clean":"2024-04-01T23:00:59.623390+0000","last_became_active":"2024-04-01T22:33:33.249309+0000","last_became_peered":"2024-04-01T22:33:33.249309+0000","last_unstale":"2024-04-01T23:00:59.623390+0000","last_undegraded":"2024-04-01T23:00:59.623390+0000","last_fullsized":"2024-04-01T23:00:59.623390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":13518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'31","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:37.405979+0000","last_change":"2024-04-01T22:33:27.879797+0000","last_active":"2024-04-01T23:01:37.405979+0000","last_peered":"2024-04-01T23:01:37.405979+0000","last_clean":"2024-04-01T23:01:37.405979+0000","last_became_active":"2024-04-01T22:33:27.879582+0000","last_became_peered":"2024-04-01T22:33:27.879582+0000","last_unstale":"2024-04-01T23:01:37.405979+0000","last_undegraded":"2024-04-01T23:01:37.405979+0000","last_fullsized":"2024-04-01T23:01:37.405979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'1318","reported_seq":1366,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:45.512098+0000","last_change":"2024-04-01T23:01:45.512123+0000","last_active":"2024-04-01T23:01:45.512098+0000","last_peered":"2024-04-01T23:01:45.512098+0000","last_clean":"2024-04-01T23:01:45.512098+0000","last_became_active":"2024-04-01T22:33:26.847333+0000","last_became_peered":"2024-04-01T22:33:26.847333+0000","last_unstale":"2024-04-01T23:01:45.512098+0000","last_undegraded":"2024-04-01T23:01:45.512098+0000","last_fullsized":"2024-04-01T23:01:45.512098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1318","last_scrub_stamp":"2024-04-01T23:01:45.512035+0000","last_deep_scrub":"27'1318","last_deep_scrub_stamp":"2024-04-01T23:01:45.512035+0000","last_clean_scrub_stamp":"2024-04-01T23:01:45.512035+0000","objects_scrubbed":1,"log_size":1318,"log_dups_size":0,"ondisk_log_size":1318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:46:31.021942+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3324,"num_write_kb":1182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'132","reported_seq":165,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:37.405899+0000","last_change":"2024-04-01T22:33:33.255030+0000","last_active":"2024-04-01T23:01:37.405899+0000","last_peered":"2024-04-01T23:01:37.405899+0000","last_clean":"2024-04-01T23:01:37.405899+0000","last_became_active":"2024-04-01T22:33:33.254621+0000","last_became_peered":"2024-04-01T22:33:33.254621+0000","last_unstale":"2024-04-01T23:01:37.405899+0000","last_undegraded":"2024-04-01T23:01:37.405899+0000","last_fullsized":"2024-04-01T23:01:37.405899+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":7706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'30","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.628398+0000","last_change":"2024-04-01T22:33:27.855669+0000","last_active":"2024-04-01T23:01:32.628398+0000","last_peered":"2024-04-01T23:01:32.628398+0000","last_clean":"2024-04-01T23:01:32.628398+0000","last_became_active":"2024-04-01T22:33:27.855419+0000","last_became_peered":"2024-04-01T22:33:27.855419+0000","last_unstale":"2024-04-01T23:01:32.628398+0000","last_undegraded":"2024-04-01T23:01:32.628398+0000","last_fullsized":"2024-04-01T23:01:32.628398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:20.447485+0000","last_change":"2024-04-01T22:33:26.850176+0000","last_active":"2024-04-01T23:01:20.447485+0000","last_peered":"2024-04-01T23:01:20.447485+0000","last_clean":"2024-04-01T23:01:20.447485+0000","last_became_active":"2024-04-01T22:33:26.849717+0000","last_became_peered":"2024-04-01T22:33:26.849717+0000","last_unstale":"2024-04-01T23:01:20.447485+0000","last_undegraded":"2024-04-01T23:01:20.447485+0000","last_fullsized":"2024-04-01T23:01:20.447485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:18:55.842886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'123","reported_seq":155,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.513542+0000","last_change":"2024-04-01T22:33:33.249765+0000","last_active":"2024-04-01T23:00:58.513542+0000","last_peered":"2024-04-01T23:00:58.513542+0000","last_clean":"2024-04-01T23:00:58.513542+0000","last_became_active":"2024-04-01T22:33:33.249370+0000","last_became_peered":"2024-04-01T22:33:33.249370+0000","last_unstale":"2024-04-01T23:00:58.513542+0000","last_undegraded":"2024-04-01T23:00:58.513542+0000","last_fullsized":"2024-04-01T23:00:58.513542+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":9230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'30","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.682137+0000","last_change":"2024-04-01T22:33:27.979163+0000","last_active":"2024-04-01T23:01:32.682137+0000","last_peered":"2024-04-01T23:01:32.682137+0000","last_clean":"2024-04-01T23:01:32.682137+0000","last_became_active":"2024-04-01T22:33:27.978902+0000","last_became_peered":"2024-04-01T22:33:27.978902+0000","last_unstale":"2024-04-01T23:01:32.682137+0000","last_undegraded":"2024-04-01T23:01:32.682137+0000","last_fullsized":"2024-04-01T23:01:32.682137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'1","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:44.496195+0000","last_change":"2024-04-01T23:01:44.496216+0000","last_active":"2024-04-01T23:01:44.496195+0000","last_peered":"2024-04-01T23:01:44.496195+0000","last_clean":"2024-04-01T23:01:44.496195+0000","last_became_active":"2024-04-01T22:33:26.846265+0000","last_became_peered":"2024-04-01T22:33:26.846265+0000","last_unstale":"2024-04-01T23:01:44.496195+0000","last_undegraded":"2024-04-01T23:01:44.496195+0000","last_fullsized":"2024-04-01T23:01:44.496195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2024-04-01T23:01:44.496119+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2024-04-01T23:01:44.496119+0000","last_clean_scrub_stamp":"2024-04-01T23:01:44.496119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:53:07.929744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'159","reported_seq":191,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:01.899365+0000","last_change":"2024-04-01T22:33:32.850553+0000","last_active":"2024-04-01T23:01:01.899365+0000","last_peered":"2024-04-01T23:01:01.899365+0000","last_clean":"2024-04-01T23:01:01.899365+0000","last_became_active":"2024-04-01T22:33:32.849774+0000","last_became_peered":"2024-04-01T22:33:32.849774+0000","last_unstale":"2024-04-01T23:01:01.899365+0000","last_undegraded":"2024-04-01T23:01:01.899365+0000","last_fullsized":"2024-04-01T23:01:01.899365+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":7876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'30","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.633238+0000","last_change":"2024-04-01T22:33:27.949879+0000","last_active":"2024-04-01T23:01:32.633238+0000","last_peered":"2024-04-01T23:01:32.633238+0000","last_clean":"2024-04-01T23:01:32.633238+0000","last_became_active":"2024-04-01T22:33:27.949620+0000","last_became_peered":"2024-04-01T22:33:27.949620+0000","last_unstale":"2024-04-01T23:01:32.633238+0000","last_undegraded":"2024-04-01T23:01:32.633238+0000","last_fullsized":"2024-04-01T23:01:32.633238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'4","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:25.542116+0000","last_change":"2024-04-01T22:33:26.846346+0000","last_active":"2024-04-01T23:01:25.542116+0000","last_peered":"2024-04-01T23:01:25.542116+0000","last_clean":"2024-04-01T23:01:25.542116+0000","last_became_active":"2024-04-01T22:33:26.846052+0000","last_became_peered":"2024-04-01T22:33:26.846052+0000","last_unstale":"2024-04-01T23:01:25.542116+0000","last_undegraded":"2024-04-01T23:01:25.542116+0000","last_fullsized":"2024-04-01T23:01:25.542116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'111","reported_seq":143,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:01.899270+0000","last_change":"2024-04-01T22:33:32.846766+0000","last_active":"2024-04-01T23:01:01.899270+0000","last_peered":"2024-04-01T23:01:01.899270+0000","last_clean":"2024-04-01T23:01:01.899270+0000","last_became_active":"2024-04-01T22:33:32.846422+0000","last_became_peered":"2024-04-01T22:33:32.846422+0000","last_unstale":"2024-04-01T23:01:01.899270+0000","last_undegraded":"2024-04-01T23:01:01.899270+0000","last_fullsized":"2024-04-01T23:01:01.899270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":8847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'31","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.629740+0000","last_change":"2024-04-01T22:33:27.855299+0000","last_active":"2024-04-01T23:01:32.629740+0000","last_peered":"2024-04-01T23:01:32.629740+0000","last_clean":"2024-04-01T23:01:32.629740+0000","last_became_active":"2024-04-01T22:33:27.855035+0000","last_became_peered":"2024-04-01T22:33:27.855035+0000","last_unstale":"2024-04-01T23:01:32.629740+0000","last_undegraded":"2024-04-01T23:01:32.629740+0000","last_fullsized":"2024-04-01T23:01:32.629740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'821","reported_seq":1677,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:29.535604+0000","last_change":"2024-04-01T22:33:26.856300+0000","last_active":"2024-04-01T23:01:29.535604+0000","last_peered":"2024-04-01T23:01:29.535604+0000","last_clean":"2024-04-01T23:01:29.535604+0000","last_became_active":"2024-04-01T22:33:26.855864+0000","last_became_peered":"2024-04-01T22:33:26.855864+0000","last_unstale":"2024-04-01T23:01:29.535604+0000","last_undegraded":"2024-04-01T23:01:29.535604+0000","last_fullsized":"2024-04-01T23:01:29.535604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":821,"log_dups_size":0,"ondisk_log_size":821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188865,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":816,"num_read_kb":876,"num_write":818,"num_write_kb":878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'133","reported_seq":158,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.935885+0000","last_change":"2024-04-01T22:34:05.317101+0000","last_active":"2024-04-01T23:00:58.935885+0000","last_peered":"2024-04-01T23:00:58.935885+0000","last_clean":"2024-04-01T23:00:58.935885+0000","last_became_active":"2024-04-01T22:34:05.316665+0000","last_became_peered":"2024-04-01T22:34:05.316665+0000","last_unstale":"2024-04-01T23:00:58.935885+0000","last_undegraded":"2024-04-01T23:00:58.935885+0000","last_fullsized":"2024-04-01T23:00:58.935885+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":5930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"27'23","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.807803+0000","last_change":"2024-04-01T22:33:27.949013+0000","last_active":"2024-04-01T23:01:32.807803+0000","last_peered":"2024-04-01T23:01:32.807803+0000","last_clean":"2024-04-01T23:01:32.807803+0000","last_became_active":"2024-04-01T22:33:27.948687+0000","last_became_peered":"2024-04-01T22:33:27.948687+0000","last_unstale":"2024-04-01T23:01:32.807803+0000","last_undegraded":"2024-04-01T23:01:32.807803+0000","last_fullsized":"2024-04-01T23:01:32.807803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'280","reported_seq":320,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.906776+0000","last_change":"2024-04-01T22:33:26.848366+0000","last_active":"2024-04-01T23:01:32.906776+0000","last_peered":"2024-04-01T23:01:32.906776+0000","last_clean":"2024-04-01T23:01:32.906776+0000","last_became_active":"2024-04-01T22:33:26.848019+0000","last_became_peered":"2024-04-01T22:33:26.848019+0000","last_unstale":"2024-04-01T23:01:32.906776+0000","last_undegraded":"2024-04-01T23:01:32.906776+0000","last_fullsized":"2024-04-01T23:01:32.906776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:41:58.838710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2901821,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":275,"num_write_kb":2970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'118","reported_seq":150,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:42.332835+0000","last_change":"2024-04-01T22:33:33.253077+0000","last_active":"2024-04-01T23:01:42.332835+0000","last_peered":"2024-04-01T23:01:42.332835+0000","last_clean":"2024-04-01T23:01:42.332835+0000","last_became_active":"2024-04-01T22:33:33.252725+0000","last_became_peered":"2024-04-01T22:33:33.252725+0000","last_unstale":"2024-04-01T23:01:42.332835+0000","last_undegraded":"2024-04-01T23:01:42.332835+0000","last_fullsized":"2024-04-01T23:01:42.332835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":6978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'30","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.709011+0000","last_change":"2024-04-01T22:33:27.975039+0000","last_active":"2024-04-01T23:01:32.709011+0000","last_peered":"2024-04-01T23:01:32.709011+0000","last_clean":"2024-04-01T23:01:32.709011+0000","last_became_active":"2024-04-01T22:33:27.974751+0000","last_became_peered":"2024-04-01T22:33:27.974751+0000","last_unstale":"2024-04-01T23:01:32.709011+0000","last_undegraded":"2024-04-01T23:01:32.709011+0000","last_fullsized":"2024-04-01T23:01:32.709011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:19.392431+0000","last_change":"2024-04-01T22:33:26.831690+0000","last_active":"2024-04-01T23:01:19.392431+0000","last_peered":"2024-04-01T23:01:19.392431+0000","last_clean":"2024-04-01T23:01:19.392431+0000","last_became_active":"2024-04-01T22:33:26.831398+0000","last_became_peered":"2024-04-01T22:33:26.831398+0000","last_unstale":"2024-04-01T23:01:19.392431+0000","last_undegraded":"2024-04-01T23:01:19.392431+0000","last_fullsized":"2024-04-01T23:01:19.392431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":196,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T22:59:22.388655+0000","last_change":"2024-04-01T22:33:15.962585+0000","last_active":"2024-04-01T22:59:22.388655+0000","last_peered":"2024-04-01T22:59:22.388655+0000","last_clean":"2024-04-01T22:59:22.388655+0000","last_became_active":"2024-04-01T22:33:15.961762+0000","last_became_peered":"2024-04-01T22:33:15.961762+0000","last_unstale":"2024-04-01T22:59:22.388655+0000","last_undegraded":"2024-04-01T22:59:22.388655+0000","last_fullsized":"2024-04-01T22:59:22.388655+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:13.756389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:13.756389+0000","last_clean_scrub_stamp":"2024-04-01T22:33:13.756389+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:33:28.684533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'139","reported_seq":170,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.536776+0000","last_change":"2024-04-01T22:33:33.252863+0000","last_active":"2024-04-01T23:00:58.536776+0000","last_peered":"2024-04-01T23:00:58.536776+0000","last_clean":"2024-04-01T23:00:58.536776+0000","last_became_active":"2024-04-01T22:33:33.252494+0000","last_became_peered":"2024-04-01T22:33:33.252494+0000","last_unstale":"2024-04-01T23:00:58.536776+0000","last_undegraded":"2024-04-01T23:00:58.536776+0000","last_fullsized":"2024-04-01T23:00:58.536776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:47:09.903506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":7634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'31","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.782041+0000","last_change":"2024-04-01T22:34:04.937211+0000","last_active":"2024-04-01T23:01:32.782041+0000","last_peered":"2024-04-01T23:01:32.782041+0000","last_clean":"2024-04-01T23:01:32.782041+0000","last_became_active":"2024-04-01T22:34:04.936886+0000","last_became_peered":"2024-04-01T22:34:04.936886+0000","last_unstale":"2024-04-01T23:01:32.782041+0000","last_undegraded":"2024-04-01T23:01:32.782041+0000","last_fullsized":"2024-04-01T23:01:32.782041+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:53:33.542832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'6","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:45.590249+0000","last_change":"2024-04-01T23:01:45.590269+0000","last_active":"2024-04-01T23:01:45.590249+0000","last_peered":"2024-04-01T23:01:45.590249+0000","last_clean":"2024-04-01T23:01:45.590249+0000","last_became_active":"2024-04-01T22:33:26.832078+0000","last_became_peered":"2024-04-01T22:33:26.832078+0000","last_unstale":"2024-04-01T23:01:45.590249+0000","last_undegraded":"2024-04-01T23:01:45.590249+0000","last_fullsized":"2024-04-01T23:01:45.590249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-01T23:01:45.590183+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-01T23:01:45.590183+0000","last_clean_scrub_stamp":"2024-04-01T23:01:45.590183+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:33:20.860069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'107","reported_seq":138,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.944520+0000","last_change":"2024-04-01T22:33:33.249696+0000","last_active":"2024-04-01T23:00:58.944520+0000","last_peered":"2024-04-01T23:00:58.944520+0000","last_clean":"2024-04-01T23:00:58.944520+0000","last_became_active":"2024-04-01T22:33:33.249313+0000","last_became_peered":"2024-04-01T22:33:33.249313+0000","last_unstale":"2024-04-01T23:00:58.944520+0000","last_undegraded":"2024-04-01T23:00:58.944520+0000","last_fullsized":"2024-04-01T23:00:58.944520+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:39:33.591520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":3624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'31","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.676693+0000","last_change":"2024-04-01T22:33:27.971916+0000","last_active":"2024-04-01T23:01:32.676693+0000","last_peered":"2024-04-01T23:01:32.676693+0000","last_clean":"2024-04-01T23:01:32.676693+0000","last_became_active":"2024-04-01T22:33:27.971672+0000","last_became_peered":"2024-04-01T22:33:27.971672+0000","last_unstale":"2024-04-01T23:01:32.676693+0000","last_undegraded":"2024-04-01T23:01:32.676693+0000","last_fullsized":"2024-04-01T23:01:32.676693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'3","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:47.487584+0000","last_change":"2024-04-01T23:01:47.487617+0000","last_active":"2024-04-01T23:01:47.487584+0000","last_peered":"2024-04-01T23:01:47.487584+0000","last_clean":"2024-04-01T23:01:47.487584+0000","last_became_active":"2024-04-01T22:33:26.849098+0000","last_became_peered":"2024-04-01T22:33:26.849098+0000","last_unstale":"2024-04-01T23:01:47.487584+0000","last_undegraded":"2024-04-01T23:01:47.487584+0000","last_fullsized":"2024-04-01T23:01:47.487584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-01T23:01:47.487508+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-01T23:01:47.487508+0000","last_clean_scrub_stamp":"2024-04-01T23:01:47.487508+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:03:16.063474+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'171","reported_seq":202,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.513432+0000","last_change":"2024-04-01T22:33:32.847889+0000","last_active":"2024-04-01T23:00:58.513432+0000","last_peered":"2024-04-01T23:00:58.513432+0000","last_clean":"2024-04-01T23:00:58.513432+0000","last_became_active":"2024-04-01T22:33:32.847546+0000","last_became_peered":"2024-04-01T22:33:32.847546+0000","last_unstale":"2024-04-01T23:00:58.513432+0000","last_undegraded":"2024-04-01T23:00:58.513432+0000","last_fullsized":"2024-04-01T23:00:58.513432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":10714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'32","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.781608+0000","last_change":"2024-04-01T22:33:27.881170+0000","last_active":"2024-04-01T23:01:32.781608+0000","last_peered":"2024-04-01T23:01:32.781608+0000","last_clean":"2024-04-01T23:01:32.781608+0000","last_became_active":"2024-04-01T22:33:27.880870+0000","last_became_peered":"2024-04-01T22:33:27.880870+0000","last_unstale":"2024-04-01T23:01:32.781608+0000","last_undegraded":"2024-04-01T23:01:32.781608+0000","last_fullsized":"2024-04-01T23:01:32.781608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:43:39.489075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'5","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:25.552233+0000","last_change":"2024-04-01T22:33:26.856069+0000","last_active":"2024-04-01T23:01:25.552233+0000","last_peered":"2024-04-01T23:01:25.552233+0000","last_clean":"2024-04-01T23:01:25.552233+0000","last_became_active":"2024-04-01T22:33:26.855705+0000","last_became_peered":"2024-04-01T22:33:26.855705+0000","last_unstale":"2024-04-01T23:01:25.552233+0000","last_undegraded":"2024-04-01T23:01:25.552233+0000","last_fullsized":"2024-04-01T23:01:25.552233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'124","reported_seq":156,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:42.282155+0000","last_change":"2024-04-01T22:33:33.249689+0000","last_active":"2024-04-01T23:01:42.282155+0000","last_peered":"2024-04-01T23:01:42.282155+0000","last_clean":"2024-04-01T23:01:42.282155+0000","last_became_active":"2024-04-01T22:33:33.249315+0000","last_became_peered":"2024-04-01T22:33:33.249315+0000","last_unstale":"2024-04-01T23:01:42.282155+0000","last_undegraded":"2024-04-01T23:01:42.282155+0000","last_fullsized":"2024-04-01T23:01:42.282155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":11773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'20","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.779728+0000","last_change":"2024-04-01T22:33:27.881320+0000","last_active":"2024-04-01T23:01:32.779728+0000","last_peered":"2024-04-01T23:01:32.779728+0000","last_clean":"2024-04-01T23:01:32.779728+0000","last_became_active":"2024-04-01T22:33:27.880973+0000","last_became_peered":"2024-04-01T22:33:27.880973+0000","last_unstale":"2024-04-01T23:01:32.779728+0000","last_undegraded":"2024-04-01T23:01:32.779728+0000","last_fullsized":"2024-04-01T23:01:32.779728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:04:44.021944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'5","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:46.601927+0000","last_change":"2024-04-01T23:01:46.602006+0000","last_active":"2024-04-01T23:01:46.601927+0000","last_peered":"2024-04-01T23:01:46.601927+0000","last_clean":"2024-04-01T23:01:46.601927+0000","last_became_active":"2024-04-01T22:33:26.844852+0000","last_became_peered":"2024-04-01T22:33:26.844852+0000","last_unstale":"2024-04-01T23:01:46.601927+0000","last_undegraded":"2024-04-01T23:01:46.601927+0000","last_fullsized":"2024-04-01T23:01:46.601927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-01T23:01:46.601853+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-01T23:01:46.601853+0000","last_clean_scrub_stamp":"2024-04-01T23:01:46.601853+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:40:19.435472+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'146","reported_seq":178,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:42.344778+0000","last_change":"2024-04-01T22:33:32.846922+0000","last_active":"2024-04-01T23:01:42.344778+0000","last_peered":"2024-04-01T23:01:42.344778+0000","last_clean":"2024-04-01T23:01:42.344778+0000","last_became_active":"2024-04-01T22:33:32.846387+0000","last_became_peered":"2024-04-01T22:33:32.846387+0000","last_unstale":"2024-04-01T23:01:42.344778+0000","last_undegraded":"2024-04-01T23:01:42.344778+0000","last_fullsized":"2024-04-01T23:01:42.344778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":12308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'32","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.775880+0000","last_change":"2024-04-01T22:33:27.884447+0000","last_active":"2024-04-01T23:01:32.775880+0000","last_peered":"2024-04-01T23:01:32.775880+0000","last_clean":"2024-04-01T23:01:32.775880+0000","last_became_active":"2024-04-01T22:33:27.884148+0000","last_became_peered":"2024-04-01T22:33:27.884148+0000","last_unstale":"2024-04-01T23:01:32.775880+0000","last_undegraded":"2024-04-01T23:01:32.775880+0000","last_fullsized":"2024-04-01T23:01:32.775880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:08:00.537270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'20","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:46.567141+0000","last_change":"2024-04-01T23:01:46.567169+0000","last_active":"2024-04-01T23:01:46.567141+0000","last_peered":"2024-04-01T23:01:46.567141+0000","last_clean":"2024-04-01T23:01:46.567141+0000","last_became_active":"2024-04-01T22:33:26.844583+0000","last_became_peered":"2024-04-01T22:33:26.844583+0000","last_unstale":"2024-04-01T23:01:46.567141+0000","last_undegraded":"2024-04-01T23:01:46.567141+0000","last_fullsized":"2024-04-01T23:01:46.567141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2024-04-01T23:01:46.567082+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2024-04-01T23:01:46.567082+0000","last_clean_scrub_stamp":"2024-04-01T23:01:46.567082+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:45:14.871559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'120","reported_seq":150,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:58.994271+0000","last_change":"2024-04-01T22:33:32.845036+0000","last_active":"2024-04-01T23:00:58.994271+0000","last_peered":"2024-04-01T23:00:58.994271+0000","last_clean":"2024-04-01T23:00:58.994271+0000","last_became_active":"2024-04-01T22:33:32.844555+0000","last_became_peered":"2024-04-01T22:33:32.844555+0000","last_unstale":"2024-04-01T23:00:58.994271+0000","last_undegraded":"2024-04-01T23:00:58.994271+0000","last_fullsized":"2024-04-01T23:00:58.994271+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":6363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'25","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.635084+0000","last_change":"2024-04-01T22:33:27.950227+0000","last_active":"2024-04-01T23:01:32.635084+0000","last_peered":"2024-04-01T23:01:32.635084+0000","last_clean":"2024-04-01T23:01:32.635084+0000","last_became_active":"2024-04-01T22:33:27.949366+0000","last_became_peered":"2024-04-01T22:33:27.949366+0000","last_unstale":"2024-04-01T23:01:32.635084+0000","last_undegraded":"2024-04-01T23:01:32.635084+0000","last_fullsized":"2024-04-01T23:01:32.635084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:16:58.889368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'3","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:16.386180+0000","last_change":"2024-04-01T22:33:26.830463+0000","last_active":"2024-04-01T23:01:16.386180+0000","last_peered":"2024-04-01T23:01:16.386180+0000","last_clean":"2024-04-01T23:01:16.386180+0000","last_became_active":"2024-04-01T22:33:26.830179+0000","last_became_peered":"2024-04-01T22:33:26.830179+0000","last_unstale":"2024-04-01T23:01:16.386180+0000","last_undegraded":"2024-04-01T23:01:16.386180+0000","last_fullsized":"2024-04-01T23:01:16.386180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:38:14.576161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'118","reported_seq":148,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:55.151082+0000","last_change":"2024-04-01T22:33:33.252812+0000","last_active":"2024-04-01T23:00:55.151082+0000","last_peered":"2024-04-01T23:00:55.151082+0000","last_clean":"2024-04-01T23:00:55.151082+0000","last_became_active":"2024-04-01T22:33:33.252412+0000","last_became_peered":"2024-04-01T22:33:33.252412+0000","last_unstale":"2024-04-01T23:00:55.151082+0000","last_undegraded":"2024-04-01T23:00:55.151082+0000","last_fullsized":"2024-04-01T23:00:55.151082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":10338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'44","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.782716+0000","last_change":"2024-04-01T22:33:27.880363+0000","last_active":"2024-04-01T23:01:32.782716+0000","last_peered":"2024-04-01T23:01:32.782716+0000","last_clean":"2024-04-01T23:01:32.782716+0000","last_became_active":"2024-04-01T22:33:27.880096+0000","last_became_peered":"2024-04-01T22:33:27.880096+0000","last_unstale":"2024-04-01T23:01:32.782716+0000","last_undegraded":"2024-04-01T23:01:32.782716+0000","last_fullsized":"2024-04-01T23:01:32.782716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:19:20.248510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'6","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:27.280786+0000","last_change":"2024-04-01T22:33:26.855823+0000","last_active":"2024-04-01T23:01:27.280786+0000","last_peered":"2024-04-01T23:01:27.280786+0000","last_clean":"2024-04-01T23:01:27.280786+0000","last_became_active":"2024-04-01T22:33:26.855475+0000","last_became_peered":"2024-04-01T22:33:26.855475+0000","last_unstale":"2024-04-01T23:01:27.280786+0000","last_undegraded":"2024-04-01T23:01:27.280786+0000","last_fullsized":"2024-04-01T23:01:27.280786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'90","reported_seq":121,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:37.405946+0000","last_change":"2024-04-01T22:33:33.249941+0000","last_active":"2024-04-01T23:01:37.405946+0000","last_peered":"2024-04-01T23:01:37.405946+0000","last_clean":"2024-04-01T23:01:37.405946+0000","last_became_active":"2024-04-01T22:33:33.249352+0000","last_became_peered":"2024-04-01T22:33:33.249352+0000","last_unstale":"2024-04-01T23:01:37.405946+0000","last_undegraded":"2024-04-01T23:01:37.405946+0000","last_fullsized":"2024-04-01T23:01:37.405946+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":8688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'34","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.808004+0000","last_change":"2024-04-01T22:33:27.948988+0000","last_active":"2024-04-01T23:01:32.808004+0000","last_peered":"2024-04-01T23:01:32.808004+0000","last_clean":"2024-04-01T23:01:32.808004+0000","last_became_active":"2024-04-01T22:33:27.948691+0000","last_became_peered":"2024-04-01T22:33:27.948691+0000","last_unstale":"2024-04-01T23:01:32.808004+0000","last_undegraded":"2024-04-01T23:01:32.808004+0000","last_fullsized":"2024-04-01T23:01:32.808004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'11","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:45.782708+0000","last_change":"2024-04-01T23:01:45.782733+0000","last_active":"2024-04-01T23:01:45.782708+0000","last_peered":"2024-04-01T23:01:45.782708+0000","last_clean":"2024-04-01T23:01:45.782708+0000","last_became_active":"2024-04-01T22:33:26.849646+0000","last_became_peered":"2024-04-01T22:33:26.849646+0000","last_unstale":"2024-04-01T23:01:45.782708+0000","last_undegraded":"2024-04-01T23:01:45.782708+0000","last_fullsized":"2024-04-01T23:01:45.782708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-04-01T23:01:45.782644+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-04-01T23:01:45.782644+0000","last_clean_scrub_stamp":"2024-04-01T23:01:45.782644+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:36:03.764588+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'119","reported_seq":149,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:00.657348+0000","last_change":"2024-04-01T22:33:33.250214+0000","last_active":"2024-04-01T23:01:00.657348+0000","last_peered":"2024-04-01T23:01:00.657348+0000","last_clean":"2024-04-01T23:01:00.657348+0000","last_became_active":"2024-04-01T22:33:33.249853+0000","last_became_peered":"2024-04-01T22:33:33.249853+0000","last_unstale":"2024-04-01T23:01:00.657348+0000","last_undegraded":"2024-04-01T23:01:00.657348+0000","last_fullsized":"2024-04-01T23:01:00.657348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":9692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'28","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.618404+0000","last_change":"2024-04-01T22:34:04.898357+0000","last_active":"2024-04-01T23:01:32.618404+0000","last_peered":"2024-04-01T23:01:32.618404+0000","last_clean":"2024-04-01T23:01:32.618404+0000","last_became_active":"2024-04-01T22:34:04.898014+0000","last_became_peered":"2024-04-01T22:34:04.898014+0000","last_unstale":"2024-04-01T23:01:32.618404+0000","last_undegraded":"2024-04-01T23:01:32.618404+0000","last_fullsized":"2024-04-01T23:01:32.618404+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.14","version":"27'845","reported_seq":883,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:27.449649+0000","last_change":"2024-04-01T22:33:26.855687+0000","last_active":"2024-04-01T23:01:27.449649+0000","last_peered":"2024-04-01T23:01:27.449649+0000","last_clean":"2024-04-01T23:01:27.449649+0000","last_became_active":"2024-04-01T22:33:26.855400+0000","last_became_peered":"2024-04-01T22:33:26.855400+0000","last_unstale":"2024-04-01T23:01:27.449649+0000","last_undegraded":"2024-04-01T23:01:27.449649+0000","last_fullsized":"2024-04-01T23:01:27.449649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:39:29.846272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":842,"num_write_kb":4541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'128","reported_seq":159,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.505683+0000","last_change":"2024-04-01T22:33:32.846727+0000","last_active":"2024-04-01T23:01:32.505683+0000","last_peered":"2024-04-01T23:01:32.505683+0000","last_clean":"2024-04-01T23:01:32.505683+0000","last_became_active":"2024-04-01T22:33:32.846156+0000","last_became_peered":"2024-04-01T22:33:32.846156+0000","last_unstale":"2024-04-01T23:01:32.505683+0000","last_undegraded":"2024-04-01T23:01:32.505683+0000","last_fullsized":"2024-04-01T23:01:32.505683+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":9107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'28","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.637814+0000","last_change":"2024-04-01T22:33:27.879445+0000","last_active":"2024-04-01T23:01:32.637814+0000","last_peered":"2024-04-01T23:01:32.637814+0000","last_clean":"2024-04-01T23:01:32.637814+0000","last_became_active":"2024-04-01T22:33:27.879165+0000","last_became_peered":"2024-04-01T22:33:27.879165+0000","last_unstale":"2024-04-01T23:01:32.637814+0000","last_undegraded":"2024-04-01T23:01:32.637814+0000","last_fullsized":"2024-04-01T23:01:32.637814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'573","reported_seq":611,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:29.542312+0000","last_change":"2024-04-01T22:33:26.851767+0000","last_active":"2024-04-01T23:01:29.542312+0000","last_peered":"2024-04-01T23:01:29.542312+0000","last_clean":"2024-04-01T23:01:29.542312+0000","last_became_active":"2024-04-01T22:33:26.851489+0000","last_became_peered":"2024-04-01T22:33:26.851489+0000","last_unstale":"2024-04-01T23:01:29.542312+0000","last_undegraded":"2024-04-01T23:01:29.542312+0000","last_fullsized":"2024-04-01T23:01:29.542312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":573,"log_dups_size":0,"ondisk_log_size":573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":569,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'166","reported_seq":197,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.343611+0000","last_change":"2024-04-01T22:33:32.846386+0000","last_active":"2024-04-01T23:01:32.343611+0000","last_peered":"2024-04-01T23:01:32.343611+0000","last_clean":"2024-04-01T23:01:32.343611+0000","last_became_active":"2024-04-01T22:33:32.846024+0000","last_became_peered":"2024-04-01T22:33:32.846024+0000","last_unstale":"2024-04-01T23:01:32.343611+0000","last_undegraded":"2024-04-01T23:01:32.343611+0000","last_fullsized":"2024-04-01T23:01:32.343611+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":22198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'35","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.807890+0000","last_change":"2024-04-01T22:33:27.974120+0000","last_active":"2024-04-01T23:01:32.807890+0000","last_peered":"2024-04-01T23:01:32.807890+0000","last_clean":"2024-04-01T23:01:32.807890+0000","last_became_active":"2024-04-01T22:33:27.973846+0000","last_became_peered":"2024-04-01T22:33:27.973846+0000","last_unstale":"2024-04-01T23:01:32.807890+0000","last_undegraded":"2024-04-01T23:01:32.807890+0000","last_fullsized":"2024-04-01T23:01:32.807890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'8","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:25.556567+0000","last_change":"2024-04-01T22:33:26.831927+0000","last_active":"2024-04-01T23:01:25.556567+0000","last_peered":"2024-04-01T23:01:25.556567+0000","last_clean":"2024-04-01T23:01:25.556567+0000","last_became_active":"2024-04-01T22:33:26.831676+0000","last_became_peered":"2024-04-01T22:33:26.831676+0000","last_unstale":"2024-04-01T23:01:25.556567+0000","last_undegraded":"2024-04-01T23:01:25.556567+0000","last_fullsized":"2024-04-01T23:01:25.556567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'96","reported_seq":127,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.405438+0000","last_change":"2024-04-01T22:33:32.849983+0000","last_active":"2024-04-01T23:01:32.405438+0000","last_peered":"2024-04-01T23:01:32.405438+0000","last_clean":"2024-04-01T23:01:32.405438+0000","last_became_active":"2024-04-01T22:33:32.849661+0000","last_became_peered":"2024-04-01T22:33:32.849661+0000","last_unstale":"2024-04-01T23:01:32.405438+0000","last_undegraded":"2024-04-01T23:01:32.405438+0000","last_fullsized":"2024-04-01T23:01:32.405438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":9067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'37","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.685689+0000","last_change":"2024-04-01T22:33:27.972417+0000","last_active":"2024-04-01T23:01:32.685689+0000","last_peered":"2024-04-01T23:01:32.685689+0000","last_clean":"2024-04-01T23:01:32.685689+0000","last_became_active":"2024-04-01T22:33:27.972173+0000","last_became_peered":"2024-04-01T22:33:27.972173+0000","last_unstale":"2024-04-01T23:01:32.685689+0000","last_undegraded":"2024-04-01T23:01:32.685689+0000","last_fullsized":"2024-04-01T23:01:32.685689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:02.441408+0000","last_change":"2024-04-01T22:33:26.831934+0000","last_active":"2024-04-01T23:00:02.441408+0000","last_peered":"2024-04-01T23:00:02.441408+0000","last_clean":"2024-04-01T23:00:02.441408+0000","last_became_active":"2024-04-01T22:33:26.831702+0000","last_became_peered":"2024-04-01T22:33:26.831702+0000","last_unstale":"2024-04-01T23:00:02.441408+0000","last_undegraded":"2024-04-01T23:00:02.441408+0000","last_fullsized":"2024-04-01T23:00:02.441408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:56:04.675231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'144","reported_seq":175,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.405477+0000","last_change":"2024-04-01T22:33:33.254394+0000","last_active":"2024-04-01T23:01:32.405477+0000","last_peered":"2024-04-01T23:01:32.405477+0000","last_clean":"2024-04-01T23:01:32.405477+0000","last_became_active":"2024-04-01T22:33:33.253993+0000","last_became_peered":"2024-04-01T22:33:33.253993+0000","last_unstale":"2024-04-01T23:01:32.405477+0000","last_undegraded":"2024-04-01T23:01:32.405477+0000","last_fullsized":"2024-04-01T23:01:32.405477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":10480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'142","reported_seq":175,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:37.332435+0000","last_change":"2024-04-01T22:33:33.253062+0000","last_active":"2024-04-01T23:01:37.332435+0000","last_peered":"2024-04-01T23:01:37.332435+0000","last_clean":"2024-04-01T23:01:37.332435+0000","last_became_active":"2024-04-01T22:33:33.252690+0000","last_became_peered":"2024-04-01T22:33:33.252690+0000","last_unstale":"2024-04-01T23:01:37.332435+0000","last_undegraded":"2024-04-01T23:01:37.332435+0000","last_fullsized":"2024-04-01T23:01:37.332435+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":7949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'40","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.630062+0000","last_change":"2024-04-01T22:33:27.855871+0000","last_active":"2024-04-01T23:01:32.630062+0000","last_peered":"2024-04-01T23:01:32.630062+0000","last_clean":"2024-04-01T23:01:32.630062+0000","last_became_active":"2024-04-01T22:33:27.855609+0000","last_became_peered":"2024-04-01T22:33:27.855609+0000","last_unstale":"2024-04-01T23:01:32.630062+0000","last_undegraded":"2024-04-01T23:01:32.630062+0000","last_fullsized":"2024-04-01T23:01:32.630062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:09.149560+0000","last_change":"2024-04-01T22:33:26.831819+0000","last_active":"2024-04-01T23:01:09.149560+0000","last_peered":"2024-04-01T23:01:09.149560+0000","last_clean":"2024-04-01T23:01:09.149560+0000","last_became_active":"2024-04-01T22:33:26.831554+0000","last_became_peered":"2024-04-01T22:33:26.831554+0000","last_unstale":"2024-04-01T23:01:09.149560+0000","last_undegraded":"2024-04-01T23:01:09.149560+0000","last_fullsized":"2024-04-01T23:01:09.149560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'135","reported_seq":166,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:00:56.419481+0000","last_change":"2024-04-01T22:33:32.849917+0000","last_active":"2024-04-01T23:00:56.419481+0000","last_peered":"2024-04-01T23:00:56.419481+0000","last_clean":"2024-04-01T23:00:56.419481+0000","last_became_active":"2024-04-01T22:33:32.849536+0000","last_became_peered":"2024-04-01T22:33:32.849536+0000","last_unstale":"2024-04-01T23:00:56.419481+0000","last_undegraded":"2024-04-01T23:00:56.419481+0000","last_fullsized":"2024-04-01T23:00:56.419481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:41:50.766262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":12020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'41","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:46.257374+0000","last_change":"2024-04-01T23:01:46.257418+0000","last_active":"2024-04-01T23:01:46.257374+0000","last_peered":"2024-04-01T23:01:46.257374+0000","last_clean":"2024-04-01T23:01:46.257374+0000","last_became_active":"2024-04-01T22:33:27.950148+0000","last_became_peered":"2024-04-01T22:33:27.950148+0000","last_unstale":"2024-04-01T23:01:46.257374+0000","last_undegraded":"2024-04-01T23:01:46.257374+0000","last_fullsized":"2024-04-01T23:01:46.257374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'41","last_scrub_stamp":"2024-04-01T23:01:46.257262+0000","last_deep_scrub":"27'41","last_deep_scrub_stamp":"2024-04-01T23:01:46.257262+0000","last_clean_scrub_stamp":"2024-04-01T23:01:46.257262+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:37:45.054103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'1","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:25.550249+0000","last_change":"2024-04-01T22:33:26.855715+0000","last_active":"2024-04-01T23:01:25.550249+0000","last_peered":"2024-04-01T23:01:25.550249+0000","last_clean":"2024-04-01T23:01:25.550249+0000","last_became_active":"2024-04-01T22:33:26.855136+0000","last_became_peered":"2024-04-01T22:33:26.855136+0000","last_unstale":"2024-04-01T23:01:25.550249+0000","last_undegraded":"2024-04-01T23:01:25.550249+0000","last_fullsized":"2024-04-01T23:01:25.550249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'613","reported_seq":650,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:14.104867+0000","last_change":"2024-04-01T22:33:26.830837+0000","last_active":"2024-04-01T23:01:14.104867+0000","last_peered":"2024-04-01T23:01:14.104867+0000","last_clean":"2024-04-01T23:01:14.104867+0000","last_became_active":"2024-04-01T22:33:26.830563+0000","last_became_peered":"2024-04-01T22:33:26.830563+0000","last_unstale":"2024-04-01T23:01:14.104867+0000","last_undegraded":"2024-04-01T23:01:14.104867+0000","last_fullsized":"2024-04-01T23:01:14.104867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:40:49.124240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":609,"num_write_kb":4438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'35","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:43.775987+0000","last_change":"2024-04-01T23:01:43.776031+0000","last_active":"2024-04-01T23:01:43.775987+0000","last_peered":"2024-04-01T23:01:43.775987+0000","last_clean":"2024-04-01T23:01:43.775987+0000","last_became_active":"2024-04-01T22:33:27.951103+0000","last_became_peered":"2024-04-01T22:33:27.951103+0000","last_unstale":"2024-04-01T23:01:43.775987+0000","last_undegraded":"2024-04-01T23:01:43.775987+0000","last_fullsized":"2024-04-01T23:01:43.775987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2024-04-01T23:01:43.775866+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2024-04-01T23:01:43.775866+0000","last_clean_scrub_stamp":"2024-04-01T23:01:43.775866+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:36:23.982972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'96","reported_seq":126,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:02.270097+0000","last_change":"2024-04-01T22:33:32.846734+0000","last_active":"2024-04-01T23:01:02.270097+0000","last_peered":"2024-04-01T23:01:02.270097+0000","last_clean":"2024-04-01T23:01:02.270097+0000","last_became_active":"2024-04-01T22:33:32.846376+0000","last_became_peered":"2024-04-01T22:33:32.846376+0000","last_unstale":"2024-04-01T23:01:02.270097+0000","last_undegraded":"2024-04-01T23:01:02.270097+0000","last_fullsized":"2024-04-01T23:01:02.270097+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":4400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'650","reported_seq":688,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:25.550819+0000","last_change":"2024-04-01T22:33:26.855529+0000","last_active":"2024-04-01T23:01:25.550819+0000","last_peered":"2024-04-01T23:01:25.550819+0000","last_clean":"2024-04-01T23:01:25.550819+0000","last_became_active":"2024-04-01T22:33:26.855101+0000","last_became_peered":"2024-04-01T22:33:26.855101+0000","last_unstale":"2024-04-01T23:01:25.550819+0000","last_undegraded":"2024-04-01T23:01:25.550819+0000","last_fullsized":"2024-04-01T23:01:25.550819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:25.507704+0000","last_clean_scrub_stamp":"2024-04-01T22:33:25.507704+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":645,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'30","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.633543+0000","last_change":"2024-04-01T22:33:27.868702+0000","last_active":"2024-04-01T23:01:32.633543+0000","last_peered":"2024-04-01T23:01:32.633543+0000","last_clean":"2024-04-01T23:01:32.633543+0000","last_became_active":"2024-04-01T22:33:27.868297+0000","last_became_peered":"2024-04-01T22:33:27.868297+0000","last_unstale":"2024-04-01T23:01:32.633543+0000","last_undegraded":"2024-04-01T23:01:32.633543+0000","last_fullsized":"2024-04-01T23:01:32.633543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'127","reported_seq":164,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:02.403179+0000","last_change":"2024-04-01T22:34:05.319978+0000","last_active":"2024-04-01T23:01:02.403179+0000","last_peered":"2024-04-01T23:01:02.403179+0000","last_clean":"2024-04-01T23:01:02.403179+0000","last_became_active":"2024-04-01T22:34:05.319550+0000","last_became_peered":"2024-04-01T22:34:05.319550+0000","last_unstale":"2024-04-01T23:01:02.403179+0000","last_undegraded":"2024-04-01T23:01:02.403179+0000","last_fullsized":"2024-04-01T23:01:02.403179+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:31.535606+0000","last_clean_scrub_stamp":"2024-04-01T22:33:31.535606+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":7877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'45","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.672541+0000","last_change":"2024-04-01T22:33:27.950106+0000","last_active":"2024-04-01T23:01:32.672541+0000","last_peered":"2024-04-01T23:01:32.672541+0000","last_clean":"2024-04-01T23:01:32.672541+0000","last_became_active":"2024-04-01T22:33:27.949843+0000","last_became_peered":"2024-04-01T22:33:27.949843+0000","last_unstale":"2024-04-01T23:01:32.672541+0000","last_undegraded":"2024-04-01T23:01:32.672541+0000","last_fullsized":"2024-04-01T23:01:32.672541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:23:08.563134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'43","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.629101+0000","last_change":"2024-04-01T22:33:27.974409+0000","last_active":"2024-04-01T23:01:32.629101+0000","last_peered":"2024-04-01T23:01:32.629101+0000","last_clean":"2024-04-01T23:01:32.629101+0000","last_became_active":"2024-04-01T22:33:27.974128+0000","last_became_peered":"2024-04-01T22:33:27.974128+0000","last_unstale":"2024-04-01T23:01:32.629101+0000","last_undegraded":"2024-04-01T23:01:32.629101+0000","last_fullsized":"2024-04-01T23:01:32.629101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'42","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.682079+0000","last_change":"2024-04-01T22:33:27.974885+0000","last_active":"2024-04-01T23:01:32.682079+0000","last_peered":"2024-04-01T23:01:32.682079+0000","last_clean":"2024-04-01T23:01:32.682079+0000","last_became_active":"2024-04-01T22:33:27.973988+0000","last_became_peered":"2024-04-01T22:33:27.973988+0000","last_unstale":"2024-04-01T23:01:32.682079+0000","last_undegraded":"2024-04-01T23:01:32.682079+0000","last_fullsized":"2024-04-01T23:01:32.682079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'29","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.807280+0000","last_change":"2024-04-01T22:33:27.950817+0000","last_active":"2024-04-01T23:01:32.807280+0000","last_peered":"2024-04-01T23:01:32.807280+0000","last_clean":"2024-04-01T23:01:32.807280+0000","last_became_active":"2024-04-01T22:33:27.950515+0000","last_became_peered":"2024-04-01T22:33:27.950515+0000","last_unstale":"2024-04-01T23:01:32.807280+0000","last_undegraded":"2024-04-01T23:01:32.807280+0000","last_fullsized":"2024-04-01T23:01:32.807280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'25","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:37.405956+0000","last_change":"2024-04-01T22:33:27.869385+0000","last_active":"2024-04-01T23:01:37.405956+0000","last_peered":"2024-04-01T23:01:37.405956+0000","last_clean":"2024-04-01T23:01:37.405956+0000","last_became_active":"2024-04-01T22:33:27.869102+0000","last_became_peered":"2024-04-01T22:33:27.869102+0000","last_unstale":"2024-04-01T23:01:37.405956+0000","last_undegraded":"2024-04-01T23:01:37.405956+0000","last_fullsized":"2024-04-01T23:01:37.405956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'26","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:37.506116+0000","last_change":"2024-04-01T22:33:27.856463+0000","last_active":"2024-04-01T23:01:37.506116+0000","last_peered":"2024-04-01T23:01:37.506116+0000","last_clean":"2024-04-01T23:01:37.506116+0000","last_became_active":"2024-04-01T22:33:27.856213+0000","last_became_peered":"2024-04-01T22:33:27.856213+0000","last_unstale":"2024-04-01T23:01:37.506116+0000","last_undegraded":"2024-04-01T23:01:37.506116+0000","last_fullsized":"2024-04-01T23:01:37.506116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'41","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.676975+0000","last_change":"2024-04-01T22:33:27.921487+0000","last_active":"2024-04-01T23:01:32.676975+0000","last_peered":"2024-04-01T23:01:32.676975+0000","last_clean":"2024-04-01T23:01:32.676975+0000","last_became_active":"2024-04-01T22:33:27.921229+0000","last_became_peered":"2024-04-01T22:33:27.921229+0000","last_unstale":"2024-04-01T23:01:32.676975+0000","last_undegraded":"2024-04-01T23:01:32.676975+0000","last_fullsized":"2024-04-01T23:01:32.676975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:43:03.166262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'30","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:37.405970+0000","last_change":"2024-04-01T22:33:27.868732+0000","last_active":"2024-04-01T23:01:37.405970+0000","last_peered":"2024-04-01T23:01:37.405970+0000","last_clean":"2024-04-01T23:01:37.405970+0000","last_became_active":"2024-04-01T22:33:27.868496+0000","last_became_peered":"2024-04-01T22:33:27.868496+0000","last_unstale":"2024-04-01T23:01:37.405970+0000","last_undegraded":"2024-04-01T23:01:37.405970+0000","last_fullsized":"2024-04-01T23:01:37.405970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'30","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:42.282178+0000","last_change":"2024-04-01T22:33:27.974270+0000","last_active":"2024-04-01T23:01:42.282178+0000","last_peered":"2024-04-01T23:01:42.282178+0000","last_clean":"2024-04-01T23:01:42.282178+0000","last_became_active":"2024-04-01T22:33:27.973851+0000","last_became_peered":"2024-04-01T22:33:27.973851+0000","last_unstale":"2024-04-01T23:01:42.282178+0000","last_undegraded":"2024-04-01T23:01:42.282178+0000","last_fullsized":"2024-04-01T23:01:42.282178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'42","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.624590+0000","last_change":"2024-04-01T22:34:05.290057+0000","last_active":"2024-04-01T23:01:32.624590+0000","last_peered":"2024-04-01T23:01:32.624590+0000","last_clean":"2024-04-01T23:01:32.624590+0000","last_became_active":"2024-04-01T22:34:05.289755+0000","last_became_peered":"2024-04-01T22:34:05.289755+0000","last_unstale":"2024-04-01T23:01:32.624590+0000","last_undegraded":"2024-04-01T23:01:32.624590+0000","last_fullsized":"2024-04-01T23:01:32.624590+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"27'35","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.685987+0000","last_change":"2024-04-01T22:33:27.979380+0000","last_active":"2024-04-01T23:01:32.685987+0000","last_peered":"2024-04-01T23:01:32.685987+0000","last_clean":"2024-04-01T23:01:32.685987+0000","last_became_active":"2024-04-01T22:33:27.979108+0000","last_became_peered":"2024-04-01T22:33:27.979108+0000","last_unstale":"2024-04-01T23:01:32.685987+0000","last_undegraded":"2024-04-01T23:01:32.685987+0000","last_fullsized":"2024-04-01T23:01:32.685987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'48","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.808581+0000","last_change":"2024-04-01T22:33:27.953950+0000","last_active":"2024-04-01T23:01:32.808581+0000","last_peered":"2024-04-01T23:01:32.808581+0000","last_clean":"2024-04-01T23:01:32.808581+0000","last_became_active":"2024-04-01T22:33:27.953674+0000","last_became_peered":"2024-04-01T22:33:27.953674+0000","last_unstale":"2024-04-01T23:01:32.808581+0000","last_undegraded":"2024-04-01T23:01:32.808581+0000","last_fullsized":"2024-04-01T23:01:32.808581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'37","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.672896+0000","last_change":"2024-04-01T22:33:27.919041+0000","last_active":"2024-04-01T23:01:32.672896+0000","last_peered":"2024-04-01T23:01:32.672896+0000","last_clean":"2024-04-01T23:01:32.672896+0000","last_became_active":"2024-04-01T22:33:27.918815+0000","last_became_peered":"2024-04-01T22:33:27.918815+0000","last_unstale":"2024-04-01T23:01:32.672896+0000","last_undegraded":"2024-04-01T23:01:32.672896+0000","last_fullsized":"2024-04-01T23:01:32.672896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:15:08.500466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'34","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.703645+0000","last_change":"2024-04-01T22:33:27.881613+0000","last_active":"2024-04-01T23:01:32.703645+0000","last_peered":"2024-04-01T23:01:32.703645+0000","last_clean":"2024-04-01T23:01:32.703645+0000","last_became_active":"2024-04-01T22:33:27.881372+0000","last_became_peered":"2024-04-01T22:33:27.881372+0000","last_unstale":"2024-04-01T23:01:32.703645+0000","last_undegraded":"2024-04-01T23:01:32.703645+0000","last_fullsized":"2024-04-01T23:01:32.703645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:28:13.071380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"27'43","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.628767+0000","last_change":"2024-04-01T22:33:27.919025+0000","last_active":"2024-04-01T23:01:32.628767+0000","last_peered":"2024-04-01T23:01:32.628767+0000","last_clean":"2024-04-01T23:01:32.628767+0000","last_became_active":"2024-04-01T22:33:27.918749+0000","last_became_peered":"2024-04-01T22:33:27.918749+0000","last_unstale":"2024-04-01T23:01:32.628767+0000","last_undegraded":"2024-04-01T23:01:32.628767+0000","last_fullsized":"2024-04-01T23:01:32.628767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'36","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.672140+0000","last_change":"2024-04-01T22:33:27.979289+0000","last_active":"2024-04-01T23:01:32.672140+0000","last_peered":"2024-04-01T23:01:32.672140+0000","last_clean":"2024-04-01T23:01:32.672140+0000","last_became_active":"2024-04-01T22:33:27.979036+0000","last_became_peered":"2024-04-01T22:33:27.979036+0000","last_unstale":"2024-04-01T23:01:32.672140+0000","last_undegraded":"2024-04-01T23:01:32.672140+0000","last_fullsized":"2024-04-01T23:01:32.672140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"27'35","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.685722+0000","last_change":"2024-04-01T22:33:27.974214+0000","last_active":"2024-04-01T23:01:32.685722+0000","last_peered":"2024-04-01T23:01:32.685722+0000","last_clean":"2024-04-01T23:01:32.685722+0000","last_became_active":"2024-04-01T22:33:27.973962+0000","last_became_peered":"2024-04-01T22:33:27.973962+0000","last_unstale":"2024-04-01T23:01:32.685722+0000","last_undegraded":"2024-04-01T23:01:32.685722+0000","last_fullsized":"2024-04-01T23:01:32.685722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"27'37","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.628924+0000","last_change":"2024-04-01T22:33:27.869600+0000","last_active":"2024-04-01T23:01:32.628924+0000","last_peered":"2024-04-01T23:01:32.628924+0000","last_clean":"2024-04-01T23:01:32.628924+0000","last_became_active":"2024-04-01T22:33:27.869279+0000","last_became_peered":"2024-04-01T22:33:27.869279+0000","last_unstale":"2024-04-01T23:01:32.628924+0000","last_undegraded":"2024-04-01T23:01:32.628924+0000","last_fullsized":"2024-04-01T23:01:32.628924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'36","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.806608+0000","last_change":"2024-04-01T22:33:27.948313+0000","last_active":"2024-04-01T23:01:32.806608+0000","last_peered":"2024-04-01T23:01:32.806608+0000","last_clean":"2024-04-01T23:01:32.806608+0000","last_became_active":"2024-04-01T22:33:27.947834+0000","last_became_peered":"2024-04-01T22:33:27.947834+0000","last_unstale":"2024-04-01T23:01:32.806608+0000","last_undegraded":"2024-04-01T23:01:32.806608+0000","last_fullsized":"2024-04-01T23:01:32.806608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'35","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.709054+0000","last_change":"2024-04-01T22:33:27.915571+0000","last_active":"2024-04-01T23:01:32.709054+0000","last_peered":"2024-04-01T23:01:32.709054+0000","last_clean":"2024-04-01T23:01:32.709054+0000","last_became_active":"2024-04-01T22:33:27.915372+0000","last_became_peered":"2024-04-01T22:33:27.915372+0000","last_unstale":"2024-04-01T23:01:32.709054+0000","last_undegraded":"2024-04-01T23:01:32.709054+0000","last_fullsized":"2024-04-01T23:01:32.709054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'26","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.635399+0000","last_change":"2024-04-01T22:33:27.915752+0000","last_active":"2024-04-01T23:01:32.635399+0000","last_peered":"2024-04-01T23:01:32.635399+0000","last_clean":"2024-04-01T23:01:32.635399+0000","last_became_active":"2024-04-01T22:33:27.915515+0000","last_became_peered":"2024-04-01T22:33:27.915515+0000","last_unstale":"2024-04-01T23:01:32.635399+0000","last_undegraded":"2024-04-01T23:01:32.635399+0000","last_fullsized":"2024-04-01T23:01:32.635399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'29","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.649629+0000","last_change":"2024-04-01T22:33:27.974798+0000","last_active":"2024-04-01T23:01:32.649629+0000","last_peered":"2024-04-01T23:01:32.649629+0000","last_clean":"2024-04-01T23:01:32.649629+0000","last_became_active":"2024-04-01T22:33:27.974558+0000","last_became_peered":"2024-04-01T22:33:27.974558+0000","last_unstale":"2024-04-01T23:01:32.649629+0000","last_undegraded":"2024-04-01T23:01:32.649629+0000","last_fullsized":"2024-04-01T23:01:32.649629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:15:46.224658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'40","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.679257+0000","last_change":"2024-04-01T22:33:27.974420+0000","last_active":"2024-04-01T23:01:32.679257+0000","last_peered":"2024-04-01T23:01:32.679257+0000","last_clean":"2024-04-01T23:01:32.679257+0000","last_became_active":"2024-04-01T22:33:27.974139+0000","last_became_peered":"2024-04-01T22:33:27.974139+0000","last_unstale":"2024-04-01T23:01:32.679257+0000","last_undegraded":"2024-04-01T23:01:32.679257+0000","last_fullsized":"2024-04-01T23:01:32.679257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:48:53.083180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'41","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.781493+0000","last_change":"2024-04-01T22:33:27.972053+0000","last_active":"2024-04-01T23:01:32.781493+0000","last_peered":"2024-04-01T23:01:32.781493+0000","last_clean":"2024-04-01T23:01:32.781493+0000","last_became_active":"2024-04-01T22:33:27.971803+0000","last_became_peered":"2024-04-01T22:33:27.971803+0000","last_unstale":"2024-04-01T23:01:32.781493+0000","last_undegraded":"2024-04-01T23:01:32.781493+0000","last_fullsized":"2024-04-01T23:01:32.781493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:41:45.866834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'27","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.711000+0000","last_change":"2024-04-01T22:33:27.974447+0000","last_active":"2024-04-01T23:01:32.711000+0000","last_peered":"2024-04-01T23:01:32.711000+0000","last_clean":"2024-04-01T23:01:32.711000+0000","last_became_active":"2024-04-01T22:33:27.974205+0000","last_became_peered":"2024-04-01T22:33:27.974205+0000","last_unstale":"2024-04-01T23:01:32.711000+0000","last_undegraded":"2024-04-01T23:01:32.711000+0000","last_fullsized":"2024-04-01T23:01:32.711000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'34","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.695541+0000","last_change":"2024-04-01T22:33:27.949226+0000","last_active":"2024-04-01T23:01:32.695541+0000","last_peered":"2024-04-01T23:01:32.695541+0000","last_clean":"2024-04-01T23:01:32.695541+0000","last_became_active":"2024-04-01T22:33:27.948929+0000","last_became_peered":"2024-04-01T22:33:27.948929+0000","last_unstale":"2024-04-01T23:01:32.695541+0000","last_undegraded":"2024-04-01T23:01:32.695541+0000","last_fullsized":"2024-04-01T23:01:32.695541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:50:04.913482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'34","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.686064+0000","last_change":"2024-04-01T22:33:27.974650+0000","last_active":"2024-04-01T23:01:32.686064+0000","last_peered":"2024-04-01T23:01:32.686064+0000","last_clean":"2024-04-01T23:01:32.686064+0000","last_became_active":"2024-04-01T22:33:27.973891+0000","last_became_peered":"2024-04-01T22:33:27.973891+0000","last_unstale":"2024-04-01T23:01:32.686064+0000","last_undegraded":"2024-04-01T23:01:32.686064+0000","last_fullsized":"2024-04-01T23:01:32.686064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'27","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.774173+0000","last_change":"2024-04-01T22:33:27.879045+0000","last_active":"2024-04-01T23:01:32.774173+0000","last_peered":"2024-04-01T23:01:32.774173+0000","last_clean":"2024-04-01T23:01:32.774173+0000","last_became_active":"2024-04-01T22:33:27.878782+0000","last_became_peered":"2024-04-01T22:33:27.878782+0000","last_unstale":"2024-04-01T23:01:32.774173+0000","last_undegraded":"2024-04-01T23:01:32.774173+0000","last_fullsized":"2024-04-01T23:01:32.774173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:56:25.952727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'23","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.685884+0000","last_change":"2024-04-01T22:33:27.974592+0000","last_active":"2024-04-01T23:01:32.685884+0000","last_peered":"2024-04-01T23:01:32.685884+0000","last_clean":"2024-04-01T23:01:32.685884+0000","last_became_active":"2024-04-01T22:33:27.973592+0000","last_became_peered":"2024-04-01T22:33:27.973592+0000","last_unstale":"2024-04-01T23:01:32.685884+0000","last_undegraded":"2024-04-01T23:01:32.685884+0000","last_fullsized":"2024-04-01T23:01:32.685884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'38","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.807877+0000","last_change":"2024-04-01T22:33:27.948715+0000","last_active":"2024-04-01T23:01:32.807877+0000","last_peered":"2024-04-01T23:01:32.807877+0000","last_clean":"2024-04-01T23:01:32.807877+0000","last_became_active":"2024-04-01T22:33:27.948371+0000","last_became_peered":"2024-04-01T22:33:27.948371+0000","last_unstale":"2024-04-01T23:01:32.807877+0000","last_undegraded":"2024-04-01T23:01:32.807877+0000","last_fullsized":"2024-04-01T23:01:32.807877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'33","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.629151+0000","last_change":"2024-04-01T22:33:27.949784+0000","last_active":"2024-04-01T23:01:32.629151+0000","last_peered":"2024-04-01T23:01:32.629151+0000","last_clean":"2024-04-01T23:01:32.629151+0000","last_became_active":"2024-04-01T22:33:27.949522+0000","last_became_peered":"2024-04-01T22:33:27.949522+0000","last_unstale":"2024-04-01T23:01:32.629151+0000","last_undegraded":"2024-04-01T23:01:32.629151+0000","last_fullsized":"2024-04-01T23:01:32.629151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'27","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:32.774104+0000","last_change":"2024-04-01T22:33:27.915533+0000","last_active":"2024-04-01T23:01:32.774104+0000","last_peered":"2024-04-01T23:01:32.774104+0000","last_clean":"2024-04-01T23:01:32.774104+0000","last_became_active":"2024-04-01T22:33:27.915245+0000","last_became_peered":"2024-04-01T22:33:27.915245+0000","last_unstale":"2024-04-01T23:01:32.774104+0000","last_undegraded":"2024-04-01T23:01:32.774104+0000","last_fullsized":"2024-04-01T23:01:32.774104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T22:33:26.636178+0000","last_clean_scrub_stamp":"2024-04-01T22:33:26.636178+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:39:28.692092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3654,"num_write_kb":290798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4064,"ondisk_log_size":4064,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2128,"ondisk_log_size":2128,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":36646588,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":816,"num_read_kb":876,"num_write":10141,"num_write_kb":41168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":48185344,"data_stored":73293176,"data_compressed":7244306,"data_compressed_allocated":10911744,"data_compressed_original":36085760,"omap_allocated":0,"internal_metadata":0},"log_size":8264,"ondisk_log_size":8264,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65062,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575195,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72588,"kb_used_data":15044,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94299252,"statfs":{"total":96636764160,"available":96562434048,"internally_reserved":0,"allocated":15405056,"data_stored":24583315,"data_compressed":2540462,"data_compressed_allocated":3739648,"data_compressed_original":13099008,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575195,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56068,"kb_used_data":11004,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94315772,"statfs":{"total":96636764160,"available":96579350528,"internally_reserved":0,"allocated":11268096,"data_stored":16896912,"data_compressed":1639374,"data_compressed_allocated":2478080,"data_compressed_original":8286208,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575194,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":119114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575195,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36636,"kb_used_data":5460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335204,"statfs":{"total":96636764160,"available":96599248896,"internally_reserved":0,"allocated":5591040,"data_stored":8507758,"data_compressed":911578,"data_compressed_allocated":1363968,"data_compressed_original":4464640,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575195,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58728,"kb_used_data":9504,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94313112,"statfs":{"total":96636764160,"available":96576626688,"internally_reserved":0,"allocated":9732096,"data_stored":12891473,"data_compressed":1012016,"data_compressed_allocated":1646592,"data_compressed_original":4988928,"omap_allocated":1592,"internal_metadata":50395592},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575195,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":483328,"data_stored":307889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575194,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41316,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330524,"statfs":{"total":96636764160,"available":96594456576,"internally_reserved":0,"allocated":1863680,"data_stored":3021005,"data_compressed":393957,"data_compressed_allocated":561152,"data_compressed_original":1900544,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575195,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41200,"kb_used_data":5864,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330640,"statfs":{"total":96636764160,"available":96594575360,"internally_reserved":0,"allocated":6004736,"data_stored":9098638,"data_compressed":811981,"data_compressed_allocated":1212416,"data_compressed_original":4493312,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32531,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32531,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5648384,"data_stored":8389246,"data_compressed":779450,"data_compressed_allocated":1167360,"data_compressed_original":3919872,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1572864,"data_stored":2901981,"data_compressed":393957,"data_compressed_allocated":561152,"data_compressed_original":1900544,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":192512,"data_stored":188865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9441280,"data_stored":12772449,"data_compressed":1012016,"data_compressed_allocated":1646592,"data_compressed_original":4988928,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5300224,"data_stored":8388734,"data_compressed":911578,"data_compressed_allocated":1363968,"data_compressed_original":4464640,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10977280,"data_stored":16777888,"data_compressed":1639374,"data_compressed_allocated":2478080,"data_compressed_original":8286208,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15048704,"data_stored":23873923,"data_compressed":2507931,"data_compressed_allocated":3694592,"data_compressed_original":12525568,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T23:01:49.459 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.459 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-01T22:33:31.535606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=31, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.459 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-04-01T22:33:25.507704+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=25, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.459 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.459 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-01T22:33:31.535606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=31, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.460 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-01T22:33:25.507704+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=25, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.460 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.460 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-01T22:33:31.535606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=31, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.460 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-04-01T22:33:25.507704+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=25, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.460 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.460 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-01T22:33:31.535606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=31, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.461 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.461 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-01T22:33:25.507704+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=25, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.461 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-01T22:33:31.535606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=31, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.461 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-04-01T22:33:25.507704+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=25, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.461 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-01T22:33:31.535606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=31, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.461 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.461 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-01T22:33:31.535606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=31, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.461 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.462 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-01T22:33:25.507704+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=25, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.462 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-01T22:33:31.535606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=31, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.462 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-01T22:33:25.507704+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=25, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.462 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-01T22:33:31.535606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=31, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.462 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.462 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-01T22:33:31.535606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=31, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.463 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.463 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-01T22:33:25.507704+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=25, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.463 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-01T22:33:31.535606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=31, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.463 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.463 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-01T22:33:31.535606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=31, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.463 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.463 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-01T22:33:25.507704+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=25, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.464 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-01T22:33:31.535606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=31, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.464 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.464 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-01T22:33:25.507704+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=25, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.464 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-01T22:33:31.535606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=31, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.464 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.464 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-01T22:33:25.507704+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=25, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.465 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-01T22:33:31.535606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=31, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.465 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.465 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-01T22:33:25.507704+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=25, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.465 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-01T22:33:13.756389+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=13, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.465 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-01T22:33:31.535606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=31, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.465 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.466 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-01T22:33:31.535606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=31, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.466 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.467 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-01T22:33:31.535606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=31, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.467 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.467 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-04-01T22:33:25.507704+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=25, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.468 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-01T22:33:31.535606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=31, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.468 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.468 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-01T22:33:31.535606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=31, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.469 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.469 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-01T22:33:31.535606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=31, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.470 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.470 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-04-01T22:33:25.507704+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=25, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.470 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-01T22:33:31.535606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=31, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.470 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.470 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-01T22:33:25.507704+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=25, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.471 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-01T22:33:31.535606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=31, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.471 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.471 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-01T22:33:31.535606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=31, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.471 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.471 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-04-01T22:33:25.507704+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=25, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.471 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-01T22:33:31.535606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=31, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.471 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.472 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-01T22:33:25.507704+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=25, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.472 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-01T22:33:31.535606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=31, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.472 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.472 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-04-01T22:33:25.507704+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=25, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.472 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-01T22:33:31.535606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=31, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.472 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.472 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-04-01T22:33:25.507704+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=25, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.473 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-01T22:33:31.535606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=31, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.473 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-01T22:33:31.535606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=31, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.473 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.473 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-01T22:33:25.507704+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=25, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.473 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-01T22:33:31.535606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=31, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.473 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-04-01T22:33:25.507704+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=25, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.473 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-01T22:33:25.507704+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=25, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.474 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-01T22:33:31.535606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=31, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.474 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-04-01T22:33:25.507704+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=25, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.474 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.474 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-01T22:33:31.535606+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=31, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.474 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.474 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.474 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.475 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.475 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.475 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.475 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.475 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.475 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.476 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.476 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.476 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.476 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.476 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.477 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.477 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.477 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.477 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.477 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.478 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.478 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.478 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.478 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.478 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.478 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.478 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.479 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.479 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.479 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.479 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.479 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.479 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-01T22:33:26.636178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=22, tm_min=33, tm_sec=26, tm_wday=0, tm_yday=92, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=23, tm_min=1, tm_sec=41, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T23:01:49.479 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-01T23:02:09.480 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T23:02:09.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.590+0000 7effd2cb5640 1 Processor -- start 2024-04-01T23:02:09.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.590+0000 7effd2cb5640 1 -- start start 2024-04-01T23:02:09.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.591+0000 7effd2cb5640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7effcc06c250 0x7effcc15aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:09.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.591+0000 7effd2cb5640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7effcc15bb20 0x7effcc15bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:09.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.591+0000 7effd2cb5640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effcc154b70 con 0x7effcc06c630 2024-04-01T23:02:09.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.591+0000 7effd2cb5640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7effcc0ce990 con 0x7effcc06c250 2024-04-01T23:02:09.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.591+0000 7effd2cb5640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7effcc0cdac0 con 0x7effcc15bb20 2024-04-01T23:02:09.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.591+0000 7effd0a51640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7effcc06c250 0x7effcc15aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:09.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.591+0000 7effd1252640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7effcc15bb20 0x7effcc15bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:09.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.592+0000 7effd1252640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7effcc15bb20 0x7effcc15bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:50070/0 (socket says 172.21.15.47:50070) 2024-04-01T23:02:09.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.592+0000 7effd0a51640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7effcc06c250 0x7effcc15aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49834/0 (socket says 172.21.15.47:49834) 2024-04-01T23:02:09.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.592+0000 7effd1252640 1 -- 172.21.15.47:0/3210448099 learned_addr learned my addr 172.21.15.47:0/3210448099 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:02:09.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.594+0000 7effd1252640 1 -- 172.21.15.47:0/3210448099 >> v2:172.21.15.47:3300/0 conn(0x7effcc06c250 msgr2=0x7effcc15aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:02:09.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.594+0000 7effd1252640 1 --2- 172.21.15.47:0/3210448099 >> v2:172.21.15.47:3300/0 conn(0x7effcc06c250 0x7effcc15aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:09.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.594+0000 7effd1252640 1 -- 172.21.15.47:0/3210448099 >> v1:172.21.15.47:6789/0 conn(0x7effcc06c630 legacy=0x7effcc0ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:09.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.594+0000 7effd1252640 1 -- 172.21.15.47:0/3210448099 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effcc0cf2a0 con 0x7effcc15bb20 2024-04-01T23:02:09.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.596+0000 7effd1252640 1 --2- 172.21.15.47:0/3210448099 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7effcc15bb20 0x7effcc15bf50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7effc4009e50 tx=0x7effc402bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28392731df949703 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:02:09.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.599+0000 7effc37fe640 1 -- 172.21.15.47:0/3210448099 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc402cb90 con 0x7effcc15bb20 2024-04-01T23:02:09.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.599+0000 7effc37fe640 1 -- 172.21.15.47:0/3210448099 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effc402cd30 con 0x7effcc15bb20 2024-04-01T23:02:09.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.599+0000 7effc37fe640 1 -- 172.21.15.47:0/3210448099 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc4034610 con 0x7effcc15bb20 2024-04-01T23:02:09.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.600+0000 7effd2cb5640 1 -- 172.21.15.47:0/3210448099 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7effcc15bb20 msgr2=0x7effcc15bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:09.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.600+0000 7effd2cb5640 1 --2- 172.21.15.47:0/3210448099 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7effcc15bb20 0x7effcc15bf50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7effc4009e50 tx=0x7effc402bff0 comp rx=0 tx=0).stop 2024-04-01T23:02:09.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.600+0000 7effd2cb5640 1 -- 172.21.15.47:0/3210448099 shutdown_connections 2024-04-01T23:02:09.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.600+0000 7effd2cb5640 1 --2- 172.21.15.47:0/3210448099 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7effcc15bb20 0x7effcc15bf50 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:09.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.600+0000 7effd2cb5640 1 --2- 172.21.15.47:0/3210448099 >> v2:172.21.15.47:3300/0 conn(0x7effcc06c250 0x7effcc15aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:09.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.600+0000 7effd2cb5640 1 -- 172.21.15.47:0/3210448099 >> 172.21.15.47:0/3210448099 conn(0x7effcc0cfdb0 msgr2=0x7effcc0d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:02:09.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.600+0000 7effd2cb5640 1 -- 172.21.15.47:0/3210448099 shutdown_connections 2024-04-01T23:02:09.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.600+0000 7effd2cb5640 1 -- 172.21.15.47:0/3210448099 wait complete. 2024-04-01T23:02:09.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.601+0000 7effd2cb5640 1 Processor -- start 2024-04-01T23:02:09.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.601+0000 7effd2cb5640 1 -- start start 2024-04-01T23:02:09.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.602+0000 7effd2cb5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7effcc06c250 0x7effcc159150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:09.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.602+0000 7effd2cb5640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7effcc06c630 0x7effcc156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:09.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.602+0000 7effd2cb5640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7effcc15bb20 0x7effcc1f3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:09.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.602+0000 7effd2cb5640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7effcc0ce060 con 0x7effcc06c250 2024-04-01T23:02:09.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.602+0000 7effd2cb5640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7effcc0cdd80 con 0x7effcc15bb20 2024-04-01T23:02:09.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.602+0000 7effd2cb5640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7effcc0ce340 con 0x7effcc06c630 2024-04-01T23:02:09.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.603+0000 7effd0a51640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7effcc06c250 0x7effcc159150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:09.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.603+0000 7effd1252640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7effcc15bb20 0x7effcc1f3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:09.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.603+0000 7effc3fff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7effcc06c630 0x7effcc156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:09.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.603+0000 7effd0a51640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7effcc06c250 0x7effcc159150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49840/0 (socket says 172.21.15.47:49840) 2024-04-01T23:02:09.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.603+0000 7effd0a51640 1 -- 172.21.15.47:0/4179195771 learned_addr learned my addr 172.21.15.47:0/4179195771 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:02:09.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.607+0000 7effc3fff640 1 -- 172.21.15.47:0/4179195771 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7effcc15bb20 msgr2=0x7effcc1f3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:09.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.607+0000 7effc3fff640 1 --2- 172.21.15.47:0/4179195771 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7effcc15bb20 0x7effcc1f3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:09.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.607+0000 7effc3fff640 1 -- 172.21.15.47:0/4179195771 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7effcc06c250 msgr2=0x7effcc159150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:09.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.607+0000 7effc3fff640 1 --2- 172.21.15.47:0/4179195771 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7effcc06c250 0x7effcc159150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:09.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.607+0000 7effc3fff640 1 -- 172.21.15.47:0/4179195771 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effcc156840 con 0x7effcc06c630 2024-04-01T23:02:09.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.610+0000 7effc3fff640 1 --2- 172.21.15.47:0/4179195771 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7effcc06c630 0x7effcc156fd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7effbc00c340 tx=0x7effbc00c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:02:09.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.613+0000 7effc17fa640 1 -- 172.21.15.47:0/4179195771 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effbc0052d0 con 0x7effcc06c630 2024-04-01T23:02:09.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.613+0000 7effc17fa640 1 -- 172.21.15.47:0/4179195771 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effbc005490 con 0x7effcc06c630 2024-04-01T23:02:09.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.613+0000 7effc17fa640 1 -- 172.21.15.47:0/4179195771 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effbc007260 con 0x7effcc06c630 2024-04-01T23:02:09.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.613+0000 7effd2cb5640 1 -- 172.21.15.47:0/4179195771 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effcc1597e0 con 0x7effcc06c630 2024-04-01T23:02:09.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.613+0000 7effd2cb5640 1 -- 172.21.15.47:0/4179195771 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7effcc0b2860 con 0x7effcc06c630 2024-04-01T23:02:09.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.614+0000 7effd2cb5640 1 -- 172.21.15.47:0/4179195771 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effcc06da30 con 0x7effcc06c630 2024-04-01T23:02:09.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.633+0000 7effc17fa640 1 -- 172.21.15.47:0/4179195771 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7effbc007400 con 0x7effcc06c630 2024-04-01T23:02:09.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.633+0000 7effc17fa640 1 --2- 172.21.15.47:0/4179195771 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7effb806b9e0 0x7effb806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:09.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.634+0000 7effd0a51640 1 --2- 172.21.15.47:0/4179195771 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7effb806b9e0 0x7effb806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:09.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.634+0000 7effd0a51640 1 --2- 172.21.15.47:0/4179195771 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7effb806b9e0 0x7effb806dea0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7effc8009c00 tx=0x7effc8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:02:09.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.859+0000 7effc17fa640 1 -- 172.21.15.47:0/4179195771 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7effbc056740 con 0x7effcc06c630 2024-04-01T23:02:09.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:09.869+0000 7effc17fa640 1 -- 172.21.15.47:0/4179195771 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7effcc06da30 con 0x7effcc06c630 2024-04-01T23:02:10.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.051+0000 7effd2cb5640 1 -- 172.21.15.47:0/4179195771 --> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7effcc068af0 con 0x7effb806b9e0 2024-04-01T23:02:10.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.059+0000 7effc17fa640 1 -- 172.21.15.47:0/4179195771 <== mgr.4107 v2:172.21.15.47:6800/1257047371 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334421 (secure 0 0 0) 0x7effcc068af0 con 0x7effb806b9e0 2024-04-01T23:02:10.060 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T23:02:10.062 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-01T23:02:10.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.063+0000 7effd2cb5640 1 -- 172.21.15.47:0/4179195771 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7effb806b9e0 msgr2=0x7effb806dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:10.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.063+0000 7effd2cb5640 1 --2- 172.21.15.47:0/4179195771 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7effb806b9e0 0x7effb806dea0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7effc8009c00 tx=0x7effc8009190 comp rx=0 tx=0).stop 2024-04-01T23:02:10.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.063+0000 7effd2cb5640 1 -- 172.21.15.47:0/4179195771 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7effcc06c630 msgr2=0x7effcc156fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:10.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.063+0000 7effd2cb5640 1 --2- 172.21.15.47:0/4179195771 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7effcc06c630 0x7effcc156fd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7effbc00c340 tx=0x7effbc00c800 comp rx=0 tx=0).stop 2024-04-01T23:02:10.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.063+0000 7effd2cb5640 1 -- 172.21.15.47:0/4179195771 shutdown_connections 2024-04-01T23:02:10.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.063+0000 7effd2cb5640 1 --2- 172.21.15.47:0/4179195771 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7effb806b9e0 0x7effb806dea0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:10.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.063+0000 7effd2cb5640 1 --2- 172.21.15.47:0/4179195771 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7effcc15bb20 0x7effcc1f3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:10.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.063+0000 7effd2cb5640 1 --2- 172.21.15.47:0/4179195771 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7effcc06c630 0x7effcc156fd0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:10.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.063+0000 7effd2cb5640 1 --2- 172.21.15.47:0/4179195771 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7effcc06c250 0x7effcc159150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:10.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.063+0000 7effd2cb5640 1 -- 172.21.15.47:0/4179195771 >> 172.21.15.47:0/4179195771 conn(0x7effcc0cfdb0 msgr2=0x7effcc0c71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:02:10.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.063+0000 7effd2cb5640 1 -- 172.21.15.47:0/4179195771 shutdown_connections 2024-04-01T23:02:10.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.063+0000 7effd2cb5640 1 -- 172.21.15.47:0/4179195771 wait complete. 2024-04-01T23:02:10.071 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":890,"stamp":"2024-04-01T23:02:09.145231+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":37236956,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":932,"num_read_kb":976,"num_write":13954,"num_write_kb":334382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14590,"ondisk_log_size":14590,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":361328,"kb_used_data":49456,"kb_used_omap":12,"kb_used_meta":311795,"kb_avail":754613392,"statfs":{"total":773094113280,"available":772724113408,"internally_reserved":0,"allocated":50642944,"data_stored":75426104,"data_compressed":7309368,"data_compressed_allocated":11001856,"data_compressed_original":37232640,"omap_allocated":12751,"internal_metadata":319278641},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002499"},"pg_stats":[{"pgid":"2.1f","version":"27'644","reported_seq":692,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:44.760747+0000","last_change":"2024-04-01T23:01:44.760798+0000","last_active":"2024-04-01T23:01:44.760747+0000","last_peered":"2024-04-01T23:01:44.760747+0000","last_clean":"2024-04-01T23:01:44.760747+0000","last_became_active":"2024-04-01T22:33:26.849009+0000","last_became_peered":"2024-04-01T22:33:26.849009+0000","last_unstale":"2024-04-01T23:01:44.760747+0000","last_undegraded":"2024-04-01T23:01:44.760747+0000","last_fullsized":"2024-04-01T23:01:44.760747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'644","last_scrub_stamp":"2024-04-01T23:01:44.760645+0000","last_deep_scrub":"27'644","last_deep_scrub_stamp":"2024-04-01T23:01:44.760645+0000","last_clean_scrub_stamp":"2024-04-01T23:01:44.760645+0000","objects_scrubbed":3,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:46:30.270552+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":638,"num_write_kb":4397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'23","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:49.280561+0000","last_change":"2024-04-01T23:01:49.280584+0000","last_active":"2024-04-01T23:01:49.280561+0000","last_peered":"2024-04-01T23:01:49.280561+0000","last_clean":"2024-04-01T23:01:49.280561+0000","last_became_active":"2024-04-01T22:33:27.918702+0000","last_became_peered":"2024-04-01T22:33:27.918702+0000","last_unstale":"2024-04-01T23:01:49.280561+0000","last_undegraded":"2024-04-01T23:01:49.280561+0000","last_fullsized":"2024-04-01T23:01:49.280561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'23","last_scrub_stamp":"2024-04-01T23:01:49.280497+0000","last_deep_scrub":"27'23","last_deep_scrub_stamp":"2024-04-01T23:01:49.280497+0000","last_clean_scrub_stamp":"2024-04-01T23:01:49.280497+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:44:47.579229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'149","reported_seq":187,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:02:04.345373+0000","last_change":"2024-04-01T23:02:04.345396+0000","last_active":"2024-04-01T23:02:04.345373+0000","last_peered":"2024-04-01T23:02:04.345373+0000","last_clean":"2024-04-01T23:02:04.345373+0000","last_became_active":"2024-04-01T22:33:33.254187+0000","last_became_peered":"2024-04-01T22:33:33.254187+0000","last_unstale":"2024-04-01T23:02:04.345373+0000","last_undegraded":"2024-04-01T23:02:04.345373+0000","last_fullsized":"2024-04-01T23:02:04.345373+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'149","last_scrub_stamp":"2024-04-01T23:02:04.345306+0000","last_deep_scrub":"27'149","last_deep_scrub_stamp":"2024-04-01T23:02:04.345306+0000","last_clean_scrub_stamp":"2024-04-01T23:02:04.345306+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:22:26.186667+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":7671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'718","reported_seq":767,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:50.255835+0000","last_change":"2024-04-01T23:01:50.255873+0000","last_active":"2024-04-01T23:01:50.255835+0000","last_peered":"2024-04-01T23:01:50.255835+0000","last_clean":"2024-04-01T23:01:50.255835+0000","last_became_active":"2024-04-01T22:33:26.855119+0000","last_became_peered":"2024-04-01T22:33:26.855119+0000","last_unstale":"2024-04-01T23:01:50.255835+0000","last_undegraded":"2024-04-01T23:01:50.255835+0000","last_fullsized":"2024-04-01T23:01:50.255835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'718","last_scrub_stamp":"2024-04-01T23:01:50.255731+0000","last_deep_scrub":"27'718","last_deep_scrub_stamp":"2024-04-01T23:01:50.255731+0000","last_clean_scrub_stamp":"2024-04-01T23:01:50.255731+0000","objects_scrubbed":1,"log_size":718,"log_dups_size":0,"ondisk_log_size":718,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:19:52.489144+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":714,"num_write_kb":4525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'35","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:54.744289+0000","last_change":"2024-04-01T23:01:54.744310+0000","last_active":"2024-04-01T23:01:54.744289+0000","last_peered":"2024-04-01T23:01:54.744289+0000","last_clean":"2024-04-01T23:01:54.744289+0000","last_became_active":"2024-04-01T22:33:27.973915+0000","last_became_peered":"2024-04-01T22:33:27.973915+0000","last_unstale":"2024-04-01T23:01:54.744289+0000","last_undegraded":"2024-04-01T23:01:54.744289+0000","last_fullsized":"2024-04-01T23:01:54.744289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2024-04-01T23:01:54.744218+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2024-04-01T23:01:54.744218+0000","last_clean_scrub_stamp":"2024-04-01T23:01:54.744218+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:32:35.044206+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'127","reported_seq":165,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:58.659531+0000","last_change":"2024-04-01T23:01:58.659556+0000","last_active":"2024-04-01T23:01:58.659531+0000","last_peered":"2024-04-01T23:01:58.659531+0000","last_clean":"2024-04-01T23:01:58.659531+0000","last_became_active":"2024-04-01T22:33:32.853215+0000","last_became_peered":"2024-04-01T22:33:32.853215+0000","last_unstale":"2024-04-01T23:01:58.659531+0000","last_undegraded":"2024-04-01T23:01:58.659531+0000","last_fullsized":"2024-04-01T23:01:58.659531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'127","last_scrub_stamp":"2024-04-01T23:01:58.659442+0000","last_deep_scrub":"27'127","last_deep_scrub_stamp":"2024-04-01T23:01:58.659442+0000","last_clean_scrub_stamp":"2024-04-01T23:01:58.659442+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:08:46.648537+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":8638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'1191","reported_seq":1237,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:53.306507+0000","last_change":"2024-04-01T23:01:53.306537+0000","last_active":"2024-04-01T23:01:53.306507+0000","last_peered":"2024-04-01T23:01:53.306507+0000","last_clean":"2024-04-01T23:01:53.306507+0000","last_became_active":"2024-04-01T22:33:26.849432+0000","last_became_peered":"2024-04-01T22:33:26.849432+0000","last_unstale":"2024-04-01T23:01:53.306507+0000","last_undegraded":"2024-04-01T23:01:53.306507+0000","last_fullsized":"2024-04-01T23:01:53.306507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1191","last_scrub_stamp":"2024-04-01T23:01:53.306444+0000","last_deep_scrub":"27'1191","last_deep_scrub_stamp":"2024-04-01T23:01:53.306444+0000","last_clean_scrub_stamp":"2024-04-01T23:01:53.306444+0000","objects_scrubbed":3,"log_size":1191,"log_dups_size":0,"ondisk_log_size":1191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:37:52.103286+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1179,"num_write_kb":8891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'25","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:53.587079+0000","last_change":"2024-04-01T23:01:53.587117+0000","last_active":"2024-04-01T23:01:53.587079+0000","last_peered":"2024-04-01T23:01:53.587079+0000","last_clean":"2024-04-01T23:01:53.587079+0000","last_became_active":"2024-04-01T22:34:05.289454+0000","last_became_peered":"2024-04-01T22:34:05.289454+0000","last_unstale":"2024-04-01T23:01:53.587079+0000","last_undegraded":"2024-04-01T23:01:53.587079+0000","last_fullsized":"2024-04-01T23:01:53.587079+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'25","last_scrub_stamp":"2024-04-01T23:01:53.586979+0000","last_deep_scrub":"27'25","last_deep_scrub_stamp":"2024-04-01T23:01:53.586979+0000","last_clean_scrub_stamp":"2024-04-01T23:01:53.586979+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:53:17.020604+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"27'122","reported_seq":160,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:57.612135+0000","last_change":"2024-04-01T23:01:57.612162+0000","last_active":"2024-04-01T23:01:57.612135+0000","last_peered":"2024-04-01T23:01:57.612135+0000","last_clean":"2024-04-01T23:01:57.612135+0000","last_became_active":"2024-04-01T22:33:32.846382+0000","last_became_peered":"2024-04-01T22:33:32.846382+0000","last_unstale":"2024-04-01T23:01:57.612135+0000","last_undegraded":"2024-04-01T23:01:57.612135+0000","last_fullsized":"2024-04-01T23:01:57.612135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'122","last_scrub_stamp":"2024-04-01T23:01:57.612059+0000","last_deep_scrub":"27'122","last_deep_scrub_stamp":"2024-04-01T23:01:57.612059+0000","last_clean_scrub_stamp":"2024-04-01T23:01:57.612059+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:19:59.845472+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":10048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'8","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:56.212356+0000","last_change":"2024-04-01T23:01:56.212381+0000","last_active":"2024-04-01T23:01:56.212356+0000","last_peered":"2024-04-01T23:01:56.212356+0000","last_clean":"2024-04-01T23:01:56.212356+0000","last_became_active":"2024-04-01T22:33:26.852530+0000","last_became_peered":"2024-04-01T22:33:26.852530+0000","last_unstale":"2024-04-01T23:01:56.212356+0000","last_undegraded":"2024-04-01T23:01:56.212356+0000","last_fullsized":"2024-04-01T23:01:56.212356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-01T23:01:56.212290+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-01T23:01:56.212290+0000","last_clean_scrub_stamp":"2024-04-01T23:01:56.212290+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:44:54.511022+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'45","reported_seq":89,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:48.051167+0000","last_change":"2024-04-01T23:01:48.051187+0000","last_active":"2024-04-01T23:01:48.051167+0000","last_peered":"2024-04-01T23:01:48.051167+0000","last_clean":"2024-04-01T23:01:48.051167+0000","last_became_active":"2024-04-01T22:33:27.974117+0000","last_became_peered":"2024-04-01T22:33:27.974117+0000","last_unstale":"2024-04-01T23:01:48.051167+0000","last_undegraded":"2024-04-01T23:01:48.051167+0000","last_fullsized":"2024-04-01T23:01:48.051167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2024-04-01T23:01:48.051098+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2024-04-01T23:01:48.051098+0000","last_clean_scrub_stamp":"2024-04-01T23:01:48.051098+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:36:06.033042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'133","reported_seq":171,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:52.561830+0000","last_change":"2024-04-01T23:01:52.561853+0000","last_active":"2024-04-01T23:01:52.561830+0000","last_peered":"2024-04-01T23:01:52.561830+0000","last_clean":"2024-04-01T23:01:52.561830+0000","last_became_active":"2024-04-01T22:33:32.844334+0000","last_became_peered":"2024-04-01T22:33:32.844334+0000","last_unstale":"2024-04-01T23:01:52.561830+0000","last_undegraded":"2024-04-01T23:01:52.561830+0000","last_fullsized":"2024-04-01T23:01:52.561830+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'133","last_scrub_stamp":"2024-04-01T23:01:52.561753+0000","last_deep_scrub":"27'133","last_deep_scrub_stamp":"2024-04-01T23:01:52.561753+0000","last_clean_scrub_stamp":"2024-04-01T23:01:52.561753+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:36:20.565467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":7546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'27","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:53.840346+0000","last_change":"2024-04-01T23:01:53.840366+0000","last_active":"2024-04-01T23:01:53.840346+0000","last_peered":"2024-04-01T23:01:53.840346+0000","last_clean":"2024-04-01T23:01:53.840346+0000","last_became_active":"2024-04-01T22:33:27.918466+0000","last_became_peered":"2024-04-01T22:33:27.918466+0000","last_unstale":"2024-04-01T23:01:53.840346+0000","last_undegraded":"2024-04-01T23:01:53.840346+0000","last_fullsized":"2024-04-01T23:01:53.840346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'27","last_scrub_stamp":"2024-04-01T23:01:53.840279+0000","last_deep_scrub":"27'27","last_deep_scrub_stamp":"2024-04-01T23:01:53.840279+0000","last_clean_scrub_stamp":"2024-04-01T23:01:53.840279+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:03:22.416245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'508","reported_seq":555,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:55.257339+0000","last_change":"2024-04-01T23:01:55.257383+0000","last_active":"2024-04-01T23:01:55.257339+0000","last_peered":"2024-04-01T23:01:55.257339+0000","last_clean":"2024-04-01T23:01:55.257339+0000","last_became_active":"2024-04-01T22:33:26.849954+0000","last_became_peered":"2024-04-01T22:33:26.849954+0000","last_unstale":"2024-04-01T23:01:55.257339+0000","last_undegraded":"2024-04-01T23:01:55.257339+0000","last_fullsized":"2024-04-01T23:01:55.257339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'508","last_scrub_stamp":"2024-04-01T23:01:55.257244+0000","last_deep_scrub":"27'508","last_deep_scrub_stamp":"2024-04-01T23:01:55.257244+0000","last_clean_scrub_stamp":"2024-04-01T23:01:55.257244+0000","objects_scrubbed":2,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:43:47.320048+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":502,"num_write_kb":4355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'101","reported_seq":140,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:59.688371+0000","last_change":"2024-04-01T23:01:59.688394+0000","last_active":"2024-04-01T23:01:59.688371+0000","last_peered":"2024-04-01T23:01:59.688371+0000","last_clean":"2024-04-01T23:01:59.688371+0000","last_became_active":"2024-04-01T22:33:32.853185+0000","last_became_peered":"2024-04-01T22:33:32.853185+0000","last_unstale":"2024-04-01T23:01:59.688371+0000","last_undegraded":"2024-04-01T23:01:59.688371+0000","last_fullsized":"2024-04-01T23:01:59.688371+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'101","last_scrub_stamp":"2024-04-01T23:01:59.688277+0000","last_deep_scrub":"27'101","last_deep_scrub_stamp":"2024-04-01T23:01:59.688277+0000","last_clean_scrub_stamp":"2024-04-01T23:01:59.688277+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:09:22.231832+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":9107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'34","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:47.222116+0000","last_change":"2024-04-01T23:01:47.222139+0000","last_active":"2024-04-01T23:01:47.222116+0000","last_peered":"2024-04-01T23:01:47.222116+0000","last_clean":"2024-04-01T23:01:47.222116+0000","last_became_active":"2024-04-01T22:33:27.949518+0000","last_became_peered":"2024-04-01T22:33:27.949518+0000","last_unstale":"2024-04-01T23:01:47.222116+0000","last_undegraded":"2024-04-01T23:01:47.222116+0000","last_fullsized":"2024-04-01T23:01:47.222116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'34","last_scrub_stamp":"2024-04-01T23:01:47.222046+0000","last_deep_scrub":"27'34","last_deep_scrub_stamp":"2024-04-01T23:01:47.222046+0000","last_clean_scrub_stamp":"2024-04-01T23:01:47.222046+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:18:45.782553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'2","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:49.486391+0000","last_change":"2024-04-01T23:01:49.486431+0000","last_active":"2024-04-01T23:01:49.486391+0000","last_peered":"2024-04-01T23:01:49.486391+0000","last_clean":"2024-04-01T23:01:49.486391+0000","last_became_active":"2024-04-01T22:33:26.856591+0000","last_became_peered":"2024-04-01T22:33:26.856591+0000","last_unstale":"2024-04-01T23:01:49.486391+0000","last_undegraded":"2024-04-01T23:01:49.486391+0000","last_fullsized":"2024-04-01T23:01:49.486391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-01T23:01:49.486275+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-01T23:01:49.486275+0000","last_clean_scrub_stamp":"2024-04-01T23:01:49.486275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:16:59.994928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'141","reported_seq":180,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:56.644756+0000","last_change":"2024-04-01T23:01:56.644778+0000","last_active":"2024-04-01T23:01:56.644756+0000","last_peered":"2024-04-01T23:01:56.644756+0000","last_clean":"2024-04-01T23:01:56.644756+0000","last_became_active":"2024-04-01T22:33:32.846849+0000","last_became_peered":"2024-04-01T22:33:32.846849+0000","last_unstale":"2024-04-01T23:01:56.644756+0000","last_undegraded":"2024-04-01T23:01:56.644756+0000","last_fullsized":"2024-04-01T23:01:56.644756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'141","last_scrub_stamp":"2024-04-01T23:01:56.644690+0000","last_deep_scrub":"27'141","last_deep_scrub_stamp":"2024-04-01T23:01:56.644690+0000","last_clean_scrub_stamp":"2024-04-01T23:01:56.644690+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:47:40.255619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":7884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'32","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:53.223851+0000","last_change":"2024-04-01T23:01:53.223872+0000","last_active":"2024-04-01T23:01:53.223851+0000","last_peered":"2024-04-01T23:01:53.223851+0000","last_clean":"2024-04-01T23:01:53.223851+0000","last_became_active":"2024-04-01T22:33:27.855123+0000","last_became_peered":"2024-04-01T22:33:27.855123+0000","last_unstale":"2024-04-01T23:01:53.223851+0000","last_undegraded":"2024-04-01T23:01:53.223851+0000","last_fullsized":"2024-04-01T23:01:53.223851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'32","last_scrub_stamp":"2024-04-01T23:01:53.223784+0000","last_deep_scrub":"27'32","last_deep_scrub_stamp":"2024-04-01T23:01:53.223784+0000","last_clean_scrub_stamp":"2024-04-01T23:01:53.223784+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:02:58.360137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'1","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:46.484865+0000","last_change":"2024-04-01T23:01:46.484889+0000","last_active":"2024-04-01T23:01:46.484865+0000","last_peered":"2024-04-01T23:01:46.484865+0000","last_clean":"2024-04-01T23:01:46.484865+0000","last_became_active":"2024-04-01T22:33:26.847904+0000","last_became_peered":"2024-04-01T22:33:26.847904+0000","last_unstale":"2024-04-01T23:01:46.484865+0000","last_undegraded":"2024-04-01T23:01:46.484865+0000","last_fullsized":"2024-04-01T23:01:46.484865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2024-04-01T23:01:46.484795+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2024-04-01T23:01:46.484795+0000","last_clean_scrub_stamp":"2024-04-01T23:01:46.484795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:36:04.466738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'122","reported_seq":155,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:55.535663+0000","last_change":"2024-04-01T23:01:55.535685+0000","last_active":"2024-04-01T23:01:55.535663+0000","last_peered":"2024-04-01T23:01:55.535663+0000","last_clean":"2024-04-01T23:01:55.535663+0000","last_became_active":"2024-04-01T22:34:05.289769+0000","last_became_peered":"2024-04-01T22:34:05.289769+0000","last_unstale":"2024-04-01T23:01:55.535663+0000","last_undegraded":"2024-04-01T23:01:55.535663+0000","last_fullsized":"2024-04-01T23:01:55.535663+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'122","last_scrub_stamp":"2024-04-01T23:01:55.535597+0000","last_deep_scrub":"27'122","last_deep_scrub_stamp":"2024-04-01T23:01:55.535597+0000","last_clean_scrub_stamp":"2024-04-01T23:01:55.535597+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:26:50.382410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":7582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,7],"acting":[2,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"27'32","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:48.604978+0000","last_change":"2024-04-01T23:01:48.605001+0000","last_active":"2024-04-01T23:01:48.604978+0000","last_peered":"2024-04-01T23:01:48.604978+0000","last_clean":"2024-04-01T23:01:48.604978+0000","last_became_active":"2024-04-01T22:33:27.868713+0000","last_became_peered":"2024-04-01T22:33:27.868713+0000","last_unstale":"2024-04-01T23:01:48.604978+0000","last_undegraded":"2024-04-01T23:01:48.604978+0000","last_fullsized":"2024-04-01T23:01:48.604978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'32","last_scrub_stamp":"2024-04-01T23:01:48.604900+0000","last_deep_scrub":"27'32","last_deep_scrub_stamp":"2024-04-01T23:01:48.604900+0000","last_clean_scrub_stamp":"2024-04-01T23:01:48.604900+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:09:40.354004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'5","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:51.321628+0000","last_change":"2024-04-01T23:01:51.321653+0000","last_active":"2024-04-01T23:01:51.321628+0000","last_peered":"2024-04-01T23:01:51.321628+0000","last_clean":"2024-04-01T23:01:51.321628+0000","last_became_active":"2024-04-01T22:33:26.847736+0000","last_became_peered":"2024-04-01T22:33:26.847736+0000","last_unstale":"2024-04-01T23:01:51.321628+0000","last_undegraded":"2024-04-01T23:01:51.321628+0000","last_fullsized":"2024-04-01T23:01:51.321628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-01T23:01:51.321534+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-01T23:01:51.321534+0000","last_clean_scrub_stamp":"2024-04-01T23:01:51.321534+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:39:42.225460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'108","reported_seq":147,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:55.605176+0000","last_change":"2024-04-01T23:01:55.605198+0000","last_active":"2024-04-01T23:01:55.605176+0000","last_peered":"2024-04-01T23:01:55.605176+0000","last_clean":"2024-04-01T23:01:55.605176+0000","last_became_active":"2024-04-01T22:33:32.846639+0000","last_became_peered":"2024-04-01T22:33:32.846639+0000","last_unstale":"2024-04-01T23:01:55.605176+0000","last_undegraded":"2024-04-01T23:01:55.605176+0000","last_fullsized":"2024-04-01T23:01:55.605176+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'108","last_scrub_stamp":"2024-04-01T23:01:55.605108+0000","last_deep_scrub":"27'108","last_deep_scrub_stamp":"2024-04-01T23:01:55.605108+0000","last_clean_scrub_stamp":"2024-04-01T23:01:55.605108+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:02:22.470092+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":8005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'39","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:46.748393+0000","last_change":"2024-04-01T23:01:46.748431+0000","last_active":"2024-04-01T23:01:46.748393+0000","last_peered":"2024-04-01T23:01:46.748393+0000","last_clean":"2024-04-01T23:01:46.748393+0000","last_became_active":"2024-04-01T22:33:27.947735+0000","last_became_peered":"2024-04-01T22:33:27.947735+0000","last_unstale":"2024-04-01T23:01:46.748393+0000","last_undegraded":"2024-04-01T23:01:46.748393+0000","last_fullsized":"2024-04-01T23:01:46.748393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2024-04-01T23:01:46.748288+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2024-04-01T23:01:46.748288+0000","last_clean_scrub_stamp":"2024-04-01T23:01:46.748288+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:39:37.652214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'10","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:51.808867+0000","last_change":"2024-04-01T23:01:51.808893+0000","last_active":"2024-04-01T23:01:51.808867+0000","last_peered":"2024-04-01T23:01:51.808867+0000","last_clean":"2024-04-01T23:01:51.808867+0000","last_became_active":"2024-04-01T22:33:26.849086+0000","last_became_peered":"2024-04-01T22:33:26.849086+0000","last_unstale":"2024-04-01T23:01:51.808867+0000","last_undegraded":"2024-04-01T23:01:51.808867+0000","last_fullsized":"2024-04-01T23:01:51.808867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-04-01T23:01:51.808800+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-04-01T23:01:51.808800+0000","last_clean_scrub_stamp":"2024-04-01T23:01:51.808800+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:46:37.318707+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'117","reported_seq":157,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:02:00.698248+0000","last_change":"2024-04-01T23:02:00.698288+0000","last_active":"2024-04-01T23:02:00.698248+0000","last_peered":"2024-04-01T23:02:00.698248+0000","last_clean":"2024-04-01T23:02:00.698248+0000","last_became_active":"2024-04-01T22:33:33.249309+0000","last_became_peered":"2024-04-01T22:33:33.249309+0000","last_unstale":"2024-04-01T23:02:00.698248+0000","last_undegraded":"2024-04-01T23:02:00.698248+0000","last_fullsized":"2024-04-01T23:02:00.698248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'117","last_scrub_stamp":"2024-04-01T23:02:00.698159+0000","last_deep_scrub":"27'117","last_deep_scrub_stamp":"2024-04-01T23:02:00.698159+0000","last_clean_scrub_stamp":"2024-04-01T23:02:00.698159+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:11:13.831746+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":13518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'31","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:56.295962+0000","last_change":"2024-04-01T23:01:56.296002+0000","last_active":"2024-04-01T23:01:56.295962+0000","last_peered":"2024-04-01T23:01:56.295962+0000","last_clean":"2024-04-01T23:01:56.295962+0000","last_became_active":"2024-04-01T22:33:27.879582+0000","last_became_peered":"2024-04-01T22:33:27.879582+0000","last_unstale":"2024-04-01T23:01:56.295962+0000","last_undegraded":"2024-04-01T23:01:56.295962+0000","last_fullsized":"2024-04-01T23:01:56.295962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'31","last_scrub_stamp":"2024-04-01T23:01:56.295870+0000","last_deep_scrub":"27'31","last_deep_scrub_stamp":"2024-04-01T23:01:56.295870+0000","last_clean_scrub_stamp":"2024-04-01T23:01:56.295870+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:30:35.146470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'1318","reported_seq":1366,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:45.512098+0000","last_change":"2024-04-01T23:01:45.512123+0000","last_active":"2024-04-01T23:01:45.512098+0000","last_peered":"2024-04-01T23:01:45.512098+0000","last_clean":"2024-04-01T23:01:45.512098+0000","last_became_active":"2024-04-01T22:33:26.847333+0000","last_became_peered":"2024-04-01T22:33:26.847333+0000","last_unstale":"2024-04-01T23:01:45.512098+0000","last_undegraded":"2024-04-01T23:01:45.512098+0000","last_fullsized":"2024-04-01T23:01:45.512098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1318","last_scrub_stamp":"2024-04-01T23:01:45.512035+0000","last_deep_scrub":"27'1318","last_deep_scrub_stamp":"2024-04-01T23:01:45.512035+0000","last_clean_scrub_stamp":"2024-04-01T23:01:45.512035+0000","objects_scrubbed":1,"log_size":1318,"log_dups_size":0,"ondisk_log_size":1318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:46:31.021942+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3324,"num_write_kb":1182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'132","reported_seq":173,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:02:03.360994+0000","last_change":"2024-04-01T23:02:03.361025+0000","last_active":"2024-04-01T23:02:03.360994+0000","last_peered":"2024-04-01T23:02:03.360994+0000","last_clean":"2024-04-01T23:02:03.360994+0000","last_became_active":"2024-04-01T22:33:33.254621+0000","last_became_peered":"2024-04-01T22:33:33.254621+0000","last_unstale":"2024-04-01T23:02:03.360994+0000","last_undegraded":"2024-04-01T23:02:03.360994+0000","last_fullsized":"2024-04-01T23:02:03.360994+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'132","last_scrub_stamp":"2024-04-01T23:02:03.360910+0000","last_deep_scrub":"27'132","last_deep_scrub_stamp":"2024-04-01T23:02:03.360910+0000","last_clean_scrub_stamp":"2024-04-01T23:02:03.360910+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:04:22.968878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":7706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'30","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:51.420994+0000","last_change":"2024-04-01T23:01:51.421015+0000","last_active":"2024-04-01T23:01:51.420994+0000","last_peered":"2024-04-01T23:01:51.420994+0000","last_clean":"2024-04-01T23:01:51.420994+0000","last_became_active":"2024-04-01T22:33:27.855419+0000","last_became_peered":"2024-04-01T22:33:27.855419+0000","last_unstale":"2024-04-01T23:01:51.420994+0000","last_undegraded":"2024-04-01T23:01:51.420994+0000","last_fullsized":"2024-04-01T23:01:51.420994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2024-04-01T23:01:51.420925+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2024-04-01T23:01:51.420925+0000","last_clean_scrub_stamp":"2024-04-01T23:01:51.420925+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:44:49.719657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'2","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:54.268843+0000","last_change":"2024-04-01T23:01:54.268875+0000","last_active":"2024-04-01T23:01:54.268843+0000","last_peered":"2024-04-01T23:01:54.268843+0000","last_clean":"2024-04-01T23:01:54.268843+0000","last_became_active":"2024-04-01T22:33:26.849717+0000","last_became_peered":"2024-04-01T22:33:26.849717+0000","last_unstale":"2024-04-01T23:01:54.268843+0000","last_undegraded":"2024-04-01T23:01:54.268843+0000","last_fullsized":"2024-04-01T23:01:54.268843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-01T23:01:54.268775+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-01T23:01:54.268775+0000","last_clean_scrub_stamp":"2024-04-01T23:01:54.268775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:17:04.777427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'123","reported_seq":163,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:57.781390+0000","last_change":"2024-04-01T23:01:57.781436+0000","last_active":"2024-04-01T23:01:57.781390+0000","last_peered":"2024-04-01T23:01:57.781390+0000","last_clean":"2024-04-01T23:01:57.781390+0000","last_became_active":"2024-04-01T22:33:33.249370+0000","last_became_peered":"2024-04-01T22:33:33.249370+0000","last_unstale":"2024-04-01T23:01:57.781390+0000","last_undegraded":"2024-04-01T23:01:57.781390+0000","last_fullsized":"2024-04-01T23:01:57.781390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'123","last_scrub_stamp":"2024-04-01T23:01:57.781301+0000","last_deep_scrub":"27'123","last_deep_scrub_stamp":"2024-04-01T23:01:57.781301+0000","last_clean_scrub_stamp":"2024-04-01T23:01:57.781301+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:45:51.121995+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":9230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'30","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:02:01.014712+0000","last_change":"2024-04-01T23:02:01.014734+0000","last_active":"2024-04-01T23:02:01.014712+0000","last_peered":"2024-04-01T23:02:01.014712+0000","last_clean":"2024-04-01T23:02:01.014712+0000","last_became_active":"2024-04-01T22:33:27.978902+0000","last_became_peered":"2024-04-01T22:33:27.978902+0000","last_unstale":"2024-04-01T23:02:01.014712+0000","last_undegraded":"2024-04-01T23:02:01.014712+0000","last_fullsized":"2024-04-01T23:02:01.014712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2024-04-01T23:02:01.014627+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2024-04-01T23:02:01.014627+0000","last_clean_scrub_stamp":"2024-04-01T23:02:01.014627+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:33:08.787890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'1","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:44.496195+0000","last_change":"2024-04-01T23:01:44.496216+0000","last_active":"2024-04-01T23:01:44.496195+0000","last_peered":"2024-04-01T23:01:44.496195+0000","last_clean":"2024-04-01T23:01:44.496195+0000","last_became_active":"2024-04-01T22:33:26.846265+0000","last_became_peered":"2024-04-01T22:33:26.846265+0000","last_unstale":"2024-04-01T23:01:44.496195+0000","last_undegraded":"2024-04-01T23:01:44.496195+0000","last_fullsized":"2024-04-01T23:01:44.496195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2024-04-01T23:01:44.496119+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2024-04-01T23:01:44.496119+0000","last_clean_scrub_stamp":"2024-04-01T23:01:44.496119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:53:07.929744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'159","reported_seq":199,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:58.474401+0000","last_change":"2024-04-01T23:01:58.474424+0000","last_active":"2024-04-01T23:01:58.474401+0000","last_peered":"2024-04-01T23:01:58.474401+0000","last_clean":"2024-04-01T23:01:58.474401+0000","last_became_active":"2024-04-01T22:33:32.849774+0000","last_became_peered":"2024-04-01T22:33:32.849774+0000","last_unstale":"2024-04-01T23:01:58.474401+0000","last_undegraded":"2024-04-01T23:01:58.474401+0000","last_fullsized":"2024-04-01T23:01:58.474401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'159","last_scrub_stamp":"2024-04-01T23:01:58.474328+0000","last_deep_scrub":"27'159","last_deep_scrub_stamp":"2024-04-01T23:01:58.474328+0000","last_clean_scrub_stamp":"2024-04-01T23:01:58.474328+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:30:37.324929+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":7876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'30","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:51.577300+0000","last_change":"2024-04-01T23:01:51.577337+0000","last_active":"2024-04-01T23:01:51.577300+0000","last_peered":"2024-04-01T23:01:51.577300+0000","last_clean":"2024-04-01T23:01:51.577300+0000","last_became_active":"2024-04-01T22:33:27.949620+0000","last_became_peered":"2024-04-01T22:33:27.949620+0000","last_unstale":"2024-04-01T23:01:51.577300+0000","last_undegraded":"2024-04-01T23:01:51.577300+0000","last_fullsized":"2024-04-01T23:01:51.577300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2024-04-01T23:01:51.577174+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2024-04-01T23:01:51.577174+0000","last_clean_scrub_stamp":"2024-04-01T23:01:51.577174+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:03:20.153140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'4","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:53.006991+0000","last_change":"2024-04-01T23:01:53.007012+0000","last_active":"2024-04-01T23:01:53.006991+0000","last_peered":"2024-04-01T23:01:53.006991+0000","last_clean":"2024-04-01T23:01:53.006991+0000","last_became_active":"2024-04-01T22:33:26.846052+0000","last_became_peered":"2024-04-01T22:33:26.846052+0000","last_unstale":"2024-04-01T23:01:53.006991+0000","last_undegraded":"2024-04-01T23:01:53.006991+0000","last_fullsized":"2024-04-01T23:01:53.006991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-01T23:01:53.006918+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-01T23:01:53.006918+0000","last_clean_scrub_stamp":"2024-04-01T23:01:53.006918+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:10:34.214639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'111","reported_seq":151,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:57.431597+0000","last_change":"2024-04-01T23:01:57.431619+0000","last_active":"2024-04-01T23:01:57.431597+0000","last_peered":"2024-04-01T23:01:57.431597+0000","last_clean":"2024-04-01T23:01:57.431597+0000","last_became_active":"2024-04-01T22:33:32.846422+0000","last_became_peered":"2024-04-01T22:33:32.846422+0000","last_unstale":"2024-04-01T23:01:57.431597+0000","last_undegraded":"2024-04-01T23:01:57.431597+0000","last_fullsized":"2024-04-01T23:01:57.431597+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'111","last_scrub_stamp":"2024-04-01T23:01:57.431526+0000","last_deep_scrub":"27'111","last_deep_scrub_stamp":"2024-04-01T23:01:57.431526+0000","last_clean_scrub_stamp":"2024-04-01T23:01:57.431526+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:45:50.772219+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":8847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'31","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:50.467924+0000","last_change":"2024-04-01T23:01:50.467946+0000","last_active":"2024-04-01T23:01:50.467924+0000","last_peered":"2024-04-01T23:01:50.467924+0000","last_clean":"2024-04-01T23:01:50.467924+0000","last_became_active":"2024-04-01T22:33:27.855035+0000","last_became_peered":"2024-04-01T22:33:27.855035+0000","last_unstale":"2024-04-01T23:01:50.467924+0000","last_undegraded":"2024-04-01T23:01:50.467924+0000","last_fullsized":"2024-04-01T23:01:50.467924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'31","last_scrub_stamp":"2024-04-01T23:01:50.467846+0000","last_deep_scrub":"27'31","last_deep_scrub_stamp":"2024-04-01T23:01:50.467846+0000","last_clean_scrub_stamp":"2024-04-01T23:01:50.467846+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:43:42.530650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'821","reported_seq":1685,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:48.533654+0000","last_change":"2024-04-01T23:01:48.533679+0000","last_active":"2024-04-01T23:01:48.533654+0000","last_peered":"2024-04-01T23:01:48.533654+0000","last_clean":"2024-04-01T23:01:48.533654+0000","last_became_active":"2024-04-01T22:33:26.855864+0000","last_became_peered":"2024-04-01T22:33:26.855864+0000","last_unstale":"2024-04-01T23:01:48.533654+0000","last_undegraded":"2024-04-01T23:01:48.533654+0000","last_fullsized":"2024-04-01T23:01:48.533654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'821","last_scrub_stamp":"2024-04-01T23:01:48.533585+0000","last_deep_scrub":"27'821","last_deep_scrub_stamp":"2024-04-01T23:01:48.533585+0000","last_clean_scrub_stamp":"2024-04-01T23:01:48.533585+0000","objects_scrubbed":1,"log_size":821,"log_dups_size":0,"ondisk_log_size":821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:36:52.468267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188865,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":816,"num_read_kb":876,"num_write":818,"num_write_kb":878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'133","reported_seq":166,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:56.572671+0000","last_change":"2024-04-01T23:01:56.572696+0000","last_active":"2024-04-01T23:01:56.572671+0000","last_peered":"2024-04-01T23:01:56.572671+0000","last_clean":"2024-04-01T23:01:56.572671+0000","last_became_active":"2024-04-01T22:34:05.316665+0000","last_became_peered":"2024-04-01T22:34:05.316665+0000","last_unstale":"2024-04-01T23:01:56.572671+0000","last_undegraded":"2024-04-01T23:01:56.572671+0000","last_fullsized":"2024-04-01T23:01:56.572671+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'133","last_scrub_stamp":"2024-04-01T23:01:56.572600+0000","last_deep_scrub":"27'133","last_deep_scrub_stamp":"2024-04-01T23:01:56.572600+0000","last_clean_scrub_stamp":"2024-04-01T23:01:56.572600+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:03:25.148566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":5930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"27'23","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:50.752268+0000","last_change":"2024-04-01T23:01:50.752309+0000","last_active":"2024-04-01T23:01:50.752268+0000","last_peered":"2024-04-01T23:01:50.752268+0000","last_clean":"2024-04-01T23:01:50.752268+0000","last_became_active":"2024-04-01T22:33:27.948687+0000","last_became_peered":"2024-04-01T22:33:27.948687+0000","last_unstale":"2024-04-01T23:01:50.752268+0000","last_undegraded":"2024-04-01T23:01:50.752268+0000","last_fullsized":"2024-04-01T23:01:50.752268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'23","last_scrub_stamp":"2024-04-01T23:01:50.752194+0000","last_deep_scrub":"27'23","last_deep_scrub_stamp":"2024-04-01T23:01:50.752194+0000","last_clean_scrub_stamp":"2024-04-01T23:01:50.752194+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:10:31.959915+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'280","reported_seq":329,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:52.282388+0000","last_change":"2024-04-01T23:01:52.282411+0000","last_active":"2024-04-01T23:01:52.282388+0000","last_peered":"2024-04-01T23:01:52.282388+0000","last_clean":"2024-04-01T23:01:52.282388+0000","last_became_active":"2024-04-01T22:33:26.848019+0000","last_became_peered":"2024-04-01T22:33:26.848019+0000","last_unstale":"2024-04-01T23:01:52.282388+0000","last_undegraded":"2024-04-01T23:01:52.282388+0000","last_fullsized":"2024-04-01T23:01:52.282388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'280","last_scrub_stamp":"2024-04-01T23:01:52.282314+0000","last_deep_scrub":"27'280","last_deep_scrub_stamp":"2024-04-01T23:01:52.282314+0000","last_clean_scrub_stamp":"2024-04-01T23:01:52.282314+0000","objects_scrubbed":1,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:35:31.038436+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2901821,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":275,"num_write_kb":2970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'118","reported_seq":158,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:59.790196+0000","last_change":"2024-04-01T23:01:59.790219+0000","last_active":"2024-04-01T23:01:59.790196+0000","last_peered":"2024-04-01T23:01:59.790196+0000","last_clean":"2024-04-01T23:01:59.790196+0000","last_became_active":"2024-04-01T22:33:33.252725+0000","last_became_peered":"2024-04-01T22:33:33.252725+0000","last_unstale":"2024-04-01T23:01:59.790196+0000","last_undegraded":"2024-04-01T23:01:59.790196+0000","last_fullsized":"2024-04-01T23:01:59.790196+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'118","last_scrub_stamp":"2024-04-01T23:01:59.790123+0000","last_deep_scrub":"27'118","last_deep_scrub_stamp":"2024-04-01T23:01:59.790123+0000","last_clean_scrub_stamp":"2024-04-01T23:01:59.790123+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:33:07.563387+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":6978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'30","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:58.276761+0000","last_change":"2024-04-01T23:01:58.276800+0000","last_active":"2024-04-01T23:01:58.276761+0000","last_peered":"2024-04-01T23:01:58.276761+0000","last_clean":"2024-04-01T23:01:58.276761+0000","last_became_active":"2024-04-01T22:33:27.974751+0000","last_became_peered":"2024-04-01T22:33:27.974751+0000","last_unstale":"2024-04-01T23:01:58.276761+0000","last_undegraded":"2024-04-01T23:01:58.276761+0000","last_fullsized":"2024-04-01T23:01:58.276761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2024-04-01T23:01:58.276676+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2024-04-01T23:01:58.276676+0000","last_clean_scrub_stamp":"2024-04-01T23:01:58.276676+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:12:02.261210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:49.990093+0000","last_change":"2024-04-01T23:01:49.990121+0000","last_active":"2024-04-01T23:01:49.990093+0000","last_peered":"2024-04-01T23:01:49.990093+0000","last_clean":"2024-04-01T23:01:49.990093+0000","last_became_active":"2024-04-01T22:33:26.831398+0000","last_became_peered":"2024-04-01T22:33:26.831398+0000","last_unstale":"2024-04-01T23:01:49.990093+0000","last_undegraded":"2024-04-01T23:01:49.990093+0000","last_fullsized":"2024-04-01T23:01:49.990093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-01T23:01:49.990022+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-01T23:01:49.990022+0000","last_clean_scrub_stamp":"2024-04-01T23:01:49.990022+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:35:28.746144+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":207,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:50.286858+0000","last_change":"2024-04-01T23:01:50.286910+0000","last_active":"2024-04-01T23:01:50.286858+0000","last_peered":"2024-04-01T23:01:50.286858+0000","last_clean":"2024-04-01T23:01:50.286858+0000","last_became_active":"2024-04-01T22:33:15.961762+0000","last_became_peered":"2024-04-01T22:33:15.961762+0000","last_unstale":"2024-04-01T23:01:50.286858+0000","last_undegraded":"2024-04-01T23:01:50.286858+0000","last_fullsized":"2024-04-01T23:01:50.286858+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2024-04-01T23:01:50.286743+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2024-04-01T23:01:50.286743+0000","last_clean_scrub_stamp":"2024-04-01T23:01:50.286743+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:00:53.018838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'139","reported_seq":179,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:02:02.829836+0000","last_change":"2024-04-01T23:02:02.829861+0000","last_active":"2024-04-01T23:02:02.829836+0000","last_peered":"2024-04-01T23:02:02.829836+0000","last_clean":"2024-04-01T23:02:02.829836+0000","last_became_active":"2024-04-01T22:33:33.252494+0000","last_became_peered":"2024-04-01T22:33:33.252494+0000","last_unstale":"2024-04-01T23:02:02.829836+0000","last_undegraded":"2024-04-01T23:02:02.829836+0000","last_fullsized":"2024-04-01T23:02:02.829836+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'139","last_scrub_stamp":"2024-04-01T23:02:02.829760+0000","last_deep_scrub":"27'139","last_deep_scrub_stamp":"2024-04-01T23:02:02.829760+0000","last_clean_scrub_stamp":"2024-04-01T23:02:02.829760+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:45:56.170453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":7634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'31","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:02:05.203400+0000","last_change":"2024-04-01T23:02:05.203421+0000","last_active":"2024-04-01T23:02:05.203400+0000","last_peered":"2024-04-01T23:02:05.203400+0000","last_clean":"2024-04-01T23:02:05.203400+0000","last_became_active":"2024-04-01T22:34:04.936886+0000","last_became_peered":"2024-04-01T22:34:04.936886+0000","last_unstale":"2024-04-01T23:02:05.203400+0000","last_undegraded":"2024-04-01T23:02:05.203400+0000","last_fullsized":"2024-04-01T23:02:05.203400+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'31","last_scrub_stamp":"2024-04-01T23:02:05.203337+0000","last_deep_scrub":"27'31","last_deep_scrub_stamp":"2024-04-01T23:02:05.203337+0000","last_clean_scrub_stamp":"2024-04-01T23:02:05.203337+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:29:17.656851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'6","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:45.590249+0000","last_change":"2024-04-01T23:01:45.590269+0000","last_active":"2024-04-01T23:01:45.590249+0000","last_peered":"2024-04-01T23:01:45.590249+0000","last_clean":"2024-04-01T23:01:45.590249+0000","last_became_active":"2024-04-01T22:33:26.832078+0000","last_became_peered":"2024-04-01T22:33:26.832078+0000","last_unstale":"2024-04-01T23:01:45.590249+0000","last_undegraded":"2024-04-01T23:01:45.590249+0000","last_fullsized":"2024-04-01T23:01:45.590249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-01T23:01:45.590183+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-01T23:01:45.590183+0000","last_clean_scrub_stamp":"2024-04-01T23:01:45.590183+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:33:20.860069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'107","reported_seq":147,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:02:01.829545+0000","last_change":"2024-04-01T23:02:01.829568+0000","last_active":"2024-04-01T23:02:01.829545+0000","last_peered":"2024-04-01T23:02:01.829545+0000","last_clean":"2024-04-01T23:02:01.829545+0000","last_became_active":"2024-04-01T22:33:33.249313+0000","last_became_peered":"2024-04-01T22:33:33.249313+0000","last_unstale":"2024-04-01T23:02:01.829545+0000","last_undegraded":"2024-04-01T23:02:01.829545+0000","last_fullsized":"2024-04-01T23:02:01.829545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'107","last_scrub_stamp":"2024-04-01T23:02:01.829456+0000","last_deep_scrub":"27'107","last_deep_scrub_stamp":"2024-04-01T23:02:01.829456+0000","last_clean_scrub_stamp":"2024-04-01T23:02:01.829456+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:43:48.744363+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":3624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'31","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:55.008067+0000","last_change":"2024-04-01T23:01:55.008088+0000","last_active":"2024-04-01T23:01:55.008067+0000","last_peered":"2024-04-01T23:01:55.008067+0000","last_clean":"2024-04-01T23:01:55.008067+0000","last_became_active":"2024-04-01T22:33:27.971672+0000","last_became_peered":"2024-04-01T22:33:27.971672+0000","last_unstale":"2024-04-01T23:01:55.008067+0000","last_undegraded":"2024-04-01T23:01:55.008067+0000","last_fullsized":"2024-04-01T23:01:55.008067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'31","last_scrub_stamp":"2024-04-01T23:01:55.008000+0000","last_deep_scrub":"27'31","last_deep_scrub_stamp":"2024-04-01T23:01:55.008000+0000","last_clean_scrub_stamp":"2024-04-01T23:01:55.008000+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:27:14.306546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'3","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:47.487584+0000","last_change":"2024-04-01T23:01:47.487617+0000","last_active":"2024-04-01T23:01:47.487584+0000","last_peered":"2024-04-01T23:01:47.487584+0000","last_clean":"2024-04-01T23:01:47.487584+0000","last_became_active":"2024-04-01T22:33:26.849098+0000","last_became_peered":"2024-04-01T22:33:26.849098+0000","last_unstale":"2024-04-01T23:01:47.487584+0000","last_undegraded":"2024-04-01T23:01:47.487584+0000","last_fullsized":"2024-04-01T23:01:47.487584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-01T23:01:47.487508+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-01T23:01:47.487508+0000","last_clean_scrub_stamp":"2024-04-01T23:01:47.487508+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:03:16.063474+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'171","reported_seq":210,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:56.761632+0000","last_change":"2024-04-01T23:01:56.761655+0000","last_active":"2024-04-01T23:01:56.761632+0000","last_peered":"2024-04-01T23:01:56.761632+0000","last_clean":"2024-04-01T23:01:56.761632+0000","last_became_active":"2024-04-01T22:33:32.847546+0000","last_became_peered":"2024-04-01T22:33:32.847546+0000","last_unstale":"2024-04-01T23:01:56.761632+0000","last_undegraded":"2024-04-01T23:01:56.761632+0000","last_fullsized":"2024-04-01T23:01:56.761632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'171","last_scrub_stamp":"2024-04-01T23:01:56.761561+0000","last_deep_scrub":"27'171","last_deep_scrub_stamp":"2024-04-01T23:01:56.761561+0000","last_clean_scrub_stamp":"2024-04-01T23:01:56.761561+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:43:43.676468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":10714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'32","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:58.173199+0000","last_change":"2024-04-01T23:01:58.173222+0000","last_active":"2024-04-01T23:01:58.173199+0000","last_peered":"2024-04-01T23:01:58.173199+0000","last_clean":"2024-04-01T23:01:58.173199+0000","last_became_active":"2024-04-01T22:33:27.880870+0000","last_became_peered":"2024-04-01T22:33:27.880870+0000","last_unstale":"2024-04-01T23:01:58.173199+0000","last_undegraded":"2024-04-01T23:01:58.173199+0000","last_fullsized":"2024-04-01T23:01:58.173199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'32","last_scrub_stamp":"2024-04-01T23:01:58.173126+0000","last_deep_scrub":"27'32","last_deep_scrub_stamp":"2024-04-01T23:01:58.173126+0000","last_clean_scrub_stamp":"2024-04-01T23:01:58.173126+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:45:16.001623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'6","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:47.574985+0000","last_change":"2024-04-01T23:01:47.575009+0000","last_active":"2024-04-01T23:01:47.574985+0000","last_peered":"2024-04-01T23:01:47.574985+0000","last_clean":"2024-04-01T23:01:47.574985+0000","last_became_active":"2024-04-01T22:33:26.855705+0000","last_became_peered":"2024-04-01T22:33:26.855705+0000","last_unstale":"2024-04-01T23:01:47.574985+0000","last_undegraded":"2024-04-01T23:01:47.574985+0000","last_fullsized":"2024-04-01T23:01:47.574985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-01T23:01:47.574928+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-01T23:01:47.574928+0000","last_clean_scrub_stamp":"2024-04-01T23:01:47.574928+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:38:49.978137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'124","reported_seq":164,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:02:04.047559+0000","last_change":"2024-04-01T23:02:04.047599+0000","last_active":"2024-04-01T23:02:04.047559+0000","last_peered":"2024-04-01T23:02:04.047559+0000","last_clean":"2024-04-01T23:02:04.047559+0000","last_became_active":"2024-04-01T22:33:33.249315+0000","last_became_peered":"2024-04-01T22:33:33.249315+0000","last_unstale":"2024-04-01T23:02:04.047559+0000","last_undegraded":"2024-04-01T23:02:04.047559+0000","last_fullsized":"2024-04-01T23:02:04.047559+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'124","last_scrub_stamp":"2024-04-01T23:02:04.047452+0000","last_deep_scrub":"27'124","last_deep_scrub_stamp":"2024-04-01T23:02:04.047452+0000","last_clean_scrub_stamp":"2024-04-01T23:02:04.047452+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:10:39.193503+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":11773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'20","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:59.209954+0000","last_change":"2024-04-01T23:01:59.210001+0000","last_active":"2024-04-01T23:01:59.209954+0000","last_peered":"2024-04-01T23:01:59.209954+0000","last_clean":"2024-04-01T23:01:59.209954+0000","last_became_active":"2024-04-01T22:33:27.880973+0000","last_became_peered":"2024-04-01T22:33:27.880973+0000","last_unstale":"2024-04-01T23:01:59.209954+0000","last_undegraded":"2024-04-01T23:01:59.209954+0000","last_fullsized":"2024-04-01T23:01:59.209954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2024-04-01T23:01:59.209863+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2024-04-01T23:01:59.209863+0000","last_clean_scrub_stamp":"2024-04-01T23:01:59.209863+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:03:04.346216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'5","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:46.601927+0000","last_change":"2024-04-01T23:01:46.602006+0000","last_active":"2024-04-01T23:01:46.601927+0000","last_peered":"2024-04-01T23:01:46.601927+0000","last_clean":"2024-04-01T23:01:46.601927+0000","last_became_active":"2024-04-01T22:33:26.844852+0000","last_became_peered":"2024-04-01T22:33:26.844852+0000","last_unstale":"2024-04-01T23:01:46.601927+0000","last_undegraded":"2024-04-01T23:01:46.601927+0000","last_fullsized":"2024-04-01T23:01:46.601927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-01T23:01:46.601853+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-01T23:01:46.601853+0000","last_clean_scrub_stamp":"2024-04-01T23:01:46.601853+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:40:19.435472+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'146","reported_seq":186,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:54.591036+0000","last_change":"2024-04-01T23:01:54.591059+0000","last_active":"2024-04-01T23:01:54.591036+0000","last_peered":"2024-04-01T23:01:54.591036+0000","last_clean":"2024-04-01T23:01:54.591036+0000","last_became_active":"2024-04-01T22:33:32.846387+0000","last_became_peered":"2024-04-01T22:33:32.846387+0000","last_unstale":"2024-04-01T23:01:54.591036+0000","last_undegraded":"2024-04-01T23:01:54.591036+0000","last_fullsized":"2024-04-01T23:01:54.591036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'146","last_scrub_stamp":"2024-04-01T23:01:54.590922+0000","last_deep_scrub":"27'146","last_deep_scrub_stamp":"2024-04-01T23:01:54.590922+0000","last_clean_scrub_stamp":"2024-04-01T23:01:54.590922+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:43:46.653725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":12308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'32","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:02:01.226287+0000","last_change":"2024-04-01T23:02:01.226311+0000","last_active":"2024-04-01T23:02:01.226287+0000","last_peered":"2024-04-01T23:02:01.226287+0000","last_clean":"2024-04-01T23:02:01.226287+0000","last_became_active":"2024-04-01T22:33:27.884148+0000","last_became_peered":"2024-04-01T22:33:27.884148+0000","last_unstale":"2024-04-01T23:02:01.226287+0000","last_undegraded":"2024-04-01T23:02:01.226287+0000","last_fullsized":"2024-04-01T23:02:01.226287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'32","last_scrub_stamp":"2024-04-01T23:02:01.226218+0000","last_deep_scrub":"27'32","last_deep_scrub_stamp":"2024-04-01T23:02:01.226218+0000","last_clean_scrub_stamp":"2024-04-01T23:02:01.226218+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:45:54.566911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'20","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:46.567141+0000","last_change":"2024-04-01T23:01:46.567169+0000","last_active":"2024-04-01T23:01:46.567141+0000","last_peered":"2024-04-01T23:01:46.567141+0000","last_clean":"2024-04-01T23:01:46.567141+0000","last_became_active":"2024-04-01T22:33:26.844583+0000","last_became_peered":"2024-04-01T22:33:26.844583+0000","last_unstale":"2024-04-01T23:01:46.567141+0000","last_undegraded":"2024-04-01T23:01:46.567141+0000","last_fullsized":"2024-04-01T23:01:46.567141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2024-04-01T23:01:46.567082+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2024-04-01T23:01:46.567082+0000","last_clean_scrub_stamp":"2024-04-01T23:01:46.567082+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:45:14.871559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'120","reported_seq":158,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:55.782775+0000","last_change":"2024-04-01T23:01:55.782798+0000","last_active":"2024-04-01T23:01:55.782775+0000","last_peered":"2024-04-01T23:01:55.782775+0000","last_clean":"2024-04-01T23:01:55.782775+0000","last_became_active":"2024-04-01T22:33:32.844555+0000","last_became_peered":"2024-04-01T22:33:32.844555+0000","last_unstale":"2024-04-01T23:01:55.782775+0000","last_undegraded":"2024-04-01T23:01:55.782775+0000","last_fullsized":"2024-04-01T23:01:55.782775+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'120","last_scrub_stamp":"2024-04-01T23:01:55.782705+0000","last_deep_scrub":"27'120","last_deep_scrub_stamp":"2024-04-01T23:01:55.782705+0000","last_clean_scrub_stamp":"2024-04-01T23:01:55.782705+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:03:00.919058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":6363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'25","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:57.799460+0000","last_change":"2024-04-01T23:01:57.799482+0000","last_active":"2024-04-01T23:01:57.799460+0000","last_peered":"2024-04-01T23:01:57.799460+0000","last_clean":"2024-04-01T23:01:57.799460+0000","last_became_active":"2024-04-01T22:33:27.949366+0000","last_became_peered":"2024-04-01T22:33:27.949366+0000","last_unstale":"2024-04-01T23:01:57.799460+0000","last_undegraded":"2024-04-01T23:01:57.799460+0000","last_fullsized":"2024-04-01T23:01:57.799460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'25","last_scrub_stamp":"2024-04-01T23:01:57.799394+0000","last_deep_scrub":"27'25","last_deep_scrub_stamp":"2024-04-01T23:01:57.799394+0000","last_clean_scrub_stamp":"2024-04-01T23:01:57.799394+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:44:56.098126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'3","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:48.841924+0000","last_change":"2024-04-01T23:01:48.841954+0000","last_active":"2024-04-01T23:01:48.841924+0000","last_peered":"2024-04-01T23:01:48.841924+0000","last_clean":"2024-04-01T23:01:48.841924+0000","last_became_active":"2024-04-01T22:33:26.830179+0000","last_became_peered":"2024-04-01T22:33:26.830179+0000","last_unstale":"2024-04-01T23:01:48.841924+0000","last_undegraded":"2024-04-01T23:01:48.841924+0000","last_fullsized":"2024-04-01T23:01:48.841924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-01T23:01:48.841823+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-01T23:01:48.841823+0000","last_clean_scrub_stamp":"2024-04-01T23:01:48.841823+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:19:36.149678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'118","reported_seq":156,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:02:01.353892+0000","last_change":"2024-04-01T23:02:01.353939+0000","last_active":"2024-04-01T23:02:01.353892+0000","last_peered":"2024-04-01T23:02:01.353892+0000","last_clean":"2024-04-01T23:02:01.353892+0000","last_became_active":"2024-04-01T22:33:33.252412+0000","last_became_peered":"2024-04-01T22:33:33.252412+0000","last_unstale":"2024-04-01T23:02:01.353892+0000","last_undegraded":"2024-04-01T23:02:01.353892+0000","last_fullsized":"2024-04-01T23:02:01.353892+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'118","last_scrub_stamp":"2024-04-01T23:02:01.353804+0000","last_deep_scrub":"27'118","last_deep_scrub_stamp":"2024-04-01T23:02:01.353804+0000","last_clean_scrub_stamp":"2024-04-01T23:02:01.353804+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:27:35.060362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":10338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'44","reported_seq":89,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:49.273335+0000","last_change":"2024-04-01T23:01:49.273373+0000","last_active":"2024-04-01T23:01:49.273335+0000","last_peered":"2024-04-01T23:01:49.273335+0000","last_clean":"2024-04-01T23:01:49.273335+0000","last_became_active":"2024-04-01T22:33:27.880096+0000","last_became_peered":"2024-04-01T22:33:27.880096+0000","last_unstale":"2024-04-01T23:01:49.273335+0000","last_undegraded":"2024-04-01T23:01:49.273335+0000","last_fullsized":"2024-04-01T23:01:49.273335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'44","last_scrub_stamp":"2024-04-01T23:01:49.273226+0000","last_deep_scrub":"27'44","last_deep_scrub_stamp":"2024-04-01T23:01:49.273226+0000","last_clean_scrub_stamp":"2024-04-01T23:01:49.273226+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:09:41.022331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'6","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:54.053992+0000","last_change":"2024-04-01T23:01:54.054013+0000","last_active":"2024-04-01T23:01:54.053992+0000","last_peered":"2024-04-01T23:01:54.053992+0000","last_clean":"2024-04-01T23:01:54.053992+0000","last_became_active":"2024-04-01T22:33:26.855475+0000","last_became_peered":"2024-04-01T22:33:26.855475+0000","last_unstale":"2024-04-01T23:01:54.053992+0000","last_undegraded":"2024-04-01T23:01:54.053992+0000","last_fullsized":"2024-04-01T23:01:54.053992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-01T23:01:54.053922+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-01T23:01:54.053922+0000","last_clean_scrub_stamp":"2024-04-01T23:01:54.053922+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:44:52.352654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'90","reported_seq":129,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:02:00.320954+0000","last_change":"2024-04-01T23:02:00.320977+0000","last_active":"2024-04-01T23:02:00.320954+0000","last_peered":"2024-04-01T23:02:00.320954+0000","last_clean":"2024-04-01T23:02:00.320954+0000","last_became_active":"2024-04-01T22:33:33.249352+0000","last_became_peered":"2024-04-01T22:33:33.249352+0000","last_unstale":"2024-04-01T23:02:00.320954+0000","last_undegraded":"2024-04-01T23:02:00.320954+0000","last_fullsized":"2024-04-01T23:02:00.320954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'90","last_scrub_stamp":"2024-04-01T23:02:00.320871+0000","last_deep_scrub":"27'90","last_deep_scrub_stamp":"2024-04-01T23:02:00.320871+0000","last_clean_scrub_stamp":"2024-04-01T23:02:00.320871+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:10:35.466922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":8688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'34","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:49.766237+0000","last_change":"2024-04-01T23:01:49.766276+0000","last_active":"2024-04-01T23:01:49.766237+0000","last_peered":"2024-04-01T23:01:49.766237+0000","last_clean":"2024-04-01T23:01:49.766237+0000","last_became_active":"2024-04-01T22:33:27.948691+0000","last_became_peered":"2024-04-01T22:33:27.948691+0000","last_unstale":"2024-04-01T23:01:49.766237+0000","last_undegraded":"2024-04-01T23:01:49.766237+0000","last_fullsized":"2024-04-01T23:01:49.766237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'34","last_scrub_stamp":"2024-04-01T23:01:49.766161+0000","last_deep_scrub":"27'34","last_deep_scrub_stamp":"2024-04-01T23:01:49.766161+0000","last_clean_scrub_stamp":"2024-04-01T23:01:49.766161+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:18:48.326668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'11","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:45.782708+0000","last_change":"2024-04-01T23:01:45.782733+0000","last_active":"2024-04-01T23:01:45.782708+0000","last_peered":"2024-04-01T23:01:45.782708+0000","last_clean":"2024-04-01T23:01:45.782708+0000","last_became_active":"2024-04-01T22:33:26.849646+0000","last_became_peered":"2024-04-01T22:33:26.849646+0000","last_unstale":"2024-04-01T23:01:45.782708+0000","last_undegraded":"2024-04-01T23:01:45.782708+0000","last_fullsized":"2024-04-01T23:01:45.782708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-04-01T23:01:45.782644+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-04-01T23:01:45.782644+0000","last_clean_scrub_stamp":"2024-04-01T23:01:45.782644+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:36:03.764588+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'119","reported_seq":157,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:02:05.066999+0000","last_change":"2024-04-01T23:02:05.067022+0000","last_active":"2024-04-01T23:02:05.066999+0000","last_peered":"2024-04-01T23:02:05.066999+0000","last_clean":"2024-04-01T23:02:05.066999+0000","last_became_active":"2024-04-01T22:33:33.249853+0000","last_became_peered":"2024-04-01T22:33:33.249853+0000","last_unstale":"2024-04-01T23:02:05.066999+0000","last_undegraded":"2024-04-01T23:02:05.066999+0000","last_fullsized":"2024-04-01T23:02:05.066999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2024-04-01T23:02:05.066920+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2024-04-01T23:02:05.066920+0000","last_clean_scrub_stamp":"2024-04-01T23:02:05.066920+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:01:47.563799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":9692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'28","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:52.553837+0000","last_change":"2024-04-01T23:01:52.553857+0000","last_active":"2024-04-01T23:01:52.553837+0000","last_peered":"2024-04-01T23:01:52.553837+0000","last_clean":"2024-04-01T23:01:52.553837+0000","last_became_active":"2024-04-01T22:34:04.898014+0000","last_became_peered":"2024-04-01T22:34:04.898014+0000","last_unstale":"2024-04-01T23:01:52.553837+0000","last_undegraded":"2024-04-01T23:01:52.553837+0000","last_fullsized":"2024-04-01T23:01:52.553837+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'28","last_scrub_stamp":"2024-04-01T23:01:52.553767+0000","last_deep_scrub":"27'28","last_deep_scrub_stamp":"2024-04-01T23:01:52.553767+0000","last_clean_scrub_stamp":"2024-04-01T23:01:52.553767+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:49:45.459630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.14","version":"27'848","reported_seq":895,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:52.844447+0000","last_change":"2024-04-01T23:01:52.844473+0000","last_active":"2024-04-01T23:01:52.844447+0000","last_peered":"2024-04-01T23:01:52.844447+0000","last_clean":"2024-04-01T23:01:52.844447+0000","last_became_active":"2024-04-01T22:33:26.855400+0000","last_became_peered":"2024-04-01T22:33:26.855400+0000","last_unstale":"2024-04-01T23:01:52.844447+0000","last_undegraded":"2024-04-01T23:01:52.844447+0000","last_fullsized":"2024-04-01T23:01:52.844447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'848","last_scrub_stamp":"2024-04-01T23:01:52.844390+0000","last_deep_scrub":"27'848","last_deep_scrub_stamp":"2024-04-01T23:01:52.844390+0000","last_clean_scrub_stamp":"2024-04-01T23:01:52.844390+0000","objects_scrubbed":4,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:36:10.826333+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":842,"num_write_kb":4541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'128","reported_seq":167,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:56.451106+0000","last_change":"2024-04-01T23:01:56.451157+0000","last_active":"2024-04-01T23:01:56.451106+0000","last_peered":"2024-04-01T23:01:56.451106+0000","last_clean":"2024-04-01T23:01:56.451106+0000","last_became_active":"2024-04-01T22:33:32.846156+0000","last_became_peered":"2024-04-01T22:33:32.846156+0000","last_unstale":"2024-04-01T23:01:56.451106+0000","last_undegraded":"2024-04-01T23:01:56.451106+0000","last_fullsized":"2024-04-01T23:01:56.451106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'128","last_scrub_stamp":"2024-04-01T23:01:56.451018+0000","last_deep_scrub":"27'128","last_deep_scrub_stamp":"2024-04-01T23:01:56.451018+0000","last_clean_scrub_stamp":"2024-04-01T23:01:56.451018+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:43:43.365925+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":9107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'28","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:49.594009+0000","last_change":"2024-04-01T23:01:49.594031+0000","last_active":"2024-04-01T23:01:49.594009+0000","last_peered":"2024-04-01T23:01:49.594009+0000","last_clean":"2024-04-01T23:01:49.594009+0000","last_became_active":"2024-04-01T22:33:27.879165+0000","last_became_peered":"2024-04-01T22:33:27.879165+0000","last_unstale":"2024-04-01T23:01:49.594009+0000","last_undegraded":"2024-04-01T23:01:49.594009+0000","last_fullsized":"2024-04-01T23:01:49.594009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'28","last_scrub_stamp":"2024-04-01T23:01:49.593921+0000","last_deep_scrub":"27'28","last_deep_scrub_stamp":"2024-04-01T23:01:49.593921+0000","last_clean_scrub_stamp":"2024-04-01T23:01:49.593921+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:00:52.326015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'574","reported_seq":620,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:48.510232+0000","last_change":"2024-04-01T23:01:48.510284+0000","last_active":"2024-04-01T23:01:48.510232+0000","last_peered":"2024-04-01T23:01:48.510232+0000","last_clean":"2024-04-01T23:01:48.510232+0000","last_became_active":"2024-04-01T22:33:26.851489+0000","last_became_peered":"2024-04-01T22:33:26.851489+0000","last_unstale":"2024-04-01T23:01:48.510232+0000","last_undegraded":"2024-04-01T23:01:48.510232+0000","last_fullsized":"2024-04-01T23:01:48.510232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'574","last_scrub_stamp":"2024-04-01T23:01:48.510151+0000","last_deep_scrub":"27'574","last_deep_scrub_stamp":"2024-04-01T23:01:48.510151+0000","last_clean_scrub_stamp":"2024-04-01T23:01:48.510151+0000","objects_scrubbed":2,"log_size":574,"log_dups_size":0,"ondisk_log_size":574,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:37:47.306992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":569,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'166","reported_seq":205,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:53.546156+0000","last_change":"2024-04-01T23:01:53.546181+0000","last_active":"2024-04-01T23:01:53.546156+0000","last_peered":"2024-04-01T23:01:53.546156+0000","last_clean":"2024-04-01T23:01:53.546156+0000","last_became_active":"2024-04-01T22:33:32.846024+0000","last_became_peered":"2024-04-01T22:33:32.846024+0000","last_unstale":"2024-04-01T23:01:53.546156+0000","last_undegraded":"2024-04-01T23:01:53.546156+0000","last_fullsized":"2024-04-01T23:01:53.546156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'166","last_scrub_stamp":"2024-04-01T23:01:53.546087+0000","last_deep_scrub":"27'166","last_deep_scrub_stamp":"2024-04-01T23:01:53.546087+0000","last_clean_scrub_stamp":"2024-04-01T23:01:53.546087+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:12:10.339005+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":22198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'35","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:53.784416+0000","last_change":"2024-04-01T23:01:53.784458+0000","last_active":"2024-04-01T23:01:53.784416+0000","last_peered":"2024-04-01T23:01:53.784416+0000","last_clean":"2024-04-01T23:01:53.784416+0000","last_became_active":"2024-04-01T22:33:27.973846+0000","last_became_peered":"2024-04-01T22:33:27.973846+0000","last_unstale":"2024-04-01T23:01:53.784416+0000","last_undegraded":"2024-04-01T23:01:53.784416+0000","last_fullsized":"2024-04-01T23:01:53.784416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2024-04-01T23:01:53.784313+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2024-04-01T23:01:53.784313+0000","last_clean_scrub_stamp":"2024-04-01T23:01:53.784313+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:08:41.773408+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'8","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:51.971595+0000","last_change":"2024-04-01T23:01:51.971621+0000","last_active":"2024-04-01T23:01:51.971595+0000","last_peered":"2024-04-01T23:01:51.971595+0000","last_clean":"2024-04-01T23:01:51.971595+0000","last_became_active":"2024-04-01T22:33:26.831676+0000","last_became_peered":"2024-04-01T22:33:26.831676+0000","last_unstale":"2024-04-01T23:01:51.971595+0000","last_undegraded":"2024-04-01T23:01:51.971595+0000","last_fullsized":"2024-04-01T23:01:51.971595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-01T23:01:51.971509+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-01T23:01:51.971509+0000","last_clean_scrub_stamp":"2024-04-01T23:01:51.971509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:18:50.532016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'96","reported_seq":135,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:59.323093+0000","last_change":"2024-04-01T23:01:59.323117+0000","last_active":"2024-04-01T23:01:59.323093+0000","last_peered":"2024-04-01T23:01:59.323093+0000","last_clean":"2024-04-01T23:01:59.323093+0000","last_became_active":"2024-04-01T22:33:32.849661+0000","last_became_peered":"2024-04-01T22:33:32.849661+0000","last_unstale":"2024-04-01T23:01:59.323093+0000","last_undegraded":"2024-04-01T23:01:59.323093+0000","last_fullsized":"2024-04-01T23:01:59.323093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'96","last_scrub_stamp":"2024-04-01T23:01:59.323021+0000","last_deep_scrub":"27'96","last_deep_scrub_stamp":"2024-04-01T23:01:59.323021+0000","last_clean_scrub_stamp":"2024-04-01T23:01:59.323021+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:29:11.776535+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":9067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'37","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:56.046127+0000","last_change":"2024-04-01T23:01:56.046165+0000","last_active":"2024-04-01T23:01:56.046127+0000","last_peered":"2024-04-01T23:01:56.046127+0000","last_clean":"2024-04-01T23:01:56.046127+0000","last_became_active":"2024-04-01T22:33:27.972173+0000","last_became_peered":"2024-04-01T22:33:27.972173+0000","last_unstale":"2024-04-01T23:01:56.046127+0000","last_undegraded":"2024-04-01T23:01:56.046127+0000","last_fullsized":"2024-04-01T23:01:56.046127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'37","last_scrub_stamp":"2024-04-01T23:01:56.046038+0000","last_deep_scrub":"27'37","last_deep_scrub_stamp":"2024-04-01T23:01:56.046038+0000","last_clean_scrub_stamp":"2024-04-01T23:01:56.046038+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:45:13.874535+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'2","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:50.771146+0000","last_change":"2024-04-01T23:01:50.771167+0000","last_active":"2024-04-01T23:01:50.771146+0000","last_peered":"2024-04-01T23:01:50.771146+0000","last_clean":"2024-04-01T23:01:50.771146+0000","last_became_active":"2024-04-01T22:33:26.831702+0000","last_became_peered":"2024-04-01T22:33:26.831702+0000","last_unstale":"2024-04-01T23:01:50.771146+0000","last_undegraded":"2024-04-01T23:01:50.771146+0000","last_fullsized":"2024-04-01T23:01:50.771146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-01T23:01:50.771077+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-01T23:01:50.771077+0000","last_clean_scrub_stamp":"2024-04-01T23:01:50.771077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:53:14.204703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'144","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:02:02.333576+0000","last_change":"2024-04-01T23:02:02.333598+0000","last_active":"2024-04-01T23:02:02.333576+0000","last_peered":"2024-04-01T23:02:02.333576+0000","last_clean":"2024-04-01T23:02:02.333576+0000","last_became_active":"2024-04-01T22:33:33.253993+0000","last_became_peered":"2024-04-01T22:33:33.253993+0000","last_unstale":"2024-04-01T23:02:02.333576+0000","last_undegraded":"2024-04-01T23:02:02.333576+0000","last_fullsized":"2024-04-01T23:02:02.333576+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'144","last_scrub_stamp":"2024-04-01T23:02:02.333507+0000","last_deep_scrub":"27'144","last_deep_scrub_stamp":"2024-04-01T23:02:02.333507+0000","last_clean_scrub_stamp":"2024-04-01T23:02:02.333507+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:10:26.038108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":10480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'142","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:58.814352+0000","last_change":"2024-04-01T23:01:58.814374+0000","last_active":"2024-04-01T23:01:58.814352+0000","last_peered":"2024-04-01T23:01:58.814352+0000","last_clean":"2024-04-01T23:01:58.814352+0000","last_became_active":"2024-04-01T22:33:33.252690+0000","last_became_peered":"2024-04-01T22:33:33.252690+0000","last_unstale":"2024-04-01T23:01:58.814352+0000","last_undegraded":"2024-04-01T23:01:58.814352+0000","last_fullsized":"2024-04-01T23:01:58.814352+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'142","last_scrub_stamp":"2024-04-01T23:01:58.814278+0000","last_deep_scrub":"27'142","last_deep_scrub_stamp":"2024-04-01T23:01:58.814278+0000","last_clean_scrub_stamp":"2024-04-01T23:01:58.814278+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:30:37.664878+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":7949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'40","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:52.413834+0000","last_change":"2024-04-01T23:01:52.413879+0000","last_active":"2024-04-01T23:01:52.413834+0000","last_peered":"2024-04-01T23:01:52.413834+0000","last_clean":"2024-04-01T23:01:52.413834+0000","last_became_active":"2024-04-01T22:33:27.855609+0000","last_became_peered":"2024-04-01T22:33:27.855609+0000","last_unstale":"2024-04-01T23:01:52.413834+0000","last_undegraded":"2024-04-01T23:01:52.413834+0000","last_fullsized":"2024-04-01T23:01:52.413834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2024-04-01T23:01:52.413720+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2024-04-01T23:01:52.413720+0000","last_clean_scrub_stamp":"2024-04-01T23:01:52.413720+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:19:54.647133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'2","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:51.002158+0000","last_change":"2024-04-01T23:01:51.002183+0000","last_active":"2024-04-01T23:01:51.002158+0000","last_peered":"2024-04-01T23:01:51.002158+0000","last_clean":"2024-04-01T23:01:51.002158+0000","last_became_active":"2024-04-01T22:33:26.831554+0000","last_became_peered":"2024-04-01T22:33:26.831554+0000","last_unstale":"2024-04-01T23:01:51.002158+0000","last_undegraded":"2024-04-01T23:01:51.002158+0000","last_fullsized":"2024-04-01T23:01:51.002158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-01T23:01:51.002074+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-01T23:01:51.002074+0000","last_clean_scrub_stamp":"2024-04-01T23:01:51.002074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:12:07.794992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'135","reported_seq":175,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:02:00.791359+0000","last_change":"2024-04-01T23:02:00.791381+0000","last_active":"2024-04-01T23:02:00.791359+0000","last_peered":"2024-04-01T23:02:00.791359+0000","last_clean":"2024-04-01T23:02:00.791359+0000","last_became_active":"2024-04-01T22:33:32.849536+0000","last_became_peered":"2024-04-01T22:33:32.849536+0000","last_unstale":"2024-04-01T23:02:00.791359+0000","last_undegraded":"2024-04-01T23:02:00.791359+0000","last_fullsized":"2024-04-01T23:02:00.791359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'135","last_scrub_stamp":"2024-04-01T23:02:00.791290+0000","last_deep_scrub":"27'135","last_deep_scrub_stamp":"2024-04-01T23:02:00.791290+0000","last_clean_scrub_stamp":"2024-04-01T23:02:00.791290+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:03:05.927643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":12020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'41","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:46.257374+0000","last_change":"2024-04-01T23:01:46.257418+0000","last_active":"2024-04-01T23:01:46.257374+0000","last_peered":"2024-04-01T23:01:46.257374+0000","last_clean":"2024-04-01T23:01:46.257374+0000","last_became_active":"2024-04-01T22:33:27.950148+0000","last_became_peered":"2024-04-01T22:33:27.950148+0000","last_unstale":"2024-04-01T23:01:46.257374+0000","last_undegraded":"2024-04-01T23:01:46.257374+0000","last_fullsized":"2024-04-01T23:01:46.257374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'41","last_scrub_stamp":"2024-04-01T23:01:46.257262+0000","last_deep_scrub":"27'41","last_deep_scrub_stamp":"2024-04-01T23:01:46.257262+0000","last_clean_scrub_stamp":"2024-04-01T23:01:46.257262+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:37:45.054103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'1","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:52.199011+0000","last_change":"2024-04-01T23:01:52.199051+0000","last_active":"2024-04-01T23:01:52.199011+0000","last_peered":"2024-04-01T23:01:52.199011+0000","last_clean":"2024-04-01T23:01:52.199011+0000","last_became_active":"2024-04-01T22:33:26.855136+0000","last_became_peered":"2024-04-01T22:33:26.855136+0000","last_unstale":"2024-04-01T23:01:52.199011+0000","last_undegraded":"2024-04-01T23:01:52.199011+0000","last_fullsized":"2024-04-01T23:01:52.199011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2024-04-01T23:01:52.198907+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2024-04-01T23:01:52.198907+0000","last_clean_scrub_stamp":"2024-04-01T23:01:52.198907+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:32:32.498895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'614","reported_seq":660,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:49.821690+0000","last_change":"2024-04-01T23:01:49.821720+0000","last_active":"2024-04-01T23:01:49.821690+0000","last_peered":"2024-04-01T23:01:49.821690+0000","last_clean":"2024-04-01T23:01:49.821690+0000","last_became_active":"2024-04-01T22:33:26.830563+0000","last_became_peered":"2024-04-01T22:33:26.830563+0000","last_unstale":"2024-04-01T23:01:49.821690+0000","last_undegraded":"2024-04-01T23:01:49.821690+0000","last_fullsized":"2024-04-01T23:01:49.821690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'614","last_scrub_stamp":"2024-04-01T23:01:49.821600+0000","last_deep_scrub":"27'614","last_deep_scrub_stamp":"2024-04-01T23:01:49.821600+0000","last_clean_scrub_stamp":"2024-04-01T23:01:49.821600+0000","objects_scrubbed":1,"log_size":614,"log_dups_size":0,"ondisk_log_size":614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:36:14.192953+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":609,"num_write_kb":4438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'35","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:43.775987+0000","last_change":"2024-04-01T23:01:43.776031+0000","last_active":"2024-04-01T23:01:43.775987+0000","last_peered":"2024-04-01T23:01:43.775987+0000","last_clean":"2024-04-01T23:01:43.775987+0000","last_became_active":"2024-04-01T22:33:27.951103+0000","last_became_peered":"2024-04-01T22:33:27.951103+0000","last_unstale":"2024-04-01T23:01:43.775987+0000","last_undegraded":"2024-04-01T23:01:43.775987+0000","last_fullsized":"2024-04-01T23:01:43.775987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2024-04-01T23:01:43.775866+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2024-04-01T23:01:43.775866+0000","last_clean_scrub_stamp":"2024-04-01T23:01:43.775866+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:36:23.982972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'96","reported_seq":134,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:51.565715+0000","last_change":"2024-04-01T23:01:51.565761+0000","last_active":"2024-04-01T23:01:51.565715+0000","last_peered":"2024-04-01T23:01:51.565715+0000","last_clean":"2024-04-01T23:01:51.565715+0000","last_became_active":"2024-04-01T22:33:32.846376+0000","last_became_peered":"2024-04-01T22:33:32.846376+0000","last_unstale":"2024-04-01T23:01:51.565715+0000","last_undegraded":"2024-04-01T23:01:51.565715+0000","last_fullsized":"2024-04-01T23:01:51.565715+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'96","last_scrub_stamp":"2024-04-01T23:01:51.565602+0000","last_deep_scrub":"27'96","last_deep_scrub_stamp":"2024-04-01T23:01:51.565602+0000","last_clean_scrub_stamp":"2024-04-01T23:01:51.565602+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:40:24.399221+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":4400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'651","reported_seq":697,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:51.218662+0000","last_change":"2024-04-01T23:01:51.218686+0000","last_active":"2024-04-01T23:01:51.218662+0000","last_peered":"2024-04-01T23:01:51.218662+0000","last_clean":"2024-04-01T23:01:51.218662+0000","last_became_active":"2024-04-01T22:33:26.855101+0000","last_became_peered":"2024-04-01T22:33:26.855101+0000","last_unstale":"2024-04-01T23:01:51.218662+0000","last_undegraded":"2024-04-01T23:01:51.218662+0000","last_fullsized":"2024-04-01T23:01:51.218662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'651","last_scrub_stamp":"2024-04-01T23:01:51.218594+0000","last_deep_scrub":"27'651","last_deep_scrub_stamp":"2024-04-01T23:01:51.218594+0000","last_clean_scrub_stamp":"2024-04-01T23:01:51.218594+0000","objects_scrubbed":1,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:08:39.207689+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":645,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'30","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:47.612837+0000","last_change":"2024-04-01T23:01:47.612859+0000","last_active":"2024-04-01T23:01:47.612837+0000","last_peered":"2024-04-01T23:01:47.612837+0000","last_clean":"2024-04-01T23:01:47.612837+0000","last_became_active":"2024-04-01T22:33:27.868297+0000","last_became_peered":"2024-04-01T22:33:27.868297+0000","last_unstale":"2024-04-01T23:01:47.612837+0000","last_undegraded":"2024-04-01T23:01:47.612837+0000","last_fullsized":"2024-04-01T23:01:47.612837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2024-04-01T23:01:47.612768+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2024-04-01T23:01:47.612768+0000","last_clean_scrub_stamp":"2024-04-01T23:01:47.612768+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:49:40.518631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'127","reported_seq":172,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:02:05.352363+0000","last_change":"2024-04-01T23:02:05.352404+0000","last_active":"2024-04-01T23:02:05.352363+0000","last_peered":"2024-04-01T23:02:05.352363+0000","last_clean":"2024-04-01T23:02:05.352363+0000","last_became_active":"2024-04-01T22:34:05.319550+0000","last_became_peered":"2024-04-01T22:34:05.319550+0000","last_unstale":"2024-04-01T23:02:05.352363+0000","last_undegraded":"2024-04-01T23:02:05.352363+0000","last_fullsized":"2024-04-01T23:02:05.352363+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'127","last_scrub_stamp":"2024-04-01T23:02:05.352258+0000","last_deep_scrub":"27'127","last_deep_scrub_stamp":"2024-04-01T23:02:05.352258+0000","last_clean_scrub_stamp":"2024-04-01T23:02:05.352258+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:00:13.211441+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":7877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'45","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:56.846012+0000","last_change":"2024-04-01T23:01:56.846052+0000","last_active":"2024-04-01T23:01:56.846012+0000","last_peered":"2024-04-01T23:01:56.846012+0000","last_clean":"2024-04-01T23:01:56.846012+0000","last_became_active":"2024-04-01T22:33:27.949843+0000","last_became_peered":"2024-04-01T22:33:27.949843+0000","last_unstale":"2024-04-01T23:01:56.846012+0000","last_undegraded":"2024-04-01T23:01:56.846012+0000","last_fullsized":"2024-04-01T23:01:56.846012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2024-04-01T23:01:56.845911+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2024-04-01T23:01:56.845911+0000","last_clean_scrub_stamp":"2024-04-01T23:01:56.845911+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T02:43:48.908715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'43","reported_seq":89,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:50.545638+0000","last_change":"2024-04-01T23:01:50.545658+0000","last_active":"2024-04-01T23:01:50.545638+0000","last_peered":"2024-04-01T23:01:50.545638+0000","last_clean":"2024-04-01T23:01:50.545638+0000","last_became_active":"2024-04-01T22:33:27.974128+0000","last_became_peered":"2024-04-01T22:33:27.974128+0000","last_unstale":"2024-04-01T23:01:50.545638+0000","last_undegraded":"2024-04-01T23:01:50.545638+0000","last_fullsized":"2024-04-01T23:01:50.545638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'43","last_scrub_stamp":"2024-04-01T23:01:50.545570+0000","last_deep_scrub":"27'43","last_deep_scrub_stamp":"2024-04-01T23:01:50.545570+0000","last_clean_scrub_stamp":"2024-04-01T23:01:50.545570+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:41:25.766853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'42","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:02:00.015440+0000","last_change":"2024-04-01T23:02:00.015463+0000","last_active":"2024-04-01T23:02:00.015440+0000","last_peered":"2024-04-01T23:02:00.015440+0000","last_clean":"2024-04-01T23:02:00.015440+0000","last_became_active":"2024-04-01T22:33:27.973988+0000","last_became_peered":"2024-04-01T22:33:27.973988+0000","last_unstale":"2024-04-01T23:02:00.015440+0000","last_undegraded":"2024-04-01T23:02:00.015440+0000","last_fullsized":"2024-04-01T23:02:00.015440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'42","last_scrub_stamp":"2024-04-01T23:02:00.015369+0000","last_deep_scrub":"27'42","last_deep_scrub_stamp":"2024-04-01T23:02:00.015369+0000","last_clean_scrub_stamp":"2024-04-01T23:02:00.015369+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:30:38.865969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'29","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:51.745610+0000","last_change":"2024-04-01T23:01:51.745633+0000","last_active":"2024-04-01T23:01:51.745610+0000","last_peered":"2024-04-01T23:01:51.745610+0000","last_clean":"2024-04-01T23:01:51.745610+0000","last_became_active":"2024-04-01T22:33:27.950515+0000","last_became_peered":"2024-04-01T22:33:27.950515+0000","last_unstale":"2024-04-01T23:01:51.745610+0000","last_undegraded":"2024-04-01T23:01:51.745610+0000","last_fullsized":"2024-04-01T23:01:51.745610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'29","last_scrub_stamp":"2024-04-01T23:01:51.745542+0000","last_deep_scrub":"27'29","last_deep_scrub_stamp":"2024-04-01T23:01:51.745542+0000","last_clean_scrub_stamp":"2024-04-01T23:01:51.745542+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:44:50.044273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'25","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:55.305921+0000","last_change":"2024-04-01T23:01:55.305942+0000","last_active":"2024-04-01T23:01:55.305921+0000","last_peered":"2024-04-01T23:01:55.305921+0000","last_clean":"2024-04-01T23:01:55.305921+0000","last_became_active":"2024-04-01T22:33:27.869102+0000","last_became_peered":"2024-04-01T22:33:27.869102+0000","last_unstale":"2024-04-01T23:01:55.305921+0000","last_undegraded":"2024-04-01T23:01:55.305921+0000","last_fullsized":"2024-04-01T23:01:55.305921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'25","last_scrub_stamp":"2024-04-01T23:01:55.305848+0000","last_deep_scrub":"27'25","last_deep_scrub_stamp":"2024-04-01T23:01:55.305848+0000","last_clean_scrub_stamp":"2024-04-01T23:01:55.305848+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:45:48.646542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'26","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:53.408345+0000","last_change":"2024-04-01T23:01:53.408367+0000","last_active":"2024-04-01T23:01:53.408345+0000","last_peered":"2024-04-01T23:01:53.408345+0000","last_clean":"2024-04-01T23:01:53.408345+0000","last_became_active":"2024-04-01T22:33:27.856213+0000","last_became_peered":"2024-04-01T22:33:27.856213+0000","last_unstale":"2024-04-01T23:01:53.408345+0000","last_undegraded":"2024-04-01T23:01:53.408345+0000","last_fullsized":"2024-04-01T23:01:53.408345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'26","last_scrub_stamp":"2024-04-01T23:01:53.408277+0000","last_deep_scrub":"27'26","last_deep_scrub_stamp":"2024-04-01T23:01:53.408277+0000","last_clean_scrub_stamp":"2024-04-01T23:01:53.408277+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:08:41.397372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'41","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:55.859161+0000","last_change":"2024-04-01T23:01:55.859180+0000","last_active":"2024-04-01T23:01:55.859161+0000","last_peered":"2024-04-01T23:01:55.859161+0000","last_clean":"2024-04-01T23:01:55.859161+0000","last_became_active":"2024-04-01T22:33:27.921229+0000","last_became_peered":"2024-04-01T22:33:27.921229+0000","last_unstale":"2024-04-01T23:01:55.859161+0000","last_undegraded":"2024-04-01T23:01:55.859161+0000","last_fullsized":"2024-04-01T23:01:55.859161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'41","last_scrub_stamp":"2024-04-01T23:01:55.859092+0000","last_deep_scrub":"27'41","last_deep_scrub_stamp":"2024-04-01T23:01:55.859092+0000","last_clean_scrub_stamp":"2024-04-01T23:01:55.859092+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:17:06.367745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'30","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:54.259250+0000","last_change":"2024-04-01T23:01:54.259273+0000","last_active":"2024-04-01T23:01:54.259250+0000","last_peered":"2024-04-01T23:01:54.259250+0000","last_clean":"2024-04-01T23:01:54.259250+0000","last_became_active":"2024-04-01T22:33:27.868496+0000","last_became_peered":"2024-04-01T22:33:27.868496+0000","last_unstale":"2024-04-01T23:01:54.259250+0000","last_undegraded":"2024-04-01T23:01:54.259250+0000","last_fullsized":"2024-04-01T23:01:54.259250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2024-04-01T23:01:54.259187+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2024-04-01T23:01:54.259187+0000","last_clean_scrub_stamp":"2024-04-01T23:01:54.259187+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:43:41.174094+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'30","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:49.009486+0000","last_change":"2024-04-01T23:01:49.009509+0000","last_active":"2024-04-01T23:01:49.009486+0000","last_peered":"2024-04-01T23:01:49.009486+0000","last_clean":"2024-04-01T23:01:49.009486+0000","last_became_active":"2024-04-01T22:33:27.973851+0000","last_became_peered":"2024-04-01T22:33:27.973851+0000","last_unstale":"2024-04-01T23:01:49.009486+0000","last_undegraded":"2024-04-01T23:01:49.009486+0000","last_fullsized":"2024-04-01T23:01:49.009486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2024-04-01T23:01:49.009422+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2024-04-01T23:01:49.009422+0000","last_clean_scrub_stamp":"2024-04-01T23:01:49.009422+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T00:39:39.913348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'42","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:54.541343+0000","last_change":"2024-04-01T23:01:54.541387+0000","last_active":"2024-04-01T23:01:54.541343+0000","last_peered":"2024-04-01T23:01:54.541343+0000","last_clean":"2024-04-01T23:01:54.541343+0000","last_became_active":"2024-04-01T22:34:05.289755+0000","last_became_peered":"2024-04-01T22:34:05.289755+0000","last_unstale":"2024-04-01T23:01:54.541343+0000","last_undegraded":"2024-04-01T23:01:54.541343+0000","last_fullsized":"2024-04-01T23:01:54.541343+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'42","last_scrub_stamp":"2024-04-01T23:01:54.541258+0000","last_deep_scrub":"27'42","last_deep_scrub_stamp":"2024-04-01T23:01:54.541258+0000","last_clean_scrub_stamp":"2024-04-01T23:01:54.541258+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:46:40.051165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"27'35","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:02:03.007583+0000","last_change":"2024-04-01T23:02:03.007604+0000","last_active":"2024-04-01T23:02:03.007583+0000","last_peered":"2024-04-01T23:02:03.007583+0000","last_clean":"2024-04-01T23:02:03.007583+0000","last_became_active":"2024-04-01T22:33:27.979108+0000","last_became_peered":"2024-04-01T22:33:27.979108+0000","last_unstale":"2024-04-01T23:02:03.007583+0000","last_undegraded":"2024-04-01T23:02:03.007583+0000","last_fullsized":"2024-04-01T23:02:03.007583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2024-04-01T23:02:03.007515+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2024-04-01T23:02:03.007515+0000","last_clean_scrub_stamp":"2024-04-01T23:02:03.007515+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:29:15.461030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'48","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:52.756570+0000","last_change":"2024-04-01T23:01:52.756609+0000","last_active":"2024-04-01T23:01:52.756570+0000","last_peered":"2024-04-01T23:01:52.756570+0000","last_clean":"2024-04-01T23:01:52.756570+0000","last_became_active":"2024-04-01T22:33:27.953674+0000","last_became_peered":"2024-04-01T22:33:27.953674+0000","last_unstale":"2024-04-01T23:01:52.756570+0000","last_undegraded":"2024-04-01T23:01:52.756570+0000","last_fullsized":"2024-04-01T23:01:52.756570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'48","last_scrub_stamp":"2024-04-01T23:01:52.756462+0000","last_deep_scrub":"27'48","last_deep_scrub_stamp":"2024-04-01T23:01:52.756462+0000","last_clean_scrub_stamp":"2024-04-01T23:01:52.756462+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:19:54.989875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'37","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:54.811891+0000","last_change":"2024-04-01T23:01:54.811913+0000","last_active":"2024-04-01T23:01:54.811891+0000","last_peered":"2024-04-01T23:01:54.811891+0000","last_clean":"2024-04-01T23:01:54.811891+0000","last_became_active":"2024-04-01T22:33:27.918815+0000","last_became_peered":"2024-04-01T22:33:27.918815+0000","last_unstale":"2024-04-01T23:01:54.811891+0000","last_undegraded":"2024-04-01T23:01:54.811891+0000","last_fullsized":"2024-04-01T23:01:54.811891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'37","last_scrub_stamp":"2024-04-01T23:01:54.811824+0000","last_deep_scrub":"27'37","last_deep_scrub_stamp":"2024-04-01T23:01:54.811824+0000","last_clean_scrub_stamp":"2024-04-01T23:01:54.811824+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:37:53.608665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'34","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:02:00.189072+0000","last_change":"2024-04-01T23:02:00.189112+0000","last_active":"2024-04-01T23:02:00.189072+0000","last_peered":"2024-04-01T23:02:00.189072+0000","last_clean":"2024-04-01T23:02:00.189072+0000","last_became_active":"2024-04-01T22:33:27.881372+0000","last_became_peered":"2024-04-01T22:33:27.881372+0000","last_unstale":"2024-04-01T23:02:00.189072+0000","last_undegraded":"2024-04-01T23:02:00.189072+0000","last_fullsized":"2024-04-01T23:02:00.189072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'34","last_scrub_stamp":"2024-04-01T23:02:00.188999+0000","last_deep_scrub":"27'34","last_deep_scrub_stamp":"2024-04-01T23:02:00.188999+0000","last_clean_scrub_stamp":"2024-04-01T23:02:00.188999+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:43:47.103906+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"27'43","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:49.496972+0000","last_change":"2024-04-01T23:01:49.497011+0000","last_active":"2024-04-01T23:01:49.496972+0000","last_peered":"2024-04-01T23:01:49.496972+0000","last_clean":"2024-04-01T23:01:49.496972+0000","last_became_active":"2024-04-01T22:33:27.918749+0000","last_became_peered":"2024-04-01T22:33:27.918749+0000","last_unstale":"2024-04-01T23:01:49.496972+0000","last_undegraded":"2024-04-01T23:01:49.496972+0000","last_fullsized":"2024-04-01T23:01:49.496972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'43","last_scrub_stamp":"2024-04-01T23:01:49.496886+0000","last_deep_scrub":"27'43","last_deep_scrub_stamp":"2024-04-01T23:01:49.496886+0000","last_clean_scrub_stamp":"2024-04-01T23:01:49.496886+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:43:18.187456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'36","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:02:02.034406+0000","last_change":"2024-04-01T23:02:02.034445+0000","last_active":"2024-04-01T23:02:02.034406+0000","last_peered":"2024-04-01T23:02:02.034406+0000","last_clean":"2024-04-01T23:02:02.034406+0000","last_became_active":"2024-04-01T22:33:27.979036+0000","last_became_peered":"2024-04-01T22:33:27.979036+0000","last_unstale":"2024-04-01T23:02:02.034406+0000","last_undegraded":"2024-04-01T23:02:02.034406+0000","last_fullsized":"2024-04-01T23:02:02.034406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2024-04-01T23:02:02.034304+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2024-04-01T23:02:02.034304+0000","last_clean_scrub_stamp":"2024-04-01T23:02:02.034304+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:12:06.018837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"27'35","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:57.021806+0000","last_change":"2024-04-01T23:01:57.021841+0000","last_active":"2024-04-01T23:01:57.021806+0000","last_peered":"2024-04-01T23:01:57.021806+0000","last_clean":"2024-04-01T23:01:57.021806+0000","last_became_active":"2024-04-01T22:33:27.973962+0000","last_became_peered":"2024-04-01T22:33:27.973962+0000","last_unstale":"2024-04-01T23:01:57.021806+0000","last_undegraded":"2024-04-01T23:01:57.021806+0000","last_fullsized":"2024-04-01T23:01:57.021806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2024-04-01T23:01:57.021717+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2024-04-01T23:01:57.021717+0000","last_clean_scrub_stamp":"2024-04-01T23:01:57.021717+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:03:02.158070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"27'37","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:54.456498+0000","last_change":"2024-04-01T23:01:54.456519+0000","last_active":"2024-04-01T23:01:54.456498+0000","last_peered":"2024-04-01T23:01:54.456498+0000","last_clean":"2024-04-01T23:01:54.456498+0000","last_became_active":"2024-04-01T22:33:27.869279+0000","last_became_peered":"2024-04-01T22:33:27.869279+0000","last_unstale":"2024-04-01T23:01:54.456498+0000","last_undegraded":"2024-04-01T23:01:54.456498+0000","last_fullsized":"2024-04-01T23:01:54.456498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'37","last_scrub_stamp":"2024-04-01T23:01:54.456429+0000","last_deep_scrub":"27'37","last_deep_scrub_stamp":"2024-04-01T23:01:54.456429+0000","last_clean_scrub_stamp":"2024-04-01T23:01:54.456429+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:32:34.756417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'36","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:47.738228+0000","last_change":"2024-04-01T23:01:47.738251+0000","last_active":"2024-04-01T23:01:47.738228+0000","last_peered":"2024-04-01T23:01:47.738228+0000","last_clean":"2024-04-01T23:01:47.738228+0000","last_became_active":"2024-04-01T22:33:27.947834+0000","last_became_peered":"2024-04-01T22:33:27.947834+0000","last_unstale":"2024-04-01T23:01:47.738228+0000","last_undegraded":"2024-04-01T23:01:47.738228+0000","last_fullsized":"2024-04-01T23:01:47.738228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2024-04-01T23:01:47.738156+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2024-04-01T23:01:47.738156+0000","last_clean_scrub_stamp":"2024-04-01T23:01:47.738156+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:35:26.494277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'35","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:57.303161+0000","last_change":"2024-04-01T23:01:57.303183+0000","last_active":"2024-04-01T23:01:57.303161+0000","last_peered":"2024-04-01T23:01:57.303161+0000","last_clean":"2024-04-01T23:01:57.303161+0000","last_became_active":"2024-04-01T22:33:27.915372+0000","last_became_peered":"2024-04-01T22:33:27.915372+0000","last_unstale":"2024-04-01T23:01:57.303161+0000","last_undegraded":"2024-04-01T23:01:57.303161+0000","last_fullsized":"2024-04-01T23:01:57.303161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2024-04-01T23:01:57.303093+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2024-04-01T23:01:57.303093+0000","last_clean_scrub_stamp":"2024-04-01T23:01:57.303093+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:33:05.076356+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'26","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:50.559428+0000","last_change":"2024-04-01T23:01:50.559448+0000","last_active":"2024-04-01T23:01:50.559428+0000","last_peered":"2024-04-01T23:01:50.559428+0000","last_clean":"2024-04-01T23:01:50.559428+0000","last_became_active":"2024-04-01T22:33:27.915515+0000","last_became_peered":"2024-04-01T22:33:27.915515+0000","last_unstale":"2024-04-01T23:01:50.559428+0000","last_undegraded":"2024-04-01T23:01:50.559428+0000","last_fullsized":"2024-04-01T23:01:50.559428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'26","last_scrub_stamp":"2024-04-01T23:01:50.559358+0000","last_deep_scrub":"27'26","last_deep_scrub_stamp":"2024-04-01T23:01:50.559358+0000","last_clean_scrub_stamp":"2024-04-01T23:01:50.559358+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T04:26:45.406170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'29","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:59.743410+0000","last_change":"2024-04-01T23:01:59.743434+0000","last_active":"2024-04-01T23:01:59.743410+0000","last_peered":"2024-04-01T23:01:59.743410+0000","last_clean":"2024-04-01T23:01:59.743410+0000","last_became_active":"2024-04-01T22:33:27.974558+0000","last_became_peered":"2024-04-01T22:33:27.974558+0000","last_unstale":"2024-04-01T23:01:59.743410+0000","last_undegraded":"2024-04-01T23:01:59.743410+0000","last_fullsized":"2024-04-01T23:01:59.743410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'29","last_scrub_stamp":"2024-04-01T23:01:59.743334+0000","last_deep_scrub":"27'29","last_deep_scrub_stamp":"2024-04-01T23:01:59.743334+0000","last_clean_scrub_stamp":"2024-04-01T23:01:59.743334+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:45:17.571832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'40","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:58.776362+0000","last_change":"2024-04-01T23:01:58.776402+0000","last_active":"2024-04-01T23:01:58.776362+0000","last_peered":"2024-04-01T23:01:58.776362+0000","last_clean":"2024-04-01T23:01:58.776362+0000","last_became_active":"2024-04-01T22:33:27.974139+0000","last_became_peered":"2024-04-01T22:33:27.974139+0000","last_unstale":"2024-04-01T23:01:58.776362+0000","last_undegraded":"2024-04-01T23:01:58.776362+0000","last_fullsized":"2024-04-01T23:01:58.776362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2024-04-01T23:01:58.776272+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2024-04-01T23:01:58.776272+0000","last_clean_scrub_stamp":"2024-04-01T23:01:58.776272+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:27:18.074818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'41","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:02:04.218891+0000","last_change":"2024-04-01T23:02:04.218915+0000","last_active":"2024-04-01T23:02:04.218891+0000","last_peered":"2024-04-01T23:02:04.218891+0000","last_clean":"2024-04-01T23:02:04.218891+0000","last_became_active":"2024-04-01T22:33:27.971803+0000","last_became_peered":"2024-04-01T22:33:27.971803+0000","last_unstale":"2024-04-01T23:02:04.218891+0000","last_undegraded":"2024-04-01T23:02:04.218891+0000","last_fullsized":"2024-04-01T23:02:04.218891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'41","last_scrub_stamp":"2024-04-01T23:02:04.218808+0000","last_deep_scrub":"27'41","last_deep_scrub_stamp":"2024-04-01T23:02:04.218808+0000","last_clean_scrub_stamp":"2024-04-01T23:02:04.218808+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:12:08.203341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'27","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:48.266538+0000","last_change":"2024-04-01T23:01:48.266580+0000","last_active":"2024-04-01T23:01:48.266538+0000","last_peered":"2024-04-01T23:01:48.266538+0000","last_clean":"2024-04-01T23:01:48.266538+0000","last_became_active":"2024-04-01T22:33:27.974205+0000","last_became_peered":"2024-04-01T22:33:27.974205+0000","last_unstale":"2024-04-01T23:01:48.266538+0000","last_undegraded":"2024-04-01T23:01:48.266538+0000","last_fullsized":"2024-04-01T23:01:48.266538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'27","last_scrub_stamp":"2024-04-01T23:01:48.266459+0000","last_deep_scrub":"27'27","last_deep_scrub_stamp":"2024-04-01T23:01:48.266459+0000","last_clean_scrub_stamp":"2024-04-01T23:01:48.266459+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:10:29.474180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'34","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:02:03.187655+0000","last_change":"2024-04-01T23:02:03.187678+0000","last_active":"2024-04-01T23:02:03.187655+0000","last_peered":"2024-04-01T23:02:03.187655+0000","last_clean":"2024-04-01T23:02:03.187655+0000","last_became_active":"2024-04-01T22:33:27.948929+0000","last_became_peered":"2024-04-01T22:33:27.948929+0000","last_unstale":"2024-04-01T23:02:03.187655+0000","last_undegraded":"2024-04-01T23:02:03.187655+0000","last_fullsized":"2024-04-01T23:02:03.187655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'34","last_scrub_stamp":"2024-04-01T23:02:03.187579+0000","last_deep_scrub":"27'34","last_deep_scrub_stamp":"2024-04-01T23:02:03.187579+0000","last_clean_scrub_stamp":"2024-04-01T23:02:03.187579+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T05:33:10.960842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'34","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:59.046819+0000","last_change":"2024-04-01T23:01:59.046857+0000","last_active":"2024-04-01T23:01:59.046819+0000","last_peered":"2024-04-01T23:01:59.046819+0000","last_clean":"2024-04-01T23:01:59.046819+0000","last_became_active":"2024-04-01T22:33:27.973891+0000","last_became_peered":"2024-04-01T22:33:27.973891+0000","last_unstale":"2024-04-01T23:01:59.046819+0000","last_undegraded":"2024-04-01T23:01:59.046819+0000","last_fullsized":"2024-04-01T23:01:59.046819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'34","last_scrub_stamp":"2024-04-01T23:01:59.046718+0000","last_deep_scrub":"27'34","last_deep_scrub_stamp":"2024-04-01T23:01:59.046718+0000","last_clean_scrub_stamp":"2024-04-01T23:01:59.046718+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T01:45:52.387412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'27","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:57.166973+0000","last_change":"2024-04-01T23:01:57.166996+0000","last_active":"2024-04-01T23:01:57.166973+0000","last_peered":"2024-04-01T23:01:57.166973+0000","last_clean":"2024-04-01T23:01:57.166973+0000","last_became_active":"2024-04-01T22:33:27.878782+0000","last_became_peered":"2024-04-01T22:33:27.878782+0000","last_unstale":"2024-04-01T23:01:57.166973+0000","last_undegraded":"2024-04-01T23:01:57.166973+0000","last_fullsized":"2024-04-01T23:01:57.166973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'27","last_scrub_stamp":"2024-04-01T23:01:57.166898+0000","last_deep_scrub":"27'27","last_deep_scrub_stamp":"2024-04-01T23:01:57.166898+0000","last_clean_scrub_stamp":"2024-04-01T23:01:57.166898+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:27:16.465444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'23","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:58.048817+0000","last_change":"2024-04-01T23:01:58.048838+0000","last_active":"2024-04-01T23:01:58.048817+0000","last_peered":"2024-04-01T23:01:58.048817+0000","last_clean":"2024-04-01T23:01:58.048817+0000","last_became_active":"2024-04-01T22:33:27.973592+0000","last_became_peered":"2024-04-01T22:33:27.973592+0000","last_unstale":"2024-04-01T23:01:58.048817+0000","last_undegraded":"2024-04-01T23:01:58.048817+0000","last_fullsized":"2024-04-01T23:01:58.048817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'23","last_scrub_stamp":"2024-04-01T23:01:58.048746+0000","last_deep_scrub":"27'23","last_deep_scrub_stamp":"2024-04-01T23:01:58.048746+0000","last_clean_scrub_stamp":"2024-04-01T23:01:58.048746+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T06:43:44.963653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'38","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:48.723548+0000","last_change":"2024-04-01T23:01:48.723572+0000","last_active":"2024-04-01T23:01:48.723548+0000","last_peered":"2024-04-01T23:01:48.723548+0000","last_clean":"2024-04-01T23:01:48.723548+0000","last_became_active":"2024-04-01T22:33:27.948371+0000","last_became_peered":"2024-04-01T22:33:27.948371+0000","last_unstale":"2024-04-01T23:01:48.723548+0000","last_undegraded":"2024-04-01T23:01:48.723548+0000","last_fullsized":"2024-04-01T23:01:48.723548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'38","last_scrub_stamp":"2024-04-01T23:01:48.723480+0000","last_deep_scrub":"27'38","last_deep_scrub_stamp":"2024-04-01T23:01:48.723480+0000","last_clean_scrub_stamp":"2024-04-01T23:01:48.723480+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T23:37:47.520321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'33","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:01:55.416593+0000","last_change":"2024-04-01T23:01:55.416633+0000","last_active":"2024-04-01T23:01:55.416593+0000","last_peered":"2024-04-01T23:01:55.416593+0000","last_clean":"2024-04-01T23:01:55.416593+0000","last_became_active":"2024-04-01T22:33:27.949522+0000","last_became_peered":"2024-04-01T22:33:27.949522+0000","last_unstale":"2024-04-01T23:01:55.416593+0000","last_undegraded":"2024-04-01T23:01:55.416593+0000","last_fullsized":"2024-04-01T23:01:55.416593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2024-04-01T23:01:55.416479+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2024-04-01T23:01:55.416479+0000","last_clean_scrub_stamp":"2024-04-01T23:01:55.416479+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T03:03:00.552832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'27","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-01T23:02:02.177938+0000","last_change":"2024-04-01T23:02:02.177966+0000","last_active":"2024-04-01T23:02:02.177938+0000","last_peered":"2024-04-01T23:02:02.177938+0000","last_clean":"2024-04-01T23:02:02.177938+0000","last_became_active":"2024-04-01T22:33:27.915245+0000","last_became_peered":"2024-04-01T22:33:27.915245+0000","last_unstale":"2024-04-01T23:02:02.177938+0000","last_undegraded":"2024-04-01T23:02:02.177938+0000","last_fullsized":"2024-04-01T23:02:02.177938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'27","last_scrub_stamp":"2024-04-01T23:02:02.177868+0000","last_deep_scrub":"27'27","last_deep_scrub_stamp":"2024-04-01T23:02:02.177868+0000","last_clean_scrub_stamp":"2024-04-01T23:02:02.177868+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:30:41.028468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3654,"num_write_kb":290798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4064,"ondisk_log_size":4064,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2128,"ondisk_log_size":2128,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":36646588,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":816,"num_read_kb":876,"num_write":10141,"num_write_kb":41168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":48185344,"data_stored":73293176,"data_compressed":7244306,"data_compressed_allocated":10911744,"data_compressed_original":36085760,"omap_allocated":0,"internal_metadata":0},"log_size":8279,"ondisk_log_size":8279,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65062,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575199,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72588,"kb_used_data":15044,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94299252,"statfs":{"total":96636764160,"available":96562434048,"internally_reserved":0,"allocated":15405056,"data_stored":24583315,"data_compressed":2540462,"data_compressed_allocated":3739648,"data_compressed_original":13099008,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575199,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56068,"kb_used_data":11004,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94315772,"statfs":{"total":96636764160,"available":96579350528,"internally_reserved":0,"allocated":11268096,"data_stored":16896912,"data_compressed":1639374,"data_compressed_allocated":2478080,"data_compressed_original":8286208,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575198,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":119114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575199,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36636,"kb_used_data":5460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335204,"statfs":{"total":96636764160,"available":96599248896,"internally_reserved":0,"allocated":5591040,"data_stored":8507758,"data_compressed":911578,"data_compressed_allocated":1363968,"data_compressed_original":4464640,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575199,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58728,"kb_used_data":9504,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94313112,"statfs":{"total":96636764160,"available":96576626688,"internally_reserved":0,"allocated":9732096,"data_stored":12891473,"data_compressed":1012016,"data_compressed_allocated":1646592,"data_compressed_original":4988928,"omap_allocated":1592,"internal_metadata":50395592},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575199,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":483328,"data_stored":307889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575198,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41316,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330524,"statfs":{"total":96636764160,"available":96594456576,"internally_reserved":0,"allocated":1863680,"data_stored":3021005,"data_compressed":393957,"data_compressed_allocated":561152,"data_compressed_original":1900544,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575199,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41200,"kb_used_data":5864,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330640,"statfs":{"total":96636764160,"available":96594575360,"internally_reserved":0,"allocated":6004736,"data_stored":9098638,"data_compressed":811981,"data_compressed_allocated":1212416,"data_compressed_original":4493312,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32531,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32531,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5648384,"data_stored":8389246,"data_compressed":779450,"data_compressed_allocated":1167360,"data_compressed_original":3919872,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1572864,"data_stored":2901981,"data_compressed":393957,"data_compressed_allocated":561152,"data_compressed_original":1900544,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":192512,"data_stored":188865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9441280,"data_stored":12772449,"data_compressed":1012016,"data_compressed_allocated":1646592,"data_compressed_original":4988928,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5300224,"data_stored":8388734,"data_compressed":911578,"data_compressed_allocated":1363968,"data_compressed_original":4464640,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10977280,"data_stored":16777888,"data_compressed":1639374,"data_compressed_allocated":2478080,"data_compressed_original":8286208,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15048704,"data_stored":23873923,"data_compressed":2507931,"data_compressed_allocated":3694592,"data_compressed_original":12525568,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T23:02:10.080 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-01T23:02:10.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.216+0000 7f469224e640 1 Processor -- start 2024-04-01T23:02:10.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.216+0000 7f469224e640 1 -- start start 2024-04-01T23:02:10.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.217+0000 7f469224e640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f468c0cee30 0x7f468c15afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:10.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.217+0000 7f469224e640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f468c0cdae0 con 0x7f468c0cc0d0 2024-04-01T23:02:10.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.217+0000 7f469224e640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f468c0c97d0 con 0x7f468c0c93f0 2024-04-01T23:02:10.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.217+0000 7f469224e640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f468c15b500 con 0x7f468c0cee30 2024-04-01T23:02:10.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.218+0000 7f468bfff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f468c0cc0d0 0x7f468c0cc560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60234/0 (socket says 172.21.15.47:60234) 2024-04-01T23:02:10.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.218+0000 7f468bfff640 1 -- 172.21.15.47:0/2405136748 learned_addr learned my addr 172.21.15.47:0/2405136748 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T23:02:10.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.218+0000 7f468affd640 1 --2- 172.21.15.47:0/2405136748 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f468c0cee30 0x7f468c15afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:10.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.220+0000 7f468a7fc640 1 -- 172.21.15.47:0/2405136748 <== mon.1 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2445339797 0 0) 0x7f468c0c97d0 con 0x7f468c0c93f0 2024-04-01T23:02:10.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.220+0000 7f468a7fc640 1 -- 172.21.15.47:0/2405136748 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4678003520 con 0x7f468c0c93f0 2024-04-01T23:02:10.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.220+0000 7f468a7fc640 1 -- 172.21.15.47:0/2405136748 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1477582428 0 0) 0x7f468c0cdae0 con 0x7f468c0cc0d0 2024-04-01T23:02:10.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.220+0000 7f468a7fc640 1 -- 172.21.15.47:0/2405136748 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f468c0c97d0 con 0x7f468c0cc0d0 2024-04-01T23:02:10.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.221+0000 7f468affd640 1 -- 172.21.15.47:0/2405136748 >> v1:172.21.15.181:6789/0 conn(0x7f468c0c93f0 legacy=0x7f468c06c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:10.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.221+0000 7f468affd640 1 -- 172.21.15.47:0/2405136748 >> v1:172.21.15.47:6789/0 conn(0x7f468c0cc0d0 legacy=0x7f468c0cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:10.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.221+0000 7f468affd640 1 -- 172.21.15.47:0/2405136748 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f468c0cdd80 con 0x7f468c0cee30 2024-04-01T23:02:10.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.223+0000 7f468affd640 1 --2- 172.21.15.47:0/2405136748 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f468c0cee30 0x7f468c15afc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f46740097d0 tx=0x7f467402b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91a1c76c61d28bca server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:02:10.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.227+0000 7f468a7fc640 1 -- 172.21.15.47:0/2405136748 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4674035020 con 0x7f468c0cee30 2024-04-01T23:02:10.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.227+0000 7f468a7fc640 1 -- 172.21.15.47:0/2405136748 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4674031800 con 0x7f468c0cee30 2024-04-01T23:02:10.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.227+0000 7f468a7fc640 1 -- 172.21.15.47:0/2405136748 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4674031bd0 con 0x7f468c0cee30 2024-04-01T23:02:10.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.227+0000 7f469224e640 1 -- 172.21.15.47:0/2405136748 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f468c0cee30 msgr2=0x7f468c15afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:10.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.227+0000 7f469224e640 1 --2- 172.21.15.47:0/2405136748 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f468c0cee30 0x7f468c15afc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f46740097d0 tx=0x7f467402b8a0 comp rx=0 tx=0).stop 2024-04-01T23:02:10.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.227+0000 7f469224e640 1 -- 172.21.15.47:0/2405136748 shutdown_connections 2024-04-01T23:02:10.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.227+0000 7f469224e640 1 --2- 172.21.15.47:0/2405136748 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f468c0cee30 0x7f468c15afc0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:10.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.227+0000 7f469224e640 1 -- 172.21.15.47:0/2405136748 >> 172.21.15.47:0/2405136748 conn(0x7f468c0cfdb0 msgr2=0x7f468c0d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:02:10.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.227+0000 7f469224e640 1 -- 172.21.15.47:0/2405136748 shutdown_connections 2024-04-01T23:02:10.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.227+0000 7f469224e640 1 -- 172.21.15.47:0/2405136748 wait complete. 2024-04-01T23:02:10.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.228+0000 7f469224e640 1 Processor -- start 2024-04-01T23:02:10.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.229+0000 7f469224e640 1 -- start start 2024-04-01T23:02:10.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.229+0000 7f469224e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f468c0c93f0 0x7f468c0c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:10.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.229+0000 7f469224e640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f468c0cc0d0 0x7f468c0b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:10.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.229+0000 7f469224e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f468c0cee30 0x7f468c1f0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:10.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.229+0000 7f469224e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f468c0ce620 con 0x7f468c0c93f0 2024-04-01T23:02:10.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.229+0000 7f469224e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f468c0ce340 con 0x7f468c0cee30 2024-04-01T23:02:10.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.229+0000 7f469224e640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f468c0cf430 con 0x7f468c0cc0d0 2024-04-01T23:02:10.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.230+0000 7f468b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f468c0c93f0 0x7f468c0c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:10.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.230+0000 7f468affd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f468c0cc0d0 0x7f468c0b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:10.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.230+0000 7f468bfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f468c0cee30 0x7f468c1f0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:10.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.230+0000 7f468b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f468c0c93f0 0x7f468c0c48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49854/0 (socket says 172.21.15.47:49854) 2024-04-01T23:02:10.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.230+0000 7f468b7fe640 1 -- 172.21.15.47:0/2327863465 learned_addr learned my addr 172.21.15.47:0/2327863465 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:02:10.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.234+0000 7f468bfff640 1 -- 172.21.15.47:0/2327863465 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f468c0cc0d0 msgr2=0x7f468c0b4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:10.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.234+0000 7f468bfff640 1 --2- 172.21.15.47:0/2327863465 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f468c0cc0d0 0x7f468c0b4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:10.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.234+0000 7f468bfff640 1 -- 172.21.15.47:0/2327863465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f468c0c93f0 msgr2=0x7f468c0c48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:10.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.234+0000 7f468bfff640 1 --2- 172.21.15.47:0/2327863465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f468c0c93f0 0x7f468c0c48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:10.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.234+0000 7f468bfff640 1 -- 172.21.15.47:0/2327863465 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f468c0c3a40 con 0x7f468c0cee30 2024-04-01T23:02:10.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.234+0000 7f468b7fe640 1 --2- 172.21.15.47:0/2327863465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f468c0c93f0 0x7f468c0c48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T23:02:10.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.236+0000 7f468bfff640 1 --2- 172.21.15.47:0/2327863465 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f468c0cee30 0x7f468c1f0530 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f468400ca80 tx=0x7f468400cf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:02:10.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.240+0000 7f4683fff640 1 -- 172.21.15.47:0/2327863465 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4684017070 con 0x7f468c0cee30 2024-04-01T23:02:10.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.240+0000 7f4683fff640 1 -- 172.21.15.47:0/2327863465 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f468400ac30 con 0x7f468c0cee30 2024-04-01T23:02:10.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.240+0000 7f4683fff640 1 -- 172.21.15.47:0/2327863465 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4684012400 con 0x7f468c0cee30 2024-04-01T23:02:10.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.240+0000 7f469224e640 1 -- 172.21.15.47:0/2327863465 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f468c0b2cb0 con 0x7f468c0cee30 2024-04-01T23:02:10.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.240+0000 7f469224e640 1 -- 172.21.15.47:0/2327863465 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f468c0c3ce0 con 0x7f468c0cee30 2024-04-01T23:02:10.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.241+0000 7f469224e640 1 -- 172.21.15.47:0/2327863465 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f468c068210 con 0x7f468c0cee30 2024-04-01T23:02:10.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.483+0000 7f4683fff640 1 -- 172.21.15.47:0/2327863465 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f468401a070 con 0x7f468c0cee30 2024-04-01T23:02:10.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.484+0000 7f4683fff640 1 --2- 172.21.15.47:0/2327863465 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f466c06b9c0 0x7f466c06de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:10.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.484+0000 7f468b7fe640 1 --2- 172.21.15.47:0/2327863465 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f466c06b9c0 0x7f466c06de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:10.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.484+0000 7f468b7fe640 1 --2- 172.21.15.47:0/2327863465 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f466c06b9c0 0x7f466c06de80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f467c001010 tx=0x7f467c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:02:10.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.490+0000 7f4683fff640 1 -- 172.21.15.47:0/2327863465 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f4684056e70 con 0x7f468c0cee30 2024-04-01T23:02:10.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.500+0000 7f4683fff640 1 -- 172.21.15.47:0/2327863465 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f4684021080 con 0x7f468c0cee30 2024-04-01T23:02:10.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.686+0000 7f469224e640 1 -- 172.21.15.47:0/2327863465 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f468c0cf7b0 con 0x7f468c0cee30 2024-04-01T23:02:10.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.893+0000 7f4683fff640 1 -- 172.21.15.47:0/2327863465 <== mon.1 v2:172.21.15.181:3300/0 7 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4684058dd0 con 0x7f468c0cee30 2024-04-01T23:02:10.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.893+0000 7f4683fff640 1 -- 172.21.15.47:0/2327863465 <== mon.1 v2:172.21.15.181:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7f468405ce70 con 0x7f468c0cee30 2024-04-01T23:02:10.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.895+0000 7f469224e640 1 -- 172.21.15.47:0/2327863465 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f466c06b9c0 msgr2=0x7f466c06de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:10.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.895+0000 7f469224e640 1 --2- 172.21.15.47:0/2327863465 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f466c06b9c0 0x7f466c06de80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f467c001010 tx=0x7f467c009040 comp rx=0 tx=0).stop 2024-04-01T23:02:10.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.896+0000 7f469224e640 1 -- 172.21.15.47:0/2327863465 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f468c0cee30 msgr2=0x7f468c1f0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:10.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.896+0000 7f469224e640 1 --2- 172.21.15.47:0/2327863465 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f468c0cee30 0x7f468c1f0530 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f468400ca80 tx=0x7f468400cf40 comp rx=0 tx=0).stop 2024-04-01T23:02:10.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.896+0000 7f469224e640 1 -- 172.21.15.47:0/2327863465 shutdown_connections 2024-04-01T23:02:10.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.896+0000 7f469224e640 1 --2- 172.21.15.47:0/2327863465 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f466c06b9c0 0x7f466c06de80 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:10.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.896+0000 7f469224e640 1 --2- 172.21.15.47:0/2327863465 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f468c0cee30 0x7f468c1f0530 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:10.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.896+0000 7f469224e640 1 --2- 172.21.15.47:0/2327863465 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f468c0cc0d0 0x7f468c0b4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:10.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.896+0000 7f469224e640 1 --2- 172.21.15.47:0/2327863465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f468c0c93f0 0x7f468c0c48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:10.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.896+0000 7f469224e640 1 -- 172.21.15.47:0/2327863465 >> 172.21.15.47:0/2327863465 conn(0x7f468c0cfdb0 msgr2=0x7f468c0c81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:02:10.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.896+0000 7f469224e640 1 -- 172.21.15.47:0/2327863465 shutdown_connections 2024-04-01T23:02:10.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:10.896+0000 7f469224e640 1 -- 172.21.15.47:0/2327863465 wait complete. 2024-04-01T23:02:10.906 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-01T23:02:10.906 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T23:02:11.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.011+0000 7fee226a4640 1 Processor -- start 2024-04-01T23:02:11.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.011+0000 7fee226a4640 1 -- start start 2024-04-01T23:02:11.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.012+0000 7fee226a4640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fee1c15aec0 0x7fee1c06c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:11.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.012+0000 7fee226a4640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fee1c15bb20 0x7fee1c15bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:11.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.012+0000 7fee226a4640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee1c154b70 con 0x7fee1c06c250 2024-04-01T23:02:11.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.012+0000 7fee226a4640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fee1c0ce990 con 0x7fee1c15bb20 2024-04-01T23:02:11.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.012+0000 7fee226a4640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7fee1c0cdac0 con 0x7fee1c15aec0 2024-04-01T23:02:11.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.013+0000 7fee1b7fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fee1c15aec0 0x7fee1c06c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:11.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.013+0000 7fee1b7fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fee1c15aec0 0x7fee1c06c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:53704/0 (socket says 172.21.15.47:53704) 2024-04-01T23:02:11.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.013+0000 7fee1b7fe640 1 -- 172.21.15.47:0/3036736232 learned_addr learned my addr 172.21.15.47:0/3036736232 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:02:11.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.015+0000 7fee1b7fe640 1 -- 172.21.15.47:0/3036736232 >> v2:172.21.15.47:3300/0 conn(0x7fee1c15bb20 msgr2=0x7fee1c15bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:02:11.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.015+0000 7fee1b7fe640 1 --2- 172.21.15.47:0/3036736232 >> v2:172.21.15.47:3300/0 conn(0x7fee1c15bb20 0x7fee1c15bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:11.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.015+0000 7fee1b7fe640 1 -- 172.21.15.47:0/3036736232 >> v1:172.21.15.47:6789/0 conn(0x7fee1c06c250 legacy=0x7fee1c0ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:02:11.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.015+0000 7fee1b7fe640 1 -- 172.21.15.47:0/3036736232 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee1c0cf2a0 con 0x7fee1c15aec0 2024-04-01T23:02:11.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.017+0000 7fee1b7fe640 1 --2- 172.21.15.47:0/3036736232 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fee1c15aec0 0x7fee1c06c630 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fee1c157fe0 tx=0x7fee0402b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=235d07c053dc2512 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:02:11.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.021+0000 7fee1affd640 1 -- 172.21.15.47:0/3036736232 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee04034070 con 0x7fee1c15aec0 2024-04-01T23:02:11.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.021+0000 7fee1affd640 1 -- 172.21.15.47:0/3036736232 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fee04030860 con 0x7fee1c15aec0 2024-04-01T23:02:11.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.021+0000 7fee1affd640 1 -- 172.21.15.47:0/3036736232 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee04030c50 con 0x7fee1c15aec0 2024-04-01T23:02:11.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.022+0000 7fee226a4640 1 -- 172.21.15.47:0/3036736232 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fee1c15aec0 msgr2=0x7fee1c06c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:11.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.022+0000 7fee226a4640 1 --2- 172.21.15.47:0/3036736232 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fee1c15aec0 0x7fee1c06c630 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fee1c157fe0 tx=0x7fee0402b9a0 comp rx=0 tx=0).stop 2024-04-01T23:02:11.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.022+0000 7fee226a4640 1 -- 172.21.15.47:0/3036736232 shutdown_connections 2024-04-01T23:02:11.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.022+0000 7fee226a4640 1 --2- 172.21.15.47:0/3036736232 >> v2:172.21.15.47:3300/0 conn(0x7fee1c15bb20 0x7fee1c15bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:11.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.022+0000 7fee226a4640 1 --2- 172.21.15.47:0/3036736232 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fee1c15aec0 0x7fee1c06c630 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:11.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.022+0000 7fee226a4640 1 -- 172.21.15.47:0/3036736232 >> 172.21.15.47:0/3036736232 conn(0x7fee1c0cfdb0 msgr2=0x7fee1c0d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:02:11.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.022+0000 7fee226a4640 1 -- 172.21.15.47:0/3036736232 shutdown_connections 2024-04-01T23:02:11.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.022+0000 7fee226a4640 1 -- 172.21.15.47:0/3036736232 wait complete. 2024-04-01T23:02:11.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.023+0000 7fee226a4640 1 Processor -- start 2024-04-01T23:02:11.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.023+0000 7fee226a4640 1 -- start start 2024-04-01T23:02:11.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.024+0000 7fee226a4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fee1c06c250 0x7fee1c0af9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:11.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.024+0000 7fee226a4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee1c15aec0 0x7fee1c0aff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:11.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.024+0000 7fee226a4640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fee1c15bb20 0x7fee1c0b0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:11.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.024+0000 7fee226a4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fee1c0ce340 con 0x7fee1c15aec0 2024-04-01T23:02:11.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.024+0000 7fee226a4640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fee1c0ce060 con 0x7fee1c06c250 2024-04-01T23:02:11.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.024+0000 7fee226a4640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7fee1c0ce620 con 0x7fee1c15bb20 2024-04-01T23:02:11.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.024+0000 7fee1bfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fee1c06c250 0x7fee1c0af9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:11.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.024+0000 7fee20c41640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fee1c15bb20 0x7fee1c0b0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:11.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.025+0000 7fee1bfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fee1c06c250 0x7fee1c0af9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:53714/0 (socket says 172.21.15.47:53714) 2024-04-01T23:02:11.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.025+0000 7fee1bfff640 1 -- 172.21.15.47:0/3056334508 learned_addr learned my addr 172.21.15.47:0/3056334508 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:02:11.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.028+0000 7fee1bfff640 1 -- 172.21.15.47:0/3056334508 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fee1c15bb20 msgr2=0x7fee1c0b0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:11.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.028+0000 7fee1bfff640 1 --2- 172.21.15.47:0/3056334508 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fee1c15bb20 0x7fee1c0b0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:11.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.028+0000 7fee1bfff640 1 -- 172.21.15.47:0/3056334508 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee1c15aec0 msgr2=0x7fee1c0aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:11.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.028+0000 7fee1bfff640 1 --2- 172.21.15.47:0/3056334508 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee1c15aec0 0x7fee1c0aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:11.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.028+0000 7fee1bfff640 1 -- 172.21.15.47:0/3056334508 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee1c0b05e0 con 0x7fee1c06c250 2024-04-01T23:02:11.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.031+0000 7fee1bfff640 1 --2- 172.21.15.47:0/3056334508 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fee1c06c250 0x7fee1c0af9d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fee0c00c470 tx=0x7fee0c00c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:02:11.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.035+0000 7fee18ff9640 1 -- 172.21.15.47:0/3056334508 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee0c017070 con 0x7fee1c06c250 2024-04-01T23:02:11.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.035+0000 7fee18ff9640 1 -- 172.21.15.47:0/3056334508 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fee0c0035f0 con 0x7fee1c06c250 2024-04-01T23:02:11.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.035+0000 7fee18ff9640 1 -- 172.21.15.47:0/3056334508 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee0c003a00 con 0x7fee1c06c250 2024-04-01T23:02:11.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.035+0000 7fee226a4640 1 -- 172.21.15.47:0/3056334508 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee1c0c6170 con 0x7fee1c06c250 2024-04-01T23:02:11.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.035+0000 7fee226a4640 1 -- 172.21.15.47:0/3056334508 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee1c0cae60 con 0x7fee1c06c250 2024-04-01T23:02:11.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.036+0000 7fee226a4640 1 -- 172.21.15.47:0/3056334508 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee1c15b2f0 con 0x7fee1c06c250 2024-04-01T23:02:11.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.280+0000 7fee18ff9640 1 -- 172.21.15.47:0/3056334508 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7fee0c01a070 con 0x7fee1c06c250 2024-04-01T23:02:11.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.280+0000 7fee18ff9640 1 --2- 172.21.15.47:0/3056334508 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fedfc06b990 0x7fedfc06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:11.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.280+0000 7fee1b7fe640 1 --2- 172.21.15.47:0/3056334508 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fedfc06b990 0x7fedfc06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:11.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.281+0000 7fee1b7fe640 1 --2- 172.21.15.47:0/3056334508 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fedfc06b990 0x7fedfc06de50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fee04036000 tx=0x7fee0403b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:02:11.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.284+0000 7fee18ff9640 1 -- 172.21.15.47:0/3056334508 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fee0c056550 con 0x7fee1c06c250 2024-04-01T23:02:11.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.294+0000 7fee18ff9640 1 -- 172.21.15.47:0/3056334508 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fee1c15b2f0 con 0x7fee1c06c250 2024-04-01T23:02:11.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.516+0000 7fee226a4640 1 -- 172.21.15.47:0/3056334508 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fee1c15d550 con 0x7fee1c06c250 2024-04-01T23:02:11.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.529+0000 7fee18ff9640 1 -- 172.21.15.47:0/3056334508 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6835 (secure 0 0 0) 0x7fee0c021080 con 0x7fee1c06c250 2024-04-01T23:02:11.525 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T23:02:11.525 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4222,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/1297694239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1297694239},{"type":"v1","addr":"172.21.15.181:6835","nonce":1297694239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4225,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/2435310452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":2435310452},{"type":"v1","addr":"172.21.15.181:6837","nonce":2435310452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4228,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1974242436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1974242436},{"type":"v1","addr":"172.21.15.47:6839","nonce":1974242436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/4251771217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":4251771217},{"type":"v1","addr":"172.21.15.47:6837","nonce":4251771217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/1534194215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1534194215},{"type":"v1","addr":"172.21.15.181:6833","nonce":1534194215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-01T22:33:27.610692+0000","modified":"2024-04-01T22:34:00.874320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.47:6835/1610100855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":1610100855},{"type":"v1","addr":"172.21.15.47:6835","nonce":1610100855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4254,"qdb_cluster":[4254]},"id":1}]} 2024-04-01T23:02:11.525 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 9 2024-04-01T23:02:11.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.531+0000 7fee226a4640 1 -- 172.21.15.47:0/3056334508 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fedfc06b990 msgr2=0x7fedfc06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:11.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.531+0000 7fee226a4640 1 --2- 172.21.15.47:0/3056334508 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fedfc06b990 0x7fedfc06de50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fee04036000 tx=0x7fee0403b040 comp rx=0 tx=0).stop 2024-04-01T23:02:11.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.531+0000 7fee226a4640 1 -- 172.21.15.47:0/3056334508 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fee1c06c250 msgr2=0x7fee1c0af9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:11.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.531+0000 7fee226a4640 1 --2- 172.21.15.47:0/3056334508 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fee1c06c250 0x7fee1c0af9d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fee0c00c470 tx=0x7fee0c00c930 comp rx=0 tx=0).stop 2024-04-01T23:02:11.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.531+0000 7fee226a4640 1 -- 172.21.15.47:0/3056334508 shutdown_connections 2024-04-01T23:02:11.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.531+0000 7fee226a4640 1 --2- 172.21.15.47:0/3056334508 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7fedfc06b990 0x7fedfc06de50 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:11.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.531+0000 7fee226a4640 1 --2- 172.21.15.47:0/3056334508 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7fee1c15bb20 0x7fee1c0b0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:11.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.531+0000 7fee226a4640 1 --2- 172.21.15.47:0/3056334508 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee1c15aec0 0x7fee1c0aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:11.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.531+0000 7fee226a4640 1 --2- 172.21.15.47:0/3056334508 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fee1c06c250 0x7fee1c0af9d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:11.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.531+0000 7fee226a4640 1 -- 172.21.15.47:0/3056334508 >> 172.21.15.47:0/3056334508 conn(0x7fee1c0cfdb0 msgr2=0x7fee1c1542a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:02:11.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.531+0000 7fee226a4640 1 -- 172.21.15.47:0/3056334508 shutdown_connections 2024-04-01T23:02:11.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.531+0000 7fee226a4640 1 -- 172.21.15.47:0/3056334508 wait complete. 2024-04-01T23:02:11.538 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T23:02:11.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.645+0000 7f8122078640 1 Processor -- start 2024-04-01T23:02:11.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.645+0000 7f8122078640 1 -- start start 2024-04-01T23:02:11.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.646+0000 7f8122078640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f811c06c250 0x7f811c15aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:11.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.646+0000 7f8122078640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f811c06c630 0x7f811c0ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:11.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.646+0000 7f8122078640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f811c0cf0d0 0x7f811c15bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:11.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.647+0000 7f8122078640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f811c0ce990 con 0x7f811c06c250 2024-04-01T23:02:11.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.647+0000 7f8122078640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f811c154b70 con 0x7f811c0cf0d0 2024-04-01T23:02:11.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.647+0000 7f8122078640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f811c0cdac0 con 0x7f811c06c630 2024-04-01T23:02:11.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.647+0000 7f811b7fe640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f811c06c250 0x7f811c15aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:11.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.647+0000 7f811bfff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f811c0cf0d0 0x7f811c15bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:11.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.647+0000 7f811bfff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f811c0cf0d0 0x7f811c15bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:53718/0 (socket says 172.21.15.47:53718) 2024-04-01T23:02:11.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.647+0000 7f811b7fe640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f811c06c250 0x7f811c15aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49868/0 (socket says 172.21.15.47:49868) 2024-04-01T23:02:11.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.647+0000 7f811bfff640 1 -- 172.21.15.47:0/469434989 learned_addr learned my addr 172.21.15.47:0/469434989 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:02:11.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.649+0000 7f811affd640 1 --2- 172.21.15.47:0/469434989 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f811c06c630 0x7f811c0ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:11.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.650+0000 7f811b7fe640 1 -- 172.21.15.47:0/469434989 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f811c06c630 msgr2=0x7f811c0ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:02:11.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.650+0000 7f811b7fe640 1 --2- 172.21.15.47:0/469434989 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f811c06c630 0x7f811c0ceb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:11.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.650+0000 7f811b7fe640 1 -- 172.21.15.47:0/469434989 >> v2:172.21.15.181:3300/0 conn(0x7f811c0cf0d0 msgr2=0x7f811c15bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:02:11.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.650+0000 7f811b7fe640 1 --2- 172.21.15.47:0/469434989 >> v2:172.21.15.181:3300/0 conn(0x7f811c0cf0d0 0x7f811c15bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:11.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.650+0000 7f811b7fe640 1 -- 172.21.15.47:0/469434989 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f811c0cdd80 con 0x7f811c06c250 2024-04-01T23:02:11.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.650+0000 7f811bfff640 1 --2- 172.21.15.47:0/469434989 >> v2:172.21.15.181:3300/0 conn(0x7f811c0cf0d0 0x7f811c15bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T23:02:11.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.652+0000 7f811b7fe640 1 --2- 172.21.15.47:0/469434989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f811c06c250 0x7f811c15aec0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f811c0cd730 tx=0x7f811002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cc7c342eaab0fb9 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:02:11.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.656+0000 7f811a7fc640 1 -- 172.21.15.47:0/469434989 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8110035020 con 0x7f811c06c250 2024-04-01T23:02:11.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.656+0000 7f811a7fc640 1 -- 172.21.15.47:0/469434989 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8110031830 con 0x7f811c06c250 2024-04-01T23:02:11.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.656+0000 7f811a7fc640 1 -- 172.21.15.47:0/469434989 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8110031c20 con 0x7f811c06c250 2024-04-01T23:02:11.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.657+0000 7f8122078640 1 -- 172.21.15.47:0/469434989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f811c06c250 msgr2=0x7f811c15aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:11.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.657+0000 7f8122078640 1 --2- 172.21.15.47:0/469434989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f811c06c250 0x7f811c15aec0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f811c0cd730 tx=0x7f811002b8d0 comp rx=0 tx=0).stop 2024-04-01T23:02:11.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.657+0000 7f8122078640 1 -- 172.21.15.47:0/469434989 shutdown_connections 2024-04-01T23:02:11.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.657+0000 7f8122078640 1 --2- 172.21.15.47:0/469434989 >> v2:172.21.15.181:3300/0 conn(0x7f811c0cf0d0 0x7f811c15bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:11.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.657+0000 7f8122078640 1 --2- 172.21.15.47:0/469434989 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f811c06c630 0x7f811c0ceb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:11.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.657+0000 7f8122078640 1 --2- 172.21.15.47:0/469434989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f811c06c250 0x7f811c15aec0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:11.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.657+0000 7f8122078640 1 -- 172.21.15.47:0/469434989 >> 172.21.15.47:0/469434989 conn(0x7f811c0cfdb0 msgr2=0x7f811c0d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:02:11.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.657+0000 7f8122078640 1 -- 172.21.15.47:0/469434989 shutdown_connections 2024-04-01T23:02:11.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.657+0000 7f8122078640 1 -- 172.21.15.47:0/469434989 wait complete. 2024-04-01T23:02:11.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.658+0000 7f8122078640 1 Processor -- start 2024-04-01T23:02:11.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.658+0000 7f8122078640 1 -- start start 2024-04-01T23:02:11.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.659+0000 7f8122078640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f811c06c250 0x7f811c150230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:11.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.659+0000 7f8122078640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f811c06c630 0x7f811c0b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:11.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.659+0000 7f8122078640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f811c14ecc0 0x7f811c0b4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:11.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.659+0000 7f8122078640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f811c0ce620 con 0x7f811c06c630 2024-04-01T23:02:11.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.659+0000 7f8122078640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f811c0ce340 con 0x7f811c06c250 2024-04-01T23:02:11.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.659+0000 7f8122078640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f811c06ca30 con 0x7f811c14ecc0 2024-04-01T23:02:11.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.660+0000 7f811affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f811c06c630 0x7f811c0b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:11.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.660+0000 7f811bfff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f811c14ecc0 0x7f811c0b4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:11.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.660+0000 7f811b7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f811c06c250 0x7f811c150230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:11.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.660+0000 7f811bfff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f811c14ecc0 0x7f811c0b4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:50122/0 (socket says 172.21.15.47:50122) 2024-04-01T23:02:11.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.660+0000 7f811bfff640 1 -- 172.21.15.47:0/3295297277 learned_addr learned my addr 172.21.15.47:0/3295297277 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:02:11.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.663+0000 7f811bfff640 1 -- 172.21.15.47:0/3295297277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f811c06c250 msgr2=0x7f811c150230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:11.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.663+0000 7f811bfff640 1 --2- 172.21.15.47:0/3295297277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f811c06c250 0x7f811c150230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:11.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.663+0000 7f811bfff640 1 -- 172.21.15.47:0/3295297277 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f811c06c630 msgr2=0x7f811c0b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:11.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.663+0000 7f811bfff640 1 --2- 172.21.15.47:0/3295297277 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f811c06c630 0x7f811c0b3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:11.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.663+0000 7f811bfff640 1 -- 172.21.15.47:0/3295297277 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f811c14f790 con 0x7f811c14ecc0 2024-04-01T23:02:11.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.666+0000 7f811bfff640 1 --2- 172.21.15.47:0/3295297277 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f811c14ecc0 0x7f811c0b4340 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8114009e50 tx=0x7f811400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:02:11.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.669+0000 7f8103fff640 1 -- 172.21.15.47:0/3295297277 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f811400cd80 con 0x7f811c14ecc0 2024-04-01T23:02:11.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.670+0000 7f8103fff640 1 -- 172.21.15.47:0/3295297277 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8114019070 con 0x7f811c14ecc0 2024-04-01T23:02:11.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.670+0000 7f8122078640 1 -- 172.21.15.47:0/3295297277 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f811c1f1750 con 0x7f811c14ecc0 2024-04-01T23:02:11.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.670+0000 7f8103fff640 1 -- 172.21.15.47:0/3295297277 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81140146e0 con 0x7f811c14ecc0 2024-04-01T23:02:11.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.670+0000 7f8122078640 1 -- 172.21.15.47:0/3295297277 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f811c0b4e50 con 0x7f811c14ecc0 2024-04-01T23:02:11.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.670+0000 7f8122078640 1 -- 172.21.15.47:0/3295297277 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f811c0cb6b0 con 0x7f811c14ecc0 2024-04-01T23:02:11.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.916+0000 7f8103fff640 1 -- 172.21.15.47:0/3295297277 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f8114005d10 con 0x7f811c14ecc0 2024-04-01T23:02:11.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.916+0000 7f8103fff640 1 --2- 172.21.15.47:0/3295297277 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f810806b9e0 0x7f810806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:11.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.916+0000 7f811b7fe640 1 --2- 172.21.15.47:0/3295297277 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f810806b9e0 0x7f810806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:11.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.917+0000 7f811b7fe640 1 --2- 172.21.15.47:0/3295297277 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f810806b9e0 0x7f810806dea0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8110036000 tx=0x7f8110008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:02:11.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.919+0000 7f8103fff640 1 -- 172.21.15.47:0/3295297277 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f8114057c80 con 0x7f811c14ecc0 2024-04-01T23:02:11.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:11.929+0000 7f8103fff640 1 -- 172.21.15.47:0/3295297277 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f811c0cb6b0 con 0x7f811c14ecc0 2024-04-01T23:02:12.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.160+0000 7f8122078640 1 -- 172.21.15.47:0/3295297277 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f811c068210 con 0x7f811c14ecc0 2024-04-01T23:02:12.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.173+0000 7f8103fff640 1 -- 172.21.15.47:0/3295297277 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6835 (secure 0 0 0) 0x7f8114010040 con 0x7f811c14ecc0 2024-04-01T23:02:12.168 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T23:02:12.169 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4222,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/1297694239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1297694239},{"type":"v1","addr":"172.21.15.181:6835","nonce":1297694239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4225,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/2435310452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":2435310452},{"type":"v1","addr":"172.21.15.181:6837","nonce":2435310452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4228,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/1974242436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":1974242436},{"type":"v1","addr":"172.21.15.47:6839","nonce":1974242436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/4251771217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":4251771217},{"type":"v1","addr":"172.21.15.47:6837","nonce":4251771217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/1534194215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":1534194215},{"type":"v1","addr":"172.21.15.181:6833","nonce":1534194215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-01T22:33:27.610692+0000","modified":"2024-04-01T22:34:00.874320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.47:6835/1610100855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":1610100855},{"type":"v1","addr":"172.21.15.47:6835","nonce":1610100855}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4254,"qdb_cluster":[4254]},"id":1}]} 2024-04-01T23:02:12.169 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 9 2024-04-01T23:02:12.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.174+0000 7f8122078640 1 -- 172.21.15.47:0/3295297277 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f810806b9e0 msgr2=0x7f810806dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:12.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.175+0000 7f8122078640 1 --2- 172.21.15.47:0/3295297277 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f810806b9e0 0x7f810806dea0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8110036000 tx=0x7f8110008030 comp rx=0 tx=0).stop 2024-04-01T23:02:12.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.175+0000 7f8122078640 1 -- 172.21.15.47:0/3295297277 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f811c14ecc0 msgr2=0x7f811c0b4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:12.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.175+0000 7f8122078640 1 --2- 172.21.15.47:0/3295297277 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f811c14ecc0 0x7f811c0b4340 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8114009e50 tx=0x7f811400c490 comp rx=0 tx=0).stop 2024-04-01T23:02:12.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.175+0000 7f8122078640 1 -- 172.21.15.47:0/3295297277 shutdown_connections 2024-04-01T23:02:12.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.175+0000 7f8122078640 1 --2- 172.21.15.47:0/3295297277 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f810806b9e0 0x7f810806dea0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:12.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.175+0000 7f8122078640 1 --2- 172.21.15.47:0/3295297277 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f811c14ecc0 0x7f811c0b4340 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:12.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.175+0000 7f8122078640 1 --2- 172.21.15.47:0/3295297277 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f811c06c630 0x7f811c0b3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:12.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.175+0000 7f8122078640 1 --2- 172.21.15.47:0/3295297277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f811c06c250 0x7f811c150230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:12.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.175+0000 7f8122078640 1 -- 172.21.15.47:0/3295297277 >> 172.21.15.47:0/3295297277 conn(0x7f811c0cfdb0 msgr2=0x7f811c154090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:02:12.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.175+0000 7f8122078640 1 -- 172.21.15.47:0/3295297277 shutdown_connections 2024-04-01T23:02:12.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.175+0000 7f8122078640 1 -- 172.21.15.47:0/3295297277 wait complete. 2024-04-01T23:02:12.182 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T23:02:12.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.288+0000 7f7349bfd640 1 Processor -- start 2024-04-01T23:02:12.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.288+0000 7f7349bfd640 1 -- start start 2024-04-01T23:02:12.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.289+0000 7f7349bfd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f73440ca090 0x7f73440ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:12.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.289+0000 7f7349bfd640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f734415bd90 0x7f734415c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:12.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.289+0000 7f7349bfd640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73441528b0 con 0x7f73441524d0 2024-04-01T23:02:12.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.289+0000 7f7349bfd640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f7344159130 con 0x7f734415bd90 2024-04-01T23:02:12.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.289+0000 7f7349bfd640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f73441585b0 con 0x7f73440ca090 2024-04-01T23:02:12.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.290+0000 7f7343fff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f734415bd90 0x7f734415c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:12.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.290+0000 7f7342ffd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f73440ca090 0x7f73440ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:12.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.290+0000 7f73437fe640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f73441524d0 0x7f73440c8980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60250/0 (socket says 172.21.15.47:60250) 2024-04-01T23:02:12.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.290+0000 7f73437fe640 1 -- 172.21.15.47:0/1433334280 learned_addr learned my addr 172.21.15.47:0/1433334280 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T23:02:12.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.292+0000 7f7342ffd640 1 -- 172.21.15.47:0/1433334280 >> v2:172.21.15.181:3300/0 conn(0x7f734415bd90 msgr2=0x7f734415c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:02:12.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.292+0000 7f7342ffd640 1 --2- 172.21.15.47:0/1433334280 >> v2:172.21.15.181:3300/0 conn(0x7f734415bd90 0x7f734415c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:12.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.292+0000 7f7342ffd640 1 -- 172.21.15.47:0/1433334280 >> v1:172.21.15.47:6789/0 conn(0x7f73441524d0 legacy=0x7f73440c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:12.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.292+0000 7f7342ffd640 1 -- 172.21.15.47:0/1433334280 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7344158890 con 0x7f73440ca090 2024-04-01T23:02:12.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.292+0000 7f7343fff640 1 --2- 172.21.15.47:0/1433334280 >> v2:172.21.15.181:3300/0 conn(0x7f734415bd90 0x7f734415c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T23:02:12.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.294+0000 7f7342ffd640 1 --2- 172.21.15.47:0/1433334280 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f73440ca090 0x7f73440ca4d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f732c0097a0 tx=0x7f732c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afe184e7be35a304 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:02:12.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.298+0000 7f73427fc640 1 -- 172.21.15.47:0/1433334280 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f732c035020 con 0x7f73440ca090 2024-04-01T23:02:12.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.298+0000 7f73427fc640 1 -- 172.21.15.47:0/1433334280 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f732c031830 con 0x7f73440ca090 2024-04-01T23:02:12.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.298+0000 7f73427fc640 1 -- 172.21.15.47:0/1433334280 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f732c031c20 con 0x7f73440ca090 2024-04-01T23:02:12.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.298+0000 7f7349bfd640 1 -- 172.21.15.47:0/1433334280 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f73440ca090 msgr2=0x7f73440ca4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:12.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.298+0000 7f7349bfd640 1 --2- 172.21.15.47:0/1433334280 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f73440ca090 0x7f73440ca4d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f732c0097a0 tx=0x7f732c02b8d0 comp rx=0 tx=0).stop 2024-04-01T23:02:12.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.299+0000 7f7349bfd640 1 -- 172.21.15.47:0/1433334280 shutdown_connections 2024-04-01T23:02:12.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.299+0000 7f7349bfd640 1 --2- 172.21.15.47:0/1433334280 >> v2:172.21.15.181:3300/0 conn(0x7f734415bd90 0x7f734415c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:12.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.299+0000 7f7349bfd640 1 --2- 172.21.15.47:0/1433334280 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f73440ca090 0x7f73440ca4d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:12.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.299+0000 7f7349bfd640 1 -- 172.21.15.47:0/1433334280 >> 172.21.15.47:0/1433334280 conn(0x7f7344071330 msgr2=0x7f7344071740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:02:12.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.299+0000 7f7349bfd640 1 -- 172.21.15.47:0/1433334280 shutdown_connections 2024-04-01T23:02:12.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.299+0000 7f7349bfd640 1 -- 172.21.15.47:0/1433334280 wait complete. 2024-04-01T23:02:12.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.300+0000 7f7349bfd640 1 Processor -- start 2024-04-01T23:02:12.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.300+0000 7f7349bfd640 1 -- start start 2024-04-01T23:02:12.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.301+0000 7f7349bfd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f73440ca090 0x7f734406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:12.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.301+0000 7f7349bfd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f73441524d0 0x7f73441f3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:12.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.301+0000 7f7349bfd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f734415bd90 0x7f73441f4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:12.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.301+0000 7f7349bfd640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f734415b870 con 0x7f73440ca090 2024-04-01T23:02:12.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.301+0000 7f7349bfd640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7344158e50 con 0x7f734415bd90 2024-04-01T23:02:12.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.301+0000 7f7349bfd640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f73440c9090 con 0x7f73441524d0 2024-04-01T23:02:12.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.301+0000 7f73437fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f73440ca090 0x7f734406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:12.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.301+0000 7f7342ffd640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f73441524d0 0x7f73441f3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:12.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.301+0000 7f7343fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f734415bd90 0x7f73441f4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:12.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.302+0000 7f73437fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f73440ca090 0x7f734406d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49876/0 (socket says 172.21.15.47:49876) 2024-04-01T23:02:12.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.302+0000 7f73437fe640 1 -- 172.21.15.47:0/4169071769 learned_addr learned my addr 172.21.15.47:0/4169071769 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:02:12.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.305+0000 7f7342ffd640 1 -- 172.21.15.47:0/4169071769 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f734415bd90 msgr2=0x7f73441f4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:12.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.305+0000 7f7342ffd640 1 --2- 172.21.15.47:0/4169071769 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f734415bd90 0x7f73441f4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:12.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.305+0000 7f7342ffd640 1 -- 172.21.15.47:0/4169071769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f73440ca090 msgr2=0x7f734406d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:12.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.305+0000 7f7342ffd640 1 --2- 172.21.15.47:0/4169071769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f73440ca090 0x7f734406d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:12.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.305+0000 7f7342ffd640 1 -- 172.21.15.47:0/4169071769 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73440cba20 con 0x7f73441524d0 2024-04-01T23:02:12.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.307+0000 7f7342ffd640 1 --2- 172.21.15.47:0/4169071769 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f73441524d0 0x7f73441f3c30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7344158730 tx=0x7f732c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:02:12.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.311+0000 7f733bfff640 1 -- 172.21.15.47:0/4169071769 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f732c041070 con 0x7f73441524d0 2024-04-01T23:02:12.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.311+0000 7f733bfff640 1 -- 172.21.15.47:0/4169071769 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f732c03f070 con 0x7f73441524d0 2024-04-01T23:02:12.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.311+0000 7f733bfff640 1 -- 172.21.15.47:0/4169071769 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f732c035040 con 0x7f73441524d0 2024-04-01T23:02:12.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.311+0000 7f7349bfd640 1 -- 172.21.15.47:0/4169071769 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73440cbdf0 con 0x7f73441524d0 2024-04-01T23:02:12.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.311+0000 7f7349bfd640 1 -- 172.21.15.47:0/4169071769 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f734414ad60 con 0x7f73441524d0 2024-04-01T23:02:12.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.312+0000 7f7349bfd640 1 -- 172.21.15.47:0/4169071769 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7344068210 con 0x7f73441524d0 2024-04-01T23:02:12.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.330+0000 7f733bfff640 1 -- 172.21.15.47:0/4169071769 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f732c038020 con 0x7f73441524d0 2024-04-01T23:02:12.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.330+0000 7f733bfff640 1 --2- 172.21.15.47:0/4169071769 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f732406b9e0 0x7f732406dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:12.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.331+0000 7f73437fe640 1 --2- 172.21.15.47:0/4169071769 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f732406b9e0 0x7f732406dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:12.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.331+0000 7f73437fe640 1 --2- 172.21.15.47:0/4169071769 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f732406b9e0 0x7f732406dea0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7334004e40 tx=0x7f7334007f10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:02:12.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.334+0000 7f733bfff640 1 -- 172.21.15.47:0/4169071769 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f732c078ad0 con 0x7f73441524d0 2024-04-01T23:02:12.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.568+0000 7f733bfff640 1 -- 172.21.15.47:0/4169071769 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f732c07b130 con 0x7f73441524d0 2024-04-01T23:02:12.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.751+0000 7f7349bfd640 1 -- 172.21.15.47:0/4169071769 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f73440c9330 con 0x7f73441524d0 2024-04-01T23:02:12.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.790+0000 7f733bfff640 1 -- 172.21.15.47:0/4169071769 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18914 (secure 0 0 0) 0x7f732c07aa30 con 0x7f73441524d0 2024-04-01T23:02:12.786 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-01T23:02:12.786 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":27,"fsid":"a6998a48-38bc-4e42-b0d9-04f2fb5c3c87","created":"2024-04-01T22:32:57.112033+0000","modified":"2024-04-01T22:34:04.850029+0000","last_up_change":"2024-04-01T22:33:11.141073+0000","last_in_change":"2024-04-01T22:33:02.650459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T22:33:13.356568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T22:33:25.309421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T22:33:26.268050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-01T22:33:30.588103+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7bd3f25d-e3a5-4932-b381-53dcbb464dde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6811","nonce":3827395709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6813","nonce":3827395709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6817","nonce":3827395709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":3827395709},{"type":"v1","addr":"172.21.15.47:6815","nonce":3827395709}]},"public_addr":"172.21.15.47:6811/3827395709","cluster_addr":"172.21.15.47:6813/3827395709","heartbeat_back_addr":"172.21.15.47:6817/3827395709","heartbeat_front_addr":"172.21.15.47:6815/3827395709","state":["exists","up"]},{"osd":1,"uuid":"2aa60ba2-67ff-43c7-96c4-82ae2f3855ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6827","nonce":3152157503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6829","nonce":3152157503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6833","nonce":3152157503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3152157503},{"type":"v1","addr":"172.21.15.47:6831","nonce":3152157503}]},"public_addr":"172.21.15.47:6827/3152157503","cluster_addr":"172.21.15.47:6829/3152157503","heartbeat_back_addr":"172.21.15.47:6833/3152157503","heartbeat_front_addr":"172.21.15.47:6831/3152157503","state":["exists","up"]},{"osd":2,"uuid":"d83f8a98-6db8-42b7-9ef6-5b16eb9a3492","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6803","nonce":1003968856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6805","nonce":1003968856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6809","nonce":1003968856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":1003968856},{"type":"v1","addr":"172.21.15.47:6807","nonce":1003968856}]},"public_addr":"172.21.15.47:6803/1003968856","cluster_addr":"172.21.15.47:6805/1003968856","heartbeat_back_addr":"172.21.15.47:6809/1003968856","heartbeat_front_addr":"172.21.15.47:6807/1003968856","state":["exists","up"]},{"osd":3,"uuid":"edc02ed5-d25c-4dc9-a0c3-7a26f20fae07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6819","nonce":2845699561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6821","nonce":2845699561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6825","nonce":2845699561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2845699561},{"type":"v1","addr":"172.21.15.47:6823","nonce":2845699561}]},"public_addr":"172.21.15.47:6819/2845699561","cluster_addr":"172.21.15.47:6821/2845699561","heartbeat_back_addr":"172.21.15.47:6825/2845699561","heartbeat_front_addr":"172.21.15.47:6823/2845699561","state":["exists","up"]},{"osd":4,"uuid":"b3d67e74-f51e-4474-9c62-dd0daa60c728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6809","nonce":2961538461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6811","nonce":2961538461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6815","nonce":2961538461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":2961538461},{"type":"v1","addr":"172.21.15.181:6813","nonce":2961538461}]},"public_addr":"172.21.15.181:6809/2961538461","cluster_addr":"172.21.15.181:6811/2961538461","heartbeat_back_addr":"172.21.15.181:6815/2961538461","heartbeat_front_addr":"172.21.15.181:6813/2961538461","state":["exists","up"]},{"osd":5,"uuid":"d86e8f7a-99f4-4457-9949-cf2cb853e79b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6817","nonce":2161566540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6819","nonce":2161566540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6823","nonce":2161566540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2161566540},{"type":"v1","addr":"172.21.15.181:6821","nonce":2161566540}]},"public_addr":"172.21.15.181:6817/2161566540","cluster_addr":"172.21.15.181:6819/2161566540","heartbeat_back_addr":"172.21.15.181:6823/2161566540","heartbeat_front_addr":"172.21.15.181:6821/2161566540","state":["exists","up"]},{"osd":6,"uuid":"aa08266c-1719-4abd-afb9-e7e8ac593658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6801","nonce":3792144865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6803","nonce":3792144865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6807","nonce":3792144865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3792144865},{"type":"v1","addr":"172.21.15.181:6805","nonce":3792144865}]},"public_addr":"172.21.15.181:6801/3792144865","cluster_addr":"172.21.15.181:6803/3792144865","heartbeat_back_addr":"172.21.15.181:6807/3792144865","heartbeat_front_addr":"172.21.15.181:6805/3792144865","state":["exists","up"]},{"osd":7,"uuid":"6e509762-24c8-46c3-93a1-4c50b11ebcf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6825","nonce":1760995885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6827","nonce":1760995885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6831","nonce":1760995885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1760995885},{"type":"v1","addr":"172.21.15.181:6829","nonce":1760995885}]},"public_addr":"172.21.15.181:6825/1760995885","cluster_addr":"172.21.15.181:6827/1760995885","heartbeat_back_addr":"172.21.15.181:6831/1760995885","heartbeat_front_addr":"172.21.15.181:6829/1760995885","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.202426+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.255318+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.170288+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.290065+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.214871+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.176432+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.139940+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T22:33:08.299546+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.15","mappings":[{"from":7,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T23:02:12.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.792+0000 7f7349bfd640 1 -- 172.21.15.47:0/4169071769 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f732406b9e0 msgr2=0x7f732406dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:12.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.792+0000 7f7349bfd640 1 --2- 172.21.15.47:0/4169071769 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f732406b9e0 0x7f732406dea0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7334004e40 tx=0x7f7334007f10 comp rx=0 tx=0).stop 2024-04-01T23:02:12.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.792+0000 7f7349bfd640 1 -- 172.21.15.47:0/4169071769 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f73441524d0 msgr2=0x7f73441f3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:12.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.792+0000 7f7349bfd640 1 --2- 172.21.15.47:0/4169071769 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f73441524d0 0x7f73441f3c30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7344158730 tx=0x7f732c0046c0 comp rx=0 tx=0).stop 2024-04-01T23:02:12.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.792+0000 7f7349bfd640 1 -- 172.21.15.47:0/4169071769 shutdown_connections 2024-04-01T23:02:12.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.792+0000 7f7349bfd640 1 --2- 172.21.15.47:0/4169071769 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f732406b9e0 0x7f732406dea0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:12.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.792+0000 7f7349bfd640 1 --2- 172.21.15.47:0/4169071769 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f734415bd90 0x7f73441f4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:12.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.792+0000 7f7349bfd640 1 --2- 172.21.15.47:0/4169071769 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f73441524d0 0x7f73441f3c30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:12.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.792+0000 7f7349bfd640 1 --2- 172.21.15.47:0/4169071769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f73440ca090 0x7f734406d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:12.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.792+0000 7f7349bfd640 1 -- 172.21.15.47:0/4169071769 >> 172.21.15.47:0/4169071769 conn(0x7f7344071330 msgr2=0x7f7344151480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:02:12.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.792+0000 7f7349bfd640 1 -- 172.21.15.47:0/4169071769 shutdown_connections 2024-04-01T23:02:12.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.792+0000 7f7349bfd640 1 -- 172.21.15.47:0/4169071769 wait complete. 2024-04-01T23:02:12.801 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-01T23:02:12.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.908+0000 7f6422fa0640 1 Processor -- start 2024-04-01T23:02:12.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.908+0000 7f6422fa0640 1 -- start start 2024-04-01T23:02:12.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.909+0000 7f6422fa0640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f641c154340 0x7f641c0c5680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:12.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.909+0000 7f6422fa0640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f641c0ca320 0x7f641c0cab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:12.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.909+0000 7f6422fa0640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f641c15a1a0 con 0x7f641c0cb0d0 2024-04-01T23:02:12.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.909+0000 7f6422fa0640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f641c0c5bc0 con 0x7f641c0ca320 2024-04-01T23:02:12.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.909+0000 7f6422fa0640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f641c15a460 con 0x7f641c154340 2024-04-01T23:02:12.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.910+0000 7f642179d640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f641c0ca320 0x7f641c0cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:12.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.910+0000 7f6421f9e640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f641c154340 0x7f641c0c5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:12.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.910+0000 7f642279f640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f641c0cb0d0 0x7f641c15dc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60264/0 (socket says 172.21.15.47:60264) 2024-04-01T23:02:12.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.910+0000 7f642279f640 1 -- 172.21.15.47:0/3987985917 learned_addr learned my addr 172.21.15.47:0/3987985917 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T23:02:12.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.912+0000 7f6421f9e640 1 -- 172.21.15.47:0/3987985917 >> v2:172.21.15.47:3300/0 conn(0x7f641c0ca320 msgr2=0x7f641c0cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:02:12.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.912+0000 7f6421f9e640 1 --2- 172.21.15.47:0/3987985917 >> v2:172.21.15.47:3300/0 conn(0x7f641c0ca320 0x7f641c0cab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:12.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.912+0000 7f6421f9e640 1 -- 172.21.15.47:0/3987985917 >> v1:172.21.15.47:6789/0 conn(0x7f641c0cb0d0 legacy=0x7f641c15dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:12.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.912+0000 7f6421f9e640 1 -- 172.21.15.47:0/3987985917 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f641c15a740 con 0x7f641c154340 2024-04-01T23:02:12.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.914+0000 7f6421f9e640 1 --2- 172.21.15.47:0/3987985917 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f641c154340 0x7f641c0c5680 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f64180097a0 tx=0x7f641802b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ace5f96ba92f855 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:02:12.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.918+0000 7f6420f9c640 1 -- 172.21.15.47:0/3987985917 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6418034070 con 0x7f641c154340 2024-04-01T23:02:12.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.918+0000 7f6420f9c640 1 -- 172.21.15.47:0/3987985917 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6418030610 con 0x7f641c154340 2024-04-01T23:02:12.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.918+0000 7f6420f9c640 1 -- 172.21.15.47:0/3987985917 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6418030a00 con 0x7f641c154340 2024-04-01T23:02:12.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.919+0000 7f6422fa0640 1 -- 172.21.15.47:0/3987985917 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f641c154340 msgr2=0x7f641c0c5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:12.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.919+0000 7f6422fa0640 1 --2- 172.21.15.47:0/3987985917 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f641c154340 0x7f641c0c5680 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f64180097a0 tx=0x7f641802b960 comp rx=0 tx=0).stop 2024-04-01T23:02:12.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.919+0000 7f6422fa0640 1 -- 172.21.15.47:0/3987985917 shutdown_connections 2024-04-01T23:02:12.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.919+0000 7f6422fa0640 1 --2- 172.21.15.47:0/3987985917 >> v2:172.21.15.47:3300/0 conn(0x7f641c0ca320 0x7f641c0cab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:12.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.919+0000 7f6422fa0640 1 --2- 172.21.15.47:0/3987985917 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f641c154340 0x7f641c0c5680 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:12.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.919+0000 7f6422fa0640 1 -- 172.21.15.47:0/3987985917 >> 172.21.15.47:0/3987985917 conn(0x7f641c072a20 msgr2=0x7f641c061b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:02:12.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.919+0000 7f6422fa0640 1 -- 172.21.15.47:0/3987985917 shutdown_connections 2024-04-01T23:02:12.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.919+0000 7f6422fa0640 1 -- 172.21.15.47:0/3987985917 wait complete. 2024-04-01T23:02:12.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.920+0000 7f6422fa0640 1 Processor -- start 2024-04-01T23:02:12.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.920+0000 7f6422fa0640 1 -- start start 2024-04-01T23:02:12.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.921+0000 7f6422fa0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f641c0ca320 0x7f641c1499d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:12.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.921+0000 7f6422fa0640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f641c0cb0d0 0x7f641c1465a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:12.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.921+0000 7f6422fa0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f641c154340 0x7f641c146ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:12.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.921+0000 7f6422fa0640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f641c15afe0 con 0x7f641c154340 2024-04-01T23:02:12.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.921+0000 7f6422fa0640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f641c15ad00 con 0x7f641c0ca320 2024-04-01T23:02:12.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.921+0000 7f6422fa0640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f641c062820 con 0x7f641c0cb0d0 2024-04-01T23:02:12.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.921+0000 7f642179d640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f641c0cb0d0 0x7f641c1465a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:12.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.921+0000 7f642279f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f641c154340 0x7f641c146ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:12.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.921+0000 7f6421f9e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f641c0ca320 0x7f641c1499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:12.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.921+0000 7f642179d640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f641c0cb0d0 0x7f641c1465a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:50144/0 (socket says 172.21.15.47:50144) 2024-04-01T23:02:12.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.921+0000 7f642179d640 1 -- 172.21.15.47:0/1601726581 learned_addr learned my addr 172.21.15.47:0/1601726581 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:02:12.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.925+0000 7f642179d640 1 -- 172.21.15.47:0/1601726581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f641c0ca320 msgr2=0x7f641c1499d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:12.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.925+0000 7f642179d640 1 --2- 172.21.15.47:0/1601726581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f641c0ca320 0x7f641c1499d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:12.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.925+0000 7f642179d640 1 -- 172.21.15.47:0/1601726581 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f641c154340 msgr2=0x7f641c146ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:12.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.925+0000 7f642179d640 1 --2- 172.21.15.47:0/1601726581 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f641c154340 0x7f641c146ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:12.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.925+0000 7f642179d640 1 -- 172.21.15.47:0/1601726581 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f641c0d05a0 con 0x7f641c0cb0d0 2024-04-01T23:02:12.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.927+0000 7f642179d640 1 --2- 172.21.15.47:0/1601726581 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f641c0cb0d0 0x7f641c1465a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f640c00e9b0 tx=0x7f640c00ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:02:12.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.929+0000 7f64127fc640 1 -- 172.21.15.47:0/1601726581 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640c017070 con 0x7f641c0cb0d0 2024-04-01T23:02:12.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.929+0000 7f6422fa0640 1 -- 172.21.15.47:0/1601726581 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f641c0ce600 con 0x7f641c0cb0d0 2024-04-01T23:02:12.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.929+0000 7f6422fa0640 1 -- 172.21.15.47:0/1601726581 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f641c0cebc0 con 0x7f641c0cb0d0 2024-04-01T23:02:12.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.930+0000 7f6422fa0640 1 -- 172.21.15.47:0/1601726581 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f641c152600 con 0x7f641c0cb0d0 2024-04-01T23:02:12.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.930+0000 7f64127fc640 1 -- 172.21.15.47:0/1601726581 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f640c00c9a0 con 0x7f641c0cb0d0 2024-04-01T23:02:12.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.930+0000 7f64127fc640 1 -- 172.21.15.47:0/1601726581 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640c021060 con 0x7f641c0cb0d0 2024-04-01T23:02:12.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.949+0000 7f64127fc640 1 -- 172.21.15.47:0/1601726581 <== mon.2 v2:172.21.15.181:3301/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f640c01a070 con 0x7f641c0cb0d0 2024-04-01T23:02:12.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.950+0000 7f64127fc640 1 --2- 172.21.15.47:0/1601726581 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f640006b990 0x7f640006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:12.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.950+0000 7f6421f9e640 1 --2- 172.21.15.47:0/1601726581 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f640006b990 0x7f640006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:12.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:12.950+0000 7f6421f9e640 1 --2- 172.21.15.47:0/1601726581 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f640006b990 0x7f640006de50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6418036000 tx=0x7f641803b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:02:13.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.182+0000 7f64127fc640 1 -- 172.21.15.47:0/1601726581 <== mon.2 v2:172.21.15.181:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f640c057630 con 0x7f641c0cb0d0 2024-04-01T23:02:13.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.194+0000 7f64127fc640 1 -- 172.21.15.47:0/1601726581 <== mon.2 v2:172.21.15.181:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f641c152600 con 0x7f641c0cb0d0 2024-04-01T23:02:13.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.434+0000 7f6422fa0640 1 -- 172.21.15.47:0/1601726581 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f641c0ca970 con 0x7f641c0cb0d0 2024-04-01T23:02:13.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.655+0000 7f64127fc640 1 -- 172.21.15.47:0/1601726581 <== mon.2 v2:172.21.15.181:3301/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7f640c059590 con 0x7f641c0cb0d0 2024-04-01T23:02:13.651 INFO:teuthology.orchestra.run.smithi047.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-01T23:02:13.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.657+0000 7f6422fa0640 1 -- 172.21.15.47:0/1601726581 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f640006b990 msgr2=0x7f640006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:13.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.657+0000 7f6422fa0640 1 --2- 172.21.15.47:0/1601726581 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f640006b990 0x7f640006de50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6418036000 tx=0x7f641803b040 comp rx=0 tx=0).stop 2024-04-01T23:02:13.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.657+0000 7f6422fa0640 1 -- 172.21.15.47:0/1601726581 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f641c0cb0d0 msgr2=0x7f641c1465a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:13.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.657+0000 7f6422fa0640 1 --2- 172.21.15.47:0/1601726581 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f641c0cb0d0 0x7f641c1465a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f640c00e9b0 tx=0x7f640c00ee70 comp rx=0 tx=0).stop 2024-04-01T23:02:13.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.657+0000 7f6422fa0640 1 -- 172.21.15.47:0/1601726581 shutdown_connections 2024-04-01T23:02:13.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.657+0000 7f6422fa0640 1 --2- 172.21.15.47:0/1601726581 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f640006b990 0x7f640006de50 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:13.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.657+0000 7f6422fa0640 1 --2- 172.21.15.47:0/1601726581 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f641c154340 0x7f641c146ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:13.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.657+0000 7f6422fa0640 1 --2- 172.21.15.47:0/1601726581 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f641c0cb0d0 0x7f641c1465a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:13.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.657+0000 7f6422fa0640 1 --2- 172.21.15.47:0/1601726581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f641c0ca320 0x7f641c1499d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:13.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.657+0000 7f6422fa0640 1 -- 172.21.15.47:0/1601726581 >> 172.21.15.47:0/1601726581 conn(0x7f641c072a20 msgr2=0x7f641c159890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:02:13.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.657+0000 7f6422fa0640 1 -- 172.21.15.47:0/1601726581 shutdown_connections 2024-04-01T23:02:13.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.657+0000 7f6422fa0640 1 -- 172.21.15.47:0/1601726581 wait complete. 2024-04-01T23:02:13.664 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-01T23:02:13.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.774+0000 7f230a409640 1 Processor -- start 2024-04-01T23:02:13.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.774+0000 7f230a409640 1 -- start start 2024-04-01T23:02:13.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.774+0000 7f230a409640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f23040c93f0 0x7f23040cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:13.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.774+0000 7f230a409640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f23040cc0d0 0x7f23040cc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:13.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.774+0000 7f230a409640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23040ccaa0 con 0x7f230415afc0 2024-04-01T23:02:13.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.774+0000 7f230a409640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f23040cdae0 con 0x7f23040cc0d0 2024-04-01T23:02:13.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.774+0000 7f230a409640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f23040c97d0 con 0x7f23040c93f0 2024-04-01T23:02:13.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.775+0000 7f23089a6640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f23040cc0d0 0x7f23040cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:13.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.775+0000 7f2303fff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f23040c93f0 0x7f23040cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:13.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.776+0000 7f2303fff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f23040c93f0 0x7f23040cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:50158/0 (socket says 172.21.15.47:50158) 2024-04-01T23:02:13.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.776+0000 7f2303fff640 1 -- 172.21.15.47:0/3340165510 learned_addr learned my addr 172.21.15.47:0/3340165510 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:02:13.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.778+0000 7f2303fff640 1 -- 172.21.15.47:0/3340165510 >> v2:172.21.15.181:3300/0 conn(0x7f23040cc0d0 msgr2=0x7f23040cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:02:13.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.778+0000 7f2303fff640 1 --2- 172.21.15.47:0/3340165510 >> v2:172.21.15.181:3300/0 conn(0x7f23040cc0d0 0x7f23040cc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:13.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.778+0000 7f2303fff640 1 -- 172.21.15.47:0/3340165510 >> v1:172.21.15.181:6789/0 conn(0x7f230415afc0 legacy=0x7f230406c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:13.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.778+0000 7f2303fff640 1 -- 172.21.15.47:0/3340165510 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23040cdd80 con 0x7f23040c93f0 2024-04-01T23:02:13.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.781+0000 7f2303fff640 1 --2- 172.21.15.47:0/3340165510 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f23040c93f0 0x7f23040cee30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f22f4009870 tx=0x7f22f402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d12a514d1dd94e4c server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:02:13.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.785+0000 7f2302ffd640 1 -- 172.21.15.47:0/3340165510 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f4035020 con 0x7f23040c93f0 2024-04-01T23:02:13.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.785+0000 7f2302ffd640 1 -- 172.21.15.47:0/3340165510 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f22f4031640 con 0x7f23040c93f0 2024-04-01T23:02:13.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.785+0000 7f2302ffd640 1 -- 172.21.15.47:0/3340165510 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f402d040 con 0x7f23040c93f0 2024-04-01T23:02:13.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.786+0000 7f230a409640 1 -- 172.21.15.47:0/3340165510 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f23040c93f0 msgr2=0x7f23040cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:13.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.786+0000 7f230a409640 1 --2- 172.21.15.47:0/3340165510 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f23040c93f0 0x7f23040cee30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f22f4009870 tx=0x7f22f402b8f0 comp rx=0 tx=0).stop 2024-04-01T23:02:13.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.786+0000 7f230a409640 1 -- 172.21.15.47:0/3340165510 shutdown_connections 2024-04-01T23:02:13.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.786+0000 7f230a409640 1 --2- 172.21.15.47:0/3340165510 >> v2:172.21.15.181:3300/0 conn(0x7f23040cc0d0 0x7f23040cc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:13.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.786+0000 7f230a409640 1 --2- 172.21.15.47:0/3340165510 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f23040c93f0 0x7f23040cee30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:13.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.786+0000 7f230a409640 1 -- 172.21.15.47:0/3340165510 >> 172.21.15.47:0/3340165510 conn(0x7f23040cfdb0 msgr2=0x7f23040d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:02:13.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.786+0000 7f230a409640 1 -- 172.21.15.47:0/3340165510 shutdown_connections 2024-04-01T23:02:13.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.786+0000 7f230a409640 1 -- 172.21.15.47:0/3340165510 wait complete. 2024-04-01T23:02:13.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.787+0000 7f230a409640 1 Processor -- start 2024-04-01T23:02:13.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.787+0000 7f230a409640 1 -- start start 2024-04-01T23:02:13.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.788+0000 7f230a409640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f23040c93f0 0x7f2304152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:13.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.788+0000 7f230a409640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f23040cc0d0 0x7f23040b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:13.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.788+0000 7f230a409640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f230415afc0 0x7f23041f3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:13.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.788+0000 7f230a409640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f23040ce620 con 0x7f230415afc0 2024-04-01T23:02:13.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.788+0000 7f230a409640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f23040ce340 con 0x7f23040cc0d0 2024-04-01T23:02:13.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.788+0000 7f230a409640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f230415b400 con 0x7f23040c93f0 2024-04-01T23:02:13.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.788+0000 7f23089a6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f230415afc0 0x7f23041f3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:13.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.788+0000 7f2303fff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f23040c93f0 0x7f2304152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:13.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.788+0000 7f23037fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f23040cc0d0 0x7f23040b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:13.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.789+0000 7f23089a6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f230415afc0 0x7f23041f3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49900/0 (socket says 172.21.15.47:49900) 2024-04-01T23:02:13.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.789+0000 7f23089a6640 1 -- 172.21.15.47:0/742741992 learned_addr learned my addr 172.21.15.47:0/742741992 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:02:13.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.792+0000 7f23089a6640 1 -- 172.21.15.47:0/742741992 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f23040c93f0 msgr2=0x7f2304152230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:13.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.792+0000 7f23089a6640 1 --2- 172.21.15.47:0/742741992 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f23040c93f0 0x7f2304152230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:13.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.792+0000 7f23089a6640 1 -- 172.21.15.47:0/742741992 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f23040cc0d0 msgr2=0x7f23040b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:13.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.792+0000 7f23089a6640 1 --2- 172.21.15.47:0/742741992 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f23040cc0d0 0x7f23040b0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:13.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.792+0000 7f23089a6640 1 -- 172.21.15.47:0/742741992 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23040c6280 con 0x7f230415afc0 2024-04-01T23:02:13.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.795+0000 7f23089a6640 1 --2- 172.21.15.47:0/742741992 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f230415afc0 0x7f23041f3df0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f22fc009dd0 tx=0x7f22fc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:02:13.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.799+0000 7f2300ff9640 1 -- 172.21.15.47:0/742741992 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22fc018020 con 0x7f230415afc0 2024-04-01T23:02:13.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.799+0000 7f2300ff9640 1 -- 172.21.15.47:0/742741992 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f22fc014480 con 0x7f230415afc0 2024-04-01T23:02:13.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.799+0000 7f2300ff9640 1 -- 172.21.15.47:0/742741992 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22fc014890 con 0x7f230415afc0 2024-04-01T23:02:13.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.799+0000 7f230a409640 1 -- 172.21.15.47:0/742741992 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23040c6560 con 0x7f230415afc0 2024-04-01T23:02:13.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.799+0000 7f230a409640 1 -- 172.21.15.47:0/742741992 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23041f38d0 con 0x7f230415afc0 2024-04-01T23:02:13.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:13.800+0000 7f230a409640 1 -- 172.21.15.47:0/742741992 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23040c6a80 con 0x7f230415afc0 2024-04-01T23:02:14.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:14.071+0000 7f2300ff9640 1 -- 172.21.15.47:0/742741992 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f22fc005d10 con 0x7f230415afc0 2024-04-01T23:02:14.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:14.071+0000 7f2300ff9640 1 --2- 172.21.15.47:0/742741992 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f22f006b9e0 0x7f22f006dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:14.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:14.071+0000 7f2303fff640 1 --2- 172.21.15.47:0/742741992 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f22f006b9e0 0x7f22f006dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:14.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:14.072+0000 7f2303fff640 1 --2- 172.21.15.47:0/742741992 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f22f006b9e0 0x7f22f006dea0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f22f4036000 tx=0x7f22f403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:02:14.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:14.085+0000 7f2300ff9640 1 -- 172.21.15.47:0/742741992 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6821+0+0 (secure 0 0 0) 0x7f22fc058400 con 0x7f230415afc0 2024-04-01T23:02:14.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:14.085+0000 7f2300ff9640 1 -- 172.21.15.47:0/742741992 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f23040c6a80 con 0x7f230415afc0 2024-04-01T23:02:14.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:14.313+0000 7f230a409640 1 -- 172.21.15.47:0/742741992 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f2304068210 con 0x7f230415afc0 2024-04-01T23:02:14.916 INFO:tasks.ceph.mds.e.smithi047.stderr:==00:00:29:02.280 41043== 2024-04-01T23:02:14.916 INFO:tasks.ceph.mds.e.smithi047.stderr:==00:00:29:02.280 41043== Exit program on first error (--exit-on-first-error=yes) 2024-04-01T23:02:15.094 INFO:tasks.ceph.mds.e.smithi047.stderr:daemon-helper: command failed with exit status 42 2024-04-01T23:02:15.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.286+0000 7f2300ff9640 1 -- 172.21.15.47:0/742741992 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f22fc022070 con 0x7f230415afc0 2024-04-01T23:02:15.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.288+0000 7f230a409640 1 -- 172.21.15.47:0/742741992 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f22f006b9e0 msgr2=0x7f22f006dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:15.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.288+0000 7f230a409640 1 --2- 172.21.15.47:0/742741992 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f22f006b9e0 0x7f22f006dea0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f22f4036000 tx=0x7f22f403c040 comp rx=0 tx=0).stop 2024-04-01T23:02:15.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.288+0000 7f230a409640 1 -- 172.21.15.47:0/742741992 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f230415afc0 msgr2=0x7f23041f3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:15.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.288+0000 7f230a409640 1 --2- 172.21.15.47:0/742741992 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f230415afc0 0x7f23041f3df0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f22fc009dd0 tx=0x7f22fc00c490 comp rx=0 tx=0).stop 2024-04-01T23:02:15.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.288+0000 7f230a409640 1 -- 172.21.15.47:0/742741992 shutdown_connections 2024-04-01T23:02:15.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.288+0000 7f230a409640 1 --2- 172.21.15.47:0/742741992 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f22f006b9e0 0x7f22f006dea0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:15.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.288+0000 7f230a409640 1 --2- 172.21.15.47:0/742741992 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f230415afc0 0x7f23041f3df0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:15.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.288+0000 7f230a409640 1 --2- 172.21.15.47:0/742741992 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f23040cc0d0 0x7f23040b0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:15.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.288+0000 7f230a409640 1 --2- 172.21.15.47:0/742741992 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f23040c93f0 0x7f2304152230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:15.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.288+0000 7f230a409640 1 -- 172.21.15.47:0/742741992 >> 172.21.15.47:0/742741992 conn(0x7f23040cfdb0 msgr2=0x7f23040cb2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:02:15.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.288+0000 7f230a409640 1 -- 172.21.15.47:0/742741992 shutdown_connections 2024-04-01T23:02:15.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.288+0000 7f230a409640 1 -- 172.21.15.47:0/742741992 wait complete. 2024-04-01T23:02:15.296 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-01T23:02:15.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.406+0000 7ff33d872640 1 Processor -- start 2024-04-01T23:02:15.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.407+0000 7ff33d872640 1 -- start start 2024-04-01T23:02:15.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.407+0000 7ff33d872640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff3380c93f0 0x7ff3380cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:15.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.407+0000 7ff33d872640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff33815afc0 0x7ff33806c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:15.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.407+0000 7ff33d872640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff33806c770 0x7ff3380cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:15.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.407+0000 7ff33d872640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7ff3380cdae0 con 0x7ff33806c770 2024-04-01T23:02:15.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.407+0000 7ff33d872640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7ff3380c97d0 con 0x7ff3380c93f0 2024-04-01T23:02:15.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.407+0000 7ff33d872640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7ff3380cdd80 con 0x7ff33815afc0 2024-04-01T23:02:15.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.410+0000 7ff3367fc640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff33815afc0 0x7ff33806c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:15.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.410+0000 7ff3367fc640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff33815afc0 0x7ff33806c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3301/0 says I am v2:172.21.15.47:50182/0 (socket says 172.21.15.47:50182) 2024-04-01T23:02:15.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.410+0000 7ff3367fc640 1 -- 172.21.15.47:0/599038350 learned_addr learned my addr 172.21.15.47:0/599038350 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:02:15.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.410+0000 7ff336ffd640 1 --2- 172.21.15.47:0/599038350 >> v2:172.21.15.181:3300/0 conn(0x7ff3380c93f0 0x7ff3380cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:15.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.413+0000 7ff3377fe640 1 --2- 172.21.15.47:0/599038350 >> v2:172.21.15.47:3300/0 conn(0x7ff33806c770 0x7ff3380cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:15.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.413+0000 7ff3367fc640 1 -- 172.21.15.47:0/599038350 >> v2:172.21.15.181:3300/0 conn(0x7ff3380c93f0 msgr2=0x7ff3380cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:02:15.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.413+0000 7ff3367fc640 1 --2- 172.21.15.47:0/599038350 >> v2:172.21.15.181:3300/0 conn(0x7ff3380c93f0 0x7ff3380cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:15.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.413+0000 7ff3367fc640 1 -- 172.21.15.47:0/599038350 >> v2:172.21.15.47:3300/0 conn(0x7ff33806c770 msgr2=0x7ff3380cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:02:15.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.413+0000 7ff3367fc640 1 --2- 172.21.15.47:0/599038350 >> v2:172.21.15.47:3300/0 conn(0x7ff33806c770 0x7ff3380cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:15.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.413+0000 7ff3367fc640 1 -- 172.21.15.47:0/599038350 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3380ce060 con 0x7ff33815afc0 2024-04-01T23:02:15.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.416+0000 7ff3367fc640 1 --2- 172.21.15.47:0/599038350 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff33815afc0 0x7ff33806c230 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff33808d100 tx=0x7ff32c02b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92d47000a6bb03cc server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:02:15.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.421+0000 7ff335ffb640 1 -- 172.21.15.47:0/599038350 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32c02e070 con 0x7ff33815afc0 2024-04-01T23:02:15.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.422+0000 7ff335ffb640 1 -- 172.21.15.47:0/599038350 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff32c037070 con 0x7ff33815afc0 2024-04-01T23:02:15.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.422+0000 7ff335ffb640 1 -- 172.21.15.47:0/599038350 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32c031a20 con 0x7ff33815afc0 2024-04-01T23:02:15.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.422+0000 7ff33d872640 1 -- 172.21.15.47:0/599038350 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff33815afc0 msgr2=0x7ff33806c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:15.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.422+0000 7ff33d872640 1 --2- 172.21.15.47:0/599038350 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff33815afc0 0x7ff33806c230 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff33808d100 tx=0x7ff32c02b880 comp rx=0 tx=0).stop 2024-04-01T23:02:15.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.422+0000 7ff33d872640 1 -- 172.21.15.47:0/599038350 shutdown_connections 2024-04-01T23:02:15.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.422+0000 7ff33d872640 1 --2- 172.21.15.47:0/599038350 >> v2:172.21.15.47:3300/0 conn(0x7ff33806c770 0x7ff3380cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:15.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.422+0000 7ff33d872640 1 --2- 172.21.15.47:0/599038350 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff33815afc0 0x7ff33806c230 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:15.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.422+0000 7ff33d872640 1 --2- 172.21.15.47:0/599038350 >> v2:172.21.15.181:3300/0 conn(0x7ff3380c93f0 0x7ff3380cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:15.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.422+0000 7ff33d872640 1 -- 172.21.15.47:0/599038350 >> 172.21.15.47:0/599038350 conn(0x7ff3380cfdb0 msgr2=0x7ff3380d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:02:15.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.422+0000 7ff33d872640 1 -- 172.21.15.47:0/599038350 shutdown_connections 2024-04-01T23:02:15.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.422+0000 7ff33d872640 1 -- 172.21.15.47:0/599038350 wait complete. 2024-04-01T23:02:15.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.423+0000 7ff33d872640 1 Processor -- start 2024-04-01T23:02:15.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.424+0000 7ff33d872640 1 -- start start 2024-04-01T23:02:15.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.424+0000 7ff33d872640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff33806c770 0x7ff3381f37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:15.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.424+0000 7ff33d872640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff3380c93f0 0x7ff3380c4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:15.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.424+0000 7ff33d872640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff33815afc0 0x7ff3380c51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:15.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.424+0000 7ff33d872640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff33815b400 con 0x7ff33806c770 2024-04-01T23:02:15.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.424+0000 7ff33d872640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff3380ce620 con 0x7ff33815afc0 2024-04-01T23:02:15.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.424+0000 7ff33d872640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7ff3380cf430 con 0x7ff3380c93f0 2024-04-01T23:02:15.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.425+0000 7ff3377fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff33815afc0 0x7ff3380c51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:15.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.425+0000 7ff3377fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff33815afc0 0x7ff3380c51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.47:53776/0 (socket says 172.21.15.47:53776) 2024-04-01T23:02:15.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.425+0000 7ff3377fe640 1 -- 172.21.15.47:0/4086399099 learned_addr learned my addr 172.21.15.47:0/4086399099 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:02:15.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.426+0000 7ff3367fc640 1 --2- 172.21.15.47:0/4086399099 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff3380c93f0 0x7ff3380c4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:15.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.429+0000 7ff3377fe640 1 -- 172.21.15.47:0/4086399099 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff3380c93f0 msgr2=0x7ff3380c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:15.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.429+0000 7ff3377fe640 1 --2- 172.21.15.47:0/4086399099 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff3380c93f0 0x7ff3380c4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:15.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.429+0000 7ff3377fe640 1 -- 172.21.15.47:0/4086399099 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff33806c770 msgr2=0x7ff3381f37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:15.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.429+0000 7ff3377fe640 1 --2- 172.21.15.47:0/4086399099 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff33806c770 0x7ff3381f37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:15.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.429+0000 7ff3377fe640 1 -- 172.21.15.47:0/4086399099 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff338154140 con 0x7ff33815afc0 2024-04-01T23:02:15.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.431+0000 7ff3377fe640 1 --2- 172.21.15.47:0/4086399099 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff33815afc0 0x7ff3380c51b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff328007e60 tx=0x7ff32800e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:02:15.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.435+0000 7ff31ffff640 1 -- 172.21.15.47:0/4086399099 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff328014620 con 0x7ff33815afc0 2024-04-01T23:02:15.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.435+0000 7ff31ffff640 1 -- 172.21.15.47:0/4086399099 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff328019070 con 0x7ff33815afc0 2024-04-01T23:02:15.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.435+0000 7ff31ffff640 1 -- 172.21.15.47:0/4086399099 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff328014a40 con 0x7ff33815afc0 2024-04-01T23:02:15.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.435+0000 7ff33d872640 1 -- 172.21.15.47:0/4086399099 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff338154400 con 0x7ff33815afc0 2024-04-01T23:02:15.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.435+0000 7ff33d872640 1 -- 172.21.15.47:0/4086399099 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3380b0160 con 0x7ff33815afc0 2024-04-01T23:02:15.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.436+0000 7ff33d872640 1 -- 172.21.15.47:0/4086399099 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff338068210 con 0x7ff33815afc0 2024-04-01T23:02:15.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.454+0000 7ff31ffff640 1 -- 172.21.15.47:0/4086399099 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7ff328014be0 con 0x7ff33815afc0 2024-04-01T23:02:15.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.455+0000 7ff31ffff640 1 --2- 172.21.15.47:0/4086399099 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff32406b9e0 0x7ff32406dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:15.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.455+0000 7ff336ffd640 1 --2- 172.21.15.47:0/4086399099 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff32406b9e0 0x7ff32406dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:15.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.455+0000 7ff336ffd640 1 --2- 172.21.15.47:0/4086399099 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff32406b9e0 0x7ff32406dea0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff330006a90 tx=0x7ff330006a20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:02:15.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.457+0000 7ff31ffff640 1 -- 172.21.15.47:0/4086399099 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6821+0+0 (secure 0 0 0) 0x7ff3280584a0 con 0x7ff33815afc0 2024-04-01T23:02:15.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.702+0000 7ff31ffff640 1 -- 172.21.15.47:0/4086399099 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7ff32805ab00 con 0x7ff33815afc0 2024-04-01T23:02:15.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:15.886+0000 7ff33d872640 1 -- 172.21.15.47:0/4086399099 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff33806cf00 con 0x7ff33815afc0 2024-04-01T23:02:16.519 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_metadata' removed 2024-04-01T23:02:16.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.523+0000 7ff31ffff640 1 -- 172.21.15.47:0/4086399099 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) ==== 181+0+0 (secure 0 0 0) 0x7ff32805a400 con 0x7ff33815afc0 2024-04-01T23:02:16.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.526+0000 7ff33d872640 1 -- 172.21.15.47:0/4086399099 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff32406b9e0 msgr2=0x7ff32406dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:16.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.526+0000 7ff33d872640 1 --2- 172.21.15.47:0/4086399099 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff32406b9e0 0x7ff32406dea0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff330006a90 tx=0x7ff330006a20 comp rx=0 tx=0).stop 2024-04-01T23:02:16.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.526+0000 7ff33d872640 1 -- 172.21.15.47:0/4086399099 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff33815afc0 msgr2=0x7ff3380c51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:16.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.526+0000 7ff33d872640 1 --2- 172.21.15.47:0/4086399099 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff33815afc0 0x7ff3380c51b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff328007e60 tx=0x7ff32800e4b0 comp rx=0 tx=0).stop 2024-04-01T23:02:16.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.526+0000 7ff33d872640 1 -- 172.21.15.47:0/4086399099 shutdown_connections 2024-04-01T23:02:16.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.526+0000 7ff33d872640 1 --2- 172.21.15.47:0/4086399099 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7ff32406b9e0 0x7ff32406dea0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:16.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.526+0000 7ff33d872640 1 --2- 172.21.15.47:0/4086399099 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff33815afc0 0x7ff3380c51b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:16.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.526+0000 7ff33d872640 1 --2- 172.21.15.47:0/4086399099 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7ff3380c93f0 0x7ff3380c4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:16.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.526+0000 7ff33d872640 1 --2- 172.21.15.47:0/4086399099 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff33806c770 0x7ff3381f37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:16.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.526+0000 7ff33d872640 1 -- 172.21.15.47:0/4086399099 >> 172.21.15.47:0/4086399099 conn(0x7ff3380cfdb0 msgr2=0x7ff3380cc0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:02:16.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.526+0000 7ff33d872640 1 -- 172.21.15.47:0/4086399099 shutdown_connections 2024-04-01T23:02:16.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.526+0000 7ff33d872640 1 -- 172.21.15.47:0/4086399099 wait complete. 2024-04-01T23:02:16.535 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-01T23:02:16.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.647+0000 7f90a45b6640 1 Processor -- start 2024-04-01T23:02:16.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.647+0000 7f90a45b6640 1 -- start start 2024-04-01T23:02:16.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.648+0000 7f90a45b6640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f909c0c93f0 0x7f909c0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:16.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.648+0000 7f90a45b6640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f909c15afc0 0x7f909c06c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:16.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.648+0000 7f90a45b6640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f909c06c770 0x7f909c0cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:16.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.648+0000 7f90a45b6640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f909c0cdae0 con 0x7f909c06c770 2024-04-01T23:02:16.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.648+0000 7f90a45b6640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f909c0c97d0 con 0x7f909c0c93f0 2024-04-01T23:02:16.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.648+0000 7f90a45b6640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f909c0cdd80 con 0x7f909c15afc0 2024-04-01T23:02:16.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.649+0000 7f90a2b53640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f909c06c770 0x7f909c0cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:16.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.649+0000 7f90a2352640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f909c0c93f0 0x7f909c0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:16.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.649+0000 7f90a1b51640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f909c15afc0 0x7f909c06c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:16.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.649+0000 7f90a2b53640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f909c06c770 0x7f909c0cc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49934/0 (socket says 172.21.15.47:49934) 2024-04-01T23:02:16.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.649+0000 7f90a2b53640 1 -- 172.21.15.47:0/3961730415 learned_addr learned my addr 172.21.15.47:0/3961730415 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:02:16.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.651+0000 7f90a1b51640 1 -- 172.21.15.47:0/3961730415 >> v2:172.21.15.181:3300/0 conn(0x7f909c0c93f0 msgr2=0x7f909c0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:02:16.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.651+0000 7f90a1b51640 1 --2- 172.21.15.47:0/3961730415 >> v2:172.21.15.181:3300/0 conn(0x7f909c0c93f0 0x7f909c0cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:16.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.651+0000 7f90a1b51640 1 -- 172.21.15.47:0/3961730415 >> v2:172.21.15.47:3300/0 conn(0x7f909c06c770 msgr2=0x7f909c0cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T23:02:16.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.651+0000 7f90a1b51640 1 --2- 172.21.15.47:0/3961730415 >> v2:172.21.15.47:3300/0 conn(0x7f909c06c770 0x7f909c0cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:16.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.651+0000 7f90a1b51640 1 -- 172.21.15.47:0/3961730415 --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f909c0ce060 con 0x7f909c15afc0 2024-04-01T23:02:16.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.653+0000 7f90a1b51640 1 --2- 172.21.15.47:0/3961730415 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f909c15afc0 0x7f909c06c230 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f909c08d100 tx=0x7f908c02b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e726fbf1c435278c server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:02:16.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.657+0000 7f90a1350640 1 -- 172.21.15.47:0/3961730415 <== mon.2 v2:172.21.15.181:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908c038070 con 0x7f909c15afc0 2024-04-01T23:02:16.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.657+0000 7f90a1350640 1 -- 172.21.15.47:0/3961730415 <== mon.2 v2:172.21.15.181:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f908c031700 con 0x7f909c15afc0 2024-04-01T23:02:16.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.657+0000 7f90a1350640 1 -- 172.21.15.47:0/3961730415 <== mon.2 v2:172.21.15.181:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908c031af0 con 0x7f909c15afc0 2024-04-01T23:02:16.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.657+0000 7f90a45b6640 1 -- 172.21.15.47:0/3961730415 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f909c15afc0 msgr2=0x7f909c06c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:16.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.657+0000 7f90a45b6640 1 --2- 172.21.15.47:0/3961730415 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f909c15afc0 0x7f909c06c230 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f909c08d100 tx=0x7f908c02b7a0 comp rx=0 tx=0).stop 2024-04-01T23:02:16.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.657+0000 7f90a45b6640 1 -- 172.21.15.47:0/3961730415 shutdown_connections 2024-04-01T23:02:16.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.657+0000 7f90a45b6640 1 --2- 172.21.15.47:0/3961730415 >> v2:172.21.15.47:3300/0 conn(0x7f909c06c770 0x7f909c0cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:16.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.657+0000 7f90a45b6640 1 --2- 172.21.15.47:0/3961730415 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f909c15afc0 0x7f909c06c230 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:16.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.657+0000 7f90a45b6640 1 --2- 172.21.15.47:0/3961730415 >> v2:172.21.15.181:3300/0 conn(0x7f909c0c93f0 0x7f909c0cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:16.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.657+0000 7f90a45b6640 1 -- 172.21.15.47:0/3961730415 >> 172.21.15.47:0/3961730415 conn(0x7f909c0cfdb0 msgr2=0x7f909c0d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:02:16.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.657+0000 7f90a45b6640 1 -- 172.21.15.47:0/3961730415 shutdown_connections 2024-04-01T23:02:16.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.658+0000 7f90a45b6640 1 -- 172.21.15.47:0/3961730415 wait complete. 2024-04-01T23:02:16.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.659+0000 7f90a45b6640 1 Processor -- start 2024-04-01T23:02:16.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.659+0000 7f90a45b6640 1 -- start start 2024-04-01T23:02:16.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.659+0000 7f90a45b6640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f909c06c770 0x7f909c152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:16.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.659+0000 7f90a45b6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f909c0c93f0 0x7f909c0ade50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:16.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.659+0000 7f90a45b6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f909c15afc0 0x7f909c0ae390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:16.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.659+0000 7f90a45b6640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f909c15b400 con 0x7f909c15afc0 2024-04-01T23:02:16.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.659+0000 7f90a45b6640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f909c0ce620 con 0x7f909c0c93f0 2024-04-01T23:02:16.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.659+0000 7f90a45b6640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f909c0cf430 con 0x7f909c06c770 2024-04-01T23:02:16.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.660+0000 7f90a2b53640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f909c15afc0 0x7f909c0ae390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:16.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.660+0000 7f90a1b51640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f909c0c93f0 0x7f909c0ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:16.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.660+0000 7f90a2352640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f909c06c770 0x7f909c152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:16.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.660+0000 7f90a2b53640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f909c15afc0 0x7f909c0ae390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49942/0 (socket says 172.21.15.47:49942) 2024-04-01T23:02:16.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.660+0000 7f90a2b53640 1 -- 172.21.15.47:0/101019556 learned_addr learned my addr 172.21.15.47:0/101019556 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:02:16.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.663+0000 7f90a2b53640 1 -- 172.21.15.47:0/101019556 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f909c06c770 msgr2=0x7f909c152230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:16.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.663+0000 7f90a2b53640 1 --2- 172.21.15.47:0/101019556 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f909c06c770 0x7f909c152230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:16.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.663+0000 7f90a2b53640 1 -- 172.21.15.47:0/101019556 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f909c0c93f0 msgr2=0x7f909c0ade50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:16.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.664+0000 7f90a2b53640 1 --2- 172.21.15.47:0/101019556 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f909c0c93f0 0x7f909c0ade50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:16.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.664+0000 7f90a2b53640 1 -- 172.21.15.47:0/101019556 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f909c1f0ef0 con 0x7f909c15afc0 2024-04-01T23:02:16.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.666+0000 7f90a2b53640 1 --2- 172.21.15.47:0/101019556 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f909c15afc0 0x7f909c0ae390 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f909800ef00 tx=0x7f909800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:02:16.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.669+0000 7f9092ffd640 1 -- 172.21.15.47:0/101019556 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909801a070 con 0x7f909c15afc0 2024-04-01T23:02:16.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.670+0000 7f9092ffd640 1 -- 172.21.15.47:0/101019556 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f909800bb10 con 0x7f909c15afc0 2024-04-01T23:02:16.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.670+0000 7f9092ffd640 1 -- 172.21.15.47:0/101019556 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9098003990 con 0x7f909c15afc0 2024-04-01T23:02:16.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.670+0000 7f90a45b6640 1 -- 172.21.15.47:0/101019556 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f909c0c6a10 con 0x7f909c15afc0 2024-04-01T23:02:16.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.670+0000 7f90a45b6640 1 -- 172.21.15.47:0/101019556 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f909c0c6450 con 0x7f909c15afc0 2024-04-01T23:02:16.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.671+0000 7f90a45b6640 1 -- 172.21.15.47:0/101019556 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f909c068210 con 0x7f909c15afc0 2024-04-01T23:02:16.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.690+0000 7f9092ffd640 1 -- 172.21.15.47:0/101019556 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f9098005d10 con 0x7f909c15afc0 2024-04-01T23:02:16.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.691+0000 7f9092ffd640 1 --2- 172.21.15.47:0/101019556 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f908006b9e0 0x7f908006dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:16.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.691+0000 7f90a2352640 1 --2- 172.21.15.47:0/101019556 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f908006b9e0 0x7f908006dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:16.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.691+0000 7f90a2352640 1 --2- 172.21.15.47:0/101019556 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f908006b9e0 0x7f908006dea0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9094009b40 tx=0x7f9094009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:02:16.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.953+0000 7f9092ffd640 1 -- 172.21.15.47:0/101019556 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6383+0+0 (secure 0 0 0) 0x7f90980573f0 con 0x7f909c15afc0 2024-04-01T23:02:16.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:16.953+0000 7f9092ffd640 1 -- 172.21.15.47:0/101019556 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f9098059350 con 0x7f909c15afc0 2024-04-01T23:02:17.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.140+0000 7f90a45b6640 1 -- 172.21.15.47:0/101019556 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f909c06cf00 con 0x7f909c15afc0 2024-04-01T23:02:17.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.616+0000 7f9092ffd640 1 -- 172.21.15.47:0/101019556 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) ==== 169+0+0 (secure 0 0 0) 0x7f909805d3f0 con 0x7f909c15afc0 2024-04-01T23:02:17.612 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_data' removed 2024-04-01T23:02:17.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.618+0000 7f90a45b6640 1 -- 172.21.15.47:0/101019556 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f908006b9e0 msgr2=0x7f908006dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:17.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.618+0000 7f90a45b6640 1 --2- 172.21.15.47:0/101019556 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f908006b9e0 0x7f908006dea0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9094009b40 tx=0x7f9094009190 comp rx=0 tx=0).stop 2024-04-01T23:02:17.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.618+0000 7f90a45b6640 1 -- 172.21.15.47:0/101019556 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f909c15afc0 msgr2=0x7f909c0ae390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:17.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.618+0000 7f90a45b6640 1 --2- 172.21.15.47:0/101019556 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f909c15afc0 0x7f909c0ae390 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f909800ef00 tx=0x7f909800b480 comp rx=0 tx=0).stop 2024-04-01T23:02:17.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.618+0000 7f90a45b6640 1 -- 172.21.15.47:0/101019556 shutdown_connections 2024-04-01T23:02:17.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.618+0000 7f90a45b6640 1 --2- 172.21.15.47:0/101019556 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f908006b9e0 0x7f908006dea0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:17.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.618+0000 7f90a45b6640 1 --2- 172.21.15.47:0/101019556 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f909c15afc0 0x7f909c0ae390 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:17.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.618+0000 7f90a45b6640 1 --2- 172.21.15.47:0/101019556 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f909c0c93f0 0x7f909c0ade50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:17.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.618+0000 7f90a45b6640 1 --2- 172.21.15.47:0/101019556 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f909c06c770 0x7f909c152230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:17.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.618+0000 7f90a45b6640 1 -- 172.21.15.47:0/101019556 >> 172.21.15.47:0/101019556 conn(0x7f909c0cfdb0 msgr2=0x7f909c153fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:02:17.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.619+0000 7f90a45b6640 1 -- 172.21.15.47:0/101019556 shutdown_connections 2024-04-01T23:02:17.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.619+0000 7f90a45b6640 1 -- 172.21.15.47:0/101019556 wait complete. 2024-04-01T23:02:17.627 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-01T23:02:17.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.739+0000 7f7cf6f2c640 1 Processor -- start 2024-04-01T23:02:17.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.739+0000 7f7cf6f2c640 1 -- start start 2024-04-01T23:02:17.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.740+0000 7f7cf6f2c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7cf00c5410 0x7f7cf0151b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:17.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.740+0000 7f7cf6f2c640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cf0158230 con 0x7f7cf006fc90 2024-04-01T23:02:17.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.740+0000 7f7cf6f2c640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cf0158510 con 0x7f7cf00c5030 2024-04-01T23:02:17.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.740+0000 7f7cf6f2c640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 -- 0x7f7cf01587f0 con 0x7f7cf00c5410 2024-04-01T23:02:17.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.740+0000 7f7cf54c9640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f7cf006fc90 0x7f7cf015ba10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60270/0 (socket says 172.21.15.47:60270) 2024-04-01T23:02:17.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.740+0000 7f7cf54c9640 1 -- 172.21.15.47:0/1708326488 learned_addr learned my addr 172.21.15.47:0/1708326488 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-01T23:02:17.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.740+0000 7f7ceffff640 1 --2- 172.21.15.47:0/1708326488 >> v2:172.21.15.181:3300/0 conn(0x7f7cf00c5410 0x7f7cf0151b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:17.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.743+0000 7f7cef7fe640 1 -- 172.21.15.47:0/1708326488 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4042669530 0 0) 0x7f7cf0158230 con 0x7f7cf006fc90 2024-04-01T23:02:17.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.743+0000 7f7cef7fe640 1 -- 172.21.15.47:0/1708326488 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ce0003520 con 0x7f7cf006fc90 2024-04-01T23:02:17.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.743+0000 7f7ceffff640 1 -- 172.21.15.47:0/1708326488 >> v1:172.21.15.181:6789/0 conn(0x7f7cf00c5030 legacy=0x7f7cf006f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:17.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.743+0000 7f7ceffff640 1 -- 172.21.15.47:0/1708326488 >> v1:172.21.15.47:6789/0 conn(0x7f7cf006fc90 legacy=0x7f7cf015ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:17.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.743+0000 7f7ceffff640 1 -- 172.21.15.47:0/1708326488 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf0158ad0 con 0x7f7cf00c5410 2024-04-01T23:02:17.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.748+0000 7f7ceffff640 1 --2- 172.21.15.47:0/1708326488 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7cf00c5410 0x7f7cf0151b80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc0097a0 tx=0x7f7cdc02b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71309b1b176d6327 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:02:17.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.752+0000 7f7cef7fe640 1 -- 172.21.15.47:0/1708326488 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cdc02f810 con 0x7f7cf00c5410 2024-04-01T23:02:17.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.752+0000 7f7cef7fe640 1 -- 172.21.15.47:0/1708326488 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7cdc02f9b0 con 0x7f7cf00c5410 2024-04-01T23:02:17.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.752+0000 7f7cef7fe640 1 -- 172.21.15.47:0/1708326488 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cdc02fda0 con 0x7f7cf00c5410 2024-04-01T23:02:17.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.753+0000 7f7cf6f2c640 1 -- 172.21.15.47:0/1708326488 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7cf00c5410 msgr2=0x7f7cf0151b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:17.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.753+0000 7f7cf6f2c640 1 --2- 172.21.15.47:0/1708326488 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7cf00c5410 0x7f7cf0151b80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc0097a0 tx=0x7f7cdc02b9f0 comp rx=0 tx=0).stop 2024-04-01T23:02:17.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.753+0000 7f7cf6f2c640 1 -- 172.21.15.47:0/1708326488 shutdown_connections 2024-04-01T23:02:17.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.753+0000 7f7cf6f2c640 1 --2- 172.21.15.47:0/1708326488 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7cf00c5410 0x7f7cf0151b80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:17.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.753+0000 7f7cf6f2c640 1 -- 172.21.15.47:0/1708326488 >> 172.21.15.47:0/1708326488 conn(0x7f7cf006b110 msgr2=0x7f7cf006b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:02:17.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.753+0000 7f7cf6f2c640 1 -- 172.21.15.47:0/1708326488 shutdown_connections 2024-04-01T23:02:17.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.753+0000 7f7cf6f2c640 1 -- 172.21.15.47:0/1708326488 wait complete. 2024-04-01T23:02:17.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.754+0000 7f7cf6f2c640 1 Processor -- start 2024-04-01T23:02:17.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.754+0000 7f7cf6f2c640 1 -- start start 2024-04-01T23:02:17.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.755+0000 7f7cf6f2c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7cf006fc90 0x7f7cf0143ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:17.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.755+0000 7f7cf6f2c640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7cf00c5030 0x7f7cf0154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:17.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.755+0000 7f7cf6f2c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7cf00c5410 0x7f7cf0154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:17.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.755+0000 7f7cf6f2c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf015c120 con 0x7f7cf00c5410 2024-04-01T23:02:17.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.755+0000 7f7cf6f2c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf00c6b50 con 0x7f7cf006fc90 2024-04-01T23:02:17.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.755+0000 7f7cf6f2c640 1 -- --> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] -- mon_getmap magic: 0 -- 0x7f7cf015c2a0 con 0x7f7cf00c5030 2024-04-01T23:02:17.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.755+0000 7f7cf54c9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7cf00c5410 0x7f7cf0154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:17.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.756+0000 7f7ceffff640 1 --2- >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7cf00c5030 0x7f7cf0154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:17.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.756+0000 7f7cf54c9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7cf00c5410 0x7f7cf0154f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49956/0 (socket says 172.21.15.47:49956) 2024-04-01T23:02:17.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.756+0000 7f7cf54c9640 1 -- 172.21.15.47:0/3867779226 learned_addr learned my addr 172.21.15.47:0/3867779226 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-01T23:02:17.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.756+0000 7f7cf4cc8640 1 --2- 172.21.15.47:0/3867779226 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7cf006fc90 0x7f7cf0143ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:17.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.759+0000 7f7cf54c9640 1 -- 172.21.15.47:0/3867779226 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7cf00c5030 msgr2=0x7f7cf0154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:17.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.759+0000 7f7cf54c9640 1 --2- 172.21.15.47:0/3867779226 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7cf00c5030 0x7f7cf0154a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:17.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.759+0000 7f7cf54c9640 1 -- 172.21.15.47:0/3867779226 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7cf006fc90 msgr2=0x7f7cf0143ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:17.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.759+0000 7f7cf54c9640 1 --2- 172.21.15.47:0/3867779226 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7cf006fc90 0x7f7cf0143ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:17.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.759+0000 7f7cf54c9640 1 -- 172.21.15.47:0/3867779226 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf01ee860 con 0x7f7cf00c5410 2024-04-01T23:02:17.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.761+0000 7f7cf54c9640 1 --2- 172.21.15.47:0/3867779226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7cf00c5410 0x7f7cf0154f80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7ce800cbe0 tx=0x7f7ce800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:02:17.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.765+0000 7f7ced7fa640 1 -- 172.21.15.47:0/3867779226 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce8017070 con 0x7f7cf00c5410 2024-04-01T23:02:17.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.765+0000 7f7ced7fa640 1 -- 172.21.15.47:0/3867779226 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7ce800ad40 con 0x7f7cf00c5410 2024-04-01T23:02:17.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.765+0000 7f7cf6f2c640 1 -- 172.21.15.47:0/3867779226 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cf0152ad0 con 0x7f7cf00c5410 2024-04-01T23:02:17.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.765+0000 7f7ced7fa640 1 -- 172.21.15.47:0/3867779226 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce8012600 con 0x7f7cf00c5410 2024-04-01T23:02:17.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.765+0000 7f7cf6f2c640 1 -- 172.21.15.47:0/3867779226 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cf0153090 con 0x7f7cf00c5410 2024-04-01T23:02:17.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.766+0000 7f7cf6f2c640 1 -- 172.21.15.47:0/3867779226 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cf0068210 con 0x7f7cf00c5410 2024-04-01T23:02:17.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.784+0000 7f7ced7fa640 1 -- 172.21.15.47:0/3867779226 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90156+0+0 (secure 0 0 0) 0x7f7ce801a070 con 0x7f7cf00c5410 2024-04-01T23:02:17.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.785+0000 7f7ced7fa640 1 --2- 172.21.15.47:0/3867779226 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f7cd406b990 0x7f7cd406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T23:02:17.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.785+0000 7f7cf4cc8640 1 --2- 172.21.15.47:0/3867779226 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f7cd406b990 0x7f7cd406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T23:02:17.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:17.785+0000 7f7cf4cc8640 1 --2- 172.21.15.47:0/3867779226 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f7cd406b990 0x7f7cd406de50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4001780 tx=0x7f7ce4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T23:02:18.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:18.043+0000 7f7ced7fa640 1 -- 172.21.15.47:0/3867779226 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5853+0+0 (secure 0 0 0) 0x7f7ce8057430 con 0x7f7cf00c5410 2024-04-01T23:02:18.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:18.043+0000 7f7ced7fa640 1 -- 172.21.15.47:0/3867779226 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f7ce8059130 con 0x7f7cf00c5410 2024-04-01T23:02:18.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:18.227+0000 7f7cf6f2c640 1 -- 172.21.15.47:0/3867779226 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7cf00733c0 con 0x7f7cf00c5410 2024-04-01T23:02:18.411 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T23:02:18.414 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T23:02:18.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:18.628+0000 7f7ced7fa640 1 -- 172.21.15.47:0/3867779226 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) ==== 178+0+0 (secure 0 0 0) 0x7f7ce805d1d0 con 0x7f7cf00c5410 2024-04-01T23:02:18.624 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_data_ec' removed 2024-04-01T23:02:18.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:18.630+0000 7f7cf6f2c640 1 -- 172.21.15.47:0/3867779226 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f7cd406b990 msgr2=0x7f7cd406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:18.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:18.630+0000 7f7cf6f2c640 1 --2- 172.21.15.47:0/3867779226 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f7cd406b990 0x7f7cd406de50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4001780 tx=0x7f7ce4009040 comp rx=0 tx=0).stop 2024-04-01T23:02:18.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:18.630+0000 7f7cf6f2c640 1 -- 172.21.15.47:0/3867779226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7cf00c5410 msgr2=0x7f7cf0154f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T23:02:18.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:18.630+0000 7f7cf6f2c640 1 --2- 172.21.15.47:0/3867779226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7cf00c5410 0x7f7cf0154f80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7ce800cbe0 tx=0x7f7ce800a430 comp rx=0 tx=0).stop 2024-04-01T23:02:18.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:18.630+0000 7f7cf6f2c640 1 -- 172.21.15.47:0/3867779226 shutdown_connections 2024-04-01T23:02:18.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:18.630+0000 7f7cf6f2c640 1 --2- 172.21.15.47:0/3867779226 >> [v2:172.21.15.47:6800/1257047371,v1:172.21.15.47:6801/1257047371] conn(0x7f7cd406b990 0x7f7cd406de50 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:18.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:18.630+0000 7f7cf6f2c640 1 --2- 172.21.15.47:0/3867779226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7cf00c5410 0x7f7cf0154f80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:18.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:18.630+0000 7f7cf6f2c640 1 --2- 172.21.15.47:0/3867779226 >> [v2:172.21.15.181:3301/0,v1:172.21.15.181:6790/0] conn(0x7f7cf00c5030 0x7f7cf0154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:18.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:18.630+0000 7f7cf6f2c640 1 --2- 172.21.15.47:0/3867779226 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7cf006fc90 0x7f7cf0143ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T23:02:18.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:18.630+0000 7f7cf6f2c640 1 -- 172.21.15.47:0/3867779226 >> 172.21.15.47:0/3867779226 conn(0x7f7cf006b110 msgr2=0x7f7cf0144bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T23:02:18.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:18.630+0000 7f7cf6f2c640 1 -- 172.21.15.47:0/3867779226 shutdown_connections 2024-04-01T23:02:18.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-01T23:02:18.630+0000 7f7cf6f2c640 1 -- 172.21.15.47:0/3867779226 wait complete. 2024-04-01T23:02:18.638 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-01T23:02:18.638 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-01T23:02:18.638 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T23:02:18.656 INFO:tasks.ceph.mds.a.smithi047.stderr:2024-04-01T23:02:18.648+0000 b5eb640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i a (PID: 41028) UID: 0 2024-04-01T23:02:18.657 INFO:tasks.ceph.mds.a.smithi047.stderr:2024-04-01T23:02:18.650+0000 b5eb640 -1 mds.a *** got signal Terminated *** 2024-04-01T23:02:19.970 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~0s 2024-04-01T23:02:24.739 INFO:tasks.ceph.mds.a:Stopped 2024-04-01T23:02:24.740 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-01T23:02:24.740 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T23:02:24.756 INFO:tasks.ceph.mds.c.smithi047.stderr:2024-04-01T23:02:24.749+0000 b5eb640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i c (PID: 41033) UID: 0 2024-04-01T23:02:24.756 INFO:tasks.ceph.mds.c.smithi047.stderr:2024-04-01T23:02:24.750+0000 b5eb640 -1 mds.c *** got signal Terminated *** 2024-04-01T23:02:26.684 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~7s 2024-04-01T23:02:30.842 INFO:tasks.ceph.mds.c:Stopped 2024-04-01T23:02:30.842 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-04-01T23:02:30.842 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T23:02:30.842 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-04-01T23:02:30.842 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi047 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i e" 2024-04-01T23:02:30.843 INFO:tasks.ceph.mds.e:Stopped 2024-04-01T23:02:30.844 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-01T23:02:30.844 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T23:02:30.859 INFO:tasks.ceph.mds.b.smithi181.stderr:2024-04-01T23:02:30.852+0000 b5eb640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i b (PID: 41388) UID: 0 2024-04-01T23:02:30.859 INFO:tasks.ceph.mds.b.smithi181.stderr:2024-04-01T23:02:30.854+0000 b5eb640 -1 mds.b *** got signal Terminated *** 2024-04-01T23:02:33.196 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-04-01T23:02:33.196 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e has been restored 2024-04-01T23:02:36.945 INFO:tasks.ceph.mds.b:Stopped 2024-04-01T23:02:36.946 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-01T23:02:36.946 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T23:02:36.961 INFO:tasks.ceph.mds.d.smithi181.stderr:2024-04-01T23:02:36.954+0000 b5eb640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i d (PID: 41390) UID: 0 2024-04-01T23:02:36.961 INFO:tasks.ceph.mds.d.smithi181.stderr:2024-04-01T23:02:36.956+0000 b5eb640 -1 mds.d *** got signal Terminated *** 2024-04-01T23:02:39.708 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-04-01T23:02:43.047 INFO:tasks.ceph.mds.d:Stopped 2024-04-01T23:02:43.050 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-04-01T23:02:43.050 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T23:02:43.064 INFO:tasks.ceph.mds.f.smithi181.stderr:2024-04-01T23:02:43.059+0000 b5eb640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i f (PID: 41392) UID: 0 2024-04-01T23:02:43.066 INFO:tasks.ceph.mds.f.smithi181.stderr:2024-04-01T23:02:43.060+0000 b5eb640 -1 mds.f *** got signal Terminated *** 2024-04-01T23:02:46.021 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~0s 2024-04-01T23:02:48.468 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T23:02:48.471 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T23:02:49.152 INFO:tasks.ceph.mds.f:Stopped 2024-04-01T23:02:49.152 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-01T23:02:49.152 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-01T23:02:49.153 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T23:02:49.153 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-04-01T23:02:49.158+0000 7f31f85f0640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 0 (PID: 37312) UID: 0 2024-04-01T23:02:49.153 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-04-01T23:02:49.158+0000 7f31f85f0640 -1 osd.0 36 *** Got signal Terminated *** 2024-04-01T23:02:52.232 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-04-01T23:02:52.232 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f has been restored 2024-04-01T23:02:55.254 INFO:tasks.ceph.osd.0:Stopped 2024-04-01T23:02:55.255 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-01T23:02:55.255 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T23:02:55.256 INFO:tasks.ceph.osd.1.smithi047.stderr:2024-04-01T23:02:55.259+0000 7f7301b6e640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 1 (PID: 37318) UID: 0 2024-04-01T23:02:55.256 INFO:tasks.ceph.osd.1.smithi047.stderr:2024-04-01T23:02:55.259+0000 7f7301b6e640 -1 osd.1 38 *** Got signal Terminated *** 2024-04-01T23:02:58.354 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-04-01T23:02:58.355 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-04-01T23:03:01.357 INFO:tasks.ceph.osd.1:Stopped 2024-04-01T23:03:01.357 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-01T23:03:01.357 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T23:03:01.358 INFO:tasks.ceph.osd.2.smithi047.stderr:2024-04-01T23:03:01.363+0000 7f102c9a5640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 2 (PID: 37321) UID: 0 2024-04-01T23:03:01.358 INFO:tasks.ceph.osd.2.smithi047.stderr:2024-04-01T23:03:01.363+0000 7f102c9a5640 -1 osd.2 39 *** Got signal Terminated *** 2024-04-01T23:03:04.364 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-04-01T23:03:04.364 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-04-01T23:03:07.458 INFO:tasks.ceph.osd.2:Stopped 2024-04-01T23:03:07.459 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-01T23:03:07.459 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T23:03:07.460 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-04-01T23:03:07.464+0000 7f6af63ac640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 3 (PID: 37326) UID: 0 2024-04-01T23:03:07.460 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-04-01T23:03:07.464+0000 7f6af63ac640 -1 osd.3 40 *** Got signal Terminated *** 2024-04-01T23:03:10.272 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-04-01T23:03:10.272 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-04-01T23:03:13.560 INFO:tasks.ceph.osd.3:Stopped 2024-04-01T23:03:13.561 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-01T23:03:13.561 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T23:03:13.562 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-04-01T23:03:13.566+0000 7ff07a8e9640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 4 (PID: 37774) UID: 0 2024-04-01T23:03:13.562 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-04-01T23:03:13.566+0000 7ff07a8e9640 -1 osd.4 41 *** Got signal Terminated *** 2024-04-01T23:03:16.095 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-04-01T23:03:16.095 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-04-01T23:03:18.532 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T23:03:18.536 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T23:03:19.663 INFO:tasks.ceph.osd.4:Stopped 2024-04-01T23:03:19.663 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-01T23:03:19.663 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T23:03:19.665 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-04-01T23:03:19.670+0000 7f127b3e8640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 5 (PID: 37772) UID: 0 2024-04-01T23:03:19.665 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-04-01T23:03:19.670+0000 7f127b3e8640 -1 osd.5 42 *** Got signal Terminated *** 2024-04-01T23:03:21.803 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-04-01T23:03:21.803 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-04-01T23:03:25.765 INFO:tasks.ceph.osd.5:Stopped 2024-04-01T23:03:25.765 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-01T23:03:25.765 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T23:03:25.766 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-04-01T23:03:25.771+0000 7f0ddf0e9640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 6 (PID: 37776) UID: 0 2024-04-01T23:03:25.766 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-04-01T23:03:25.771+0000 7f0ddf0e9640 -1 osd.6 43 *** Got signal Terminated *** 2024-04-01T23:03:27.409 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-04-01T23:03:27.409 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-04-01T23:03:31.867 INFO:tasks.ceph.osd.6:Stopped 2024-04-01T23:03:31.867 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-01T23:03:31.867 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T23:03:31.868 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-04-01T23:03:31.873+0000 7f20fea80640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 7 (PID: 37779) UID: 0 2024-04-01T23:03:31.868 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-04-01T23:03:31.873+0000 7f20fea80640 -1 osd.7 43 *** Got signal Terminated *** 2024-04-01T23:03:33.013 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-04-01T23:03:37.969 INFO:tasks.ceph.osd.7:Stopped 2024-04-01T23:03:37.969 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-01T23:03:37.969 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-01T23:03:37.969 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T23:03:37.996 INFO:tasks.ceph.mgr.y:Stopped 2024-04-01T23:03:37.996 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-01T23:03:37.996 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T23:03:38.021 INFO:tasks.ceph.mgr.x:Stopped 2024-04-01T23:03:38.022 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-01T23:03:38.022 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-01T23:03:38.022 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T23:03:38.060 INFO:tasks.ceph.mon.a.smithi047.stderr:2024-04-01T23:03:38.046+0000 9f94640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 37025) UID: 0 2024-04-01T23:03:38.061 INFO:tasks.ceph.mon.a.smithi047.stderr:2024-04-01T23:03:38.047+0000 9f94640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-04-01T23:03:38.783 INFO:tasks.ceph.mon.a.smithi047.stderr:==00:00:30:53.400 37051== 2024-04-01T23:03:38.783 INFO:tasks.ceph.mon.a.smithi047.stderr:==00:00:30:53.400 37051== Exit program on first error (--exit-on-first-error=yes) 2024-04-01T23:03:38.795 INFO:tasks.ceph.mon.a.smithi047.stderr:daemon-helper: command failed with exit status 42 2024-04-01T23:03:43.518 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-04-01T23:03:44.123 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-04-01T23:03:44.124 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi047 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a" 2024-04-01T23:03:44.124 INFO:tasks.ceph.mon.a:Stopped 2024-04-01T23:03:44.124 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-01T23:03:44.124 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T23:03:44.142 INFO:tasks.ceph.mon.b.smithi181.stderr:2024-04-01T23:03:44.134+0000 9f94640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 37180) UID: 0 2024-04-01T23:03:44.143 INFO:tasks.ceph.mon.b.smithi181.stderr:2024-04-01T23:03:44.135+0000 9f94640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2024-04-01T23:03:44.609 INFO:tasks.ceph.mon.b.smithi181.stderr:==00:00:30:59.169 37187== 2024-04-01T23:03:44.609 INFO:tasks.ceph.mon.b.smithi181.stderr:==00:00:30:59.169 37187== Exit program on first error (--exit-on-first-error=yes) 2024-04-01T23:03:44.620 INFO:tasks.ceph.mon.b.smithi181.stderr:daemon-helper: command failed with exit status 42 2024-04-01T23:03:48.620 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-04-01T23:03:48.622 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-04-01T23:03:48.679 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T23:03:48.682 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T23:03:50.226 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-04-01T23:03:50.226 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi181 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b" 2024-04-01T23:03:50.227 INFO:tasks.ceph.mon.b:Stopped 2024-04-01T23:03:50.227 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-01T23:03:50.227 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T23:03:50.243 INFO:tasks.ceph.mon.c.smithi181.stderr:2024-04-01T23:03:50.236+0000 9f94640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 37183) UID: 0 2024-04-01T23:03:50.243 INFO:tasks.ceph.mon.c.smithi181.stderr:2024-04-01T23:03:50.238+0000 9f94640 -1 mon.c@2(probing) e1 *** Got Signal Terminated *** 2024-04-01T23:03:53.723 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-04-01T23:04:18.819 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T23:04:18.823 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T23:04:48.883 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T23:04:48.886 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T23:05:18.997 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T23:05:19.001 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T23:05:40.688 INFO:tasks.ceph.mon.c.smithi181.stderr:==00:00:32:55.247 37188== 2024-04-01T23:05:40.688 INFO:tasks.ceph.mon.c.smithi181.stderr:==00:00:32:55.247 37188== Exit program on first error (--exit-on-first-error=yes) 2024-04-01T23:05:40.698 INFO:tasks.ceph.mon.c.smithi181.stderr:daemon-helper: command failed with exit status 42 2024-04-01T23:05:40.756 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-04-01T23:05:45.757 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~5s 2024-04-01T23:05:46.157 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-04-01T23:05:46.157 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi181 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c" 2024-04-01T23:05:46.157 INFO:tasks.ceph.mon.c:Stopped 2024-04-01T23:05:46.158 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-01T23:05:46.158 DEBUG:teuthology.orchestra.run.smithi047:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v MON_DOWN | head -n 1 2024-04-01T23:05:46.195 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi047.front.sepia.ceph.com 2024-04-01T23:05:46.195 DEBUG:teuthology.orchestra.run.smithi047:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-01T23:05:46.463 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi047.front.sepia.ceph.com 2024-04-01T23:05:46.464 DEBUG:teuthology.orchestra.run.smithi047:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-01T23:05:46.533 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi047.front.sepia.ceph.com 2024-04-01T23:05:46.533 DEBUG:teuthology.orchestra.run.smithi047:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-01T23:05:46.589 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi047.front.sepia.ceph.com 2024-04-01T23:05:46.589 DEBUG:teuthology.orchestra.run.smithi047:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-01T23:05:46.642 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi181.front.sepia.ceph.com 2024-04-01T23:05:46.642 DEBUG:teuthology.orchestra.run.smithi181:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-01T23:05:46.744 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi181.front.sepia.ceph.com 2024-04-01T23:05:46.745 DEBUG:teuthology.orchestra.run.smithi181:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-01T23:05:46.802 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi181.front.sepia.ceph.com 2024-04-01T23:05:46.803 DEBUG:teuthology.orchestra.run.smithi181:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-01T23:05:46.861 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi181.front.sepia.ceph.com 2024-04-01T23:05:46.861 DEBUG:teuthology.orchestra.run.smithi181:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-01T23:05:46.910 INFO:tasks.ceph:Archiving mon data... 2024-04-01T23:05:46.912 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2024-04-01_20:57:46-fs-wip-yuri3-testing-2024-04-01-0837-squid-distro-default-smithi/7634387/data/mon.a.tgz 2024-04-01T23:05:46.912 DEBUG:teuthology.orchestra.run.smithi047:> mktemp 2024-04-01T23:05:46.929 INFO:teuthology.orchestra.run.smithi047.stdout:/tmp/tmp.si2kNnRqca 2024-04-01T23:05:46.929 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.si2kNnRqca 2024-04-01T23:05:47.089 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0666 /tmp/tmp.si2kNnRqca 2024-04-01T23:05:47.173 DEBUG:teuthology.orchestra.remote:smithi047:/tmp/tmp.si2kNnRqca is 322KB 2024-04-01T23:05:47.272 DEBUG:teuthology.orchestra.run.smithi047:> rm -fr /tmp/tmp.si2kNnRqca 2024-04-01T23:05:47.286 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2024-04-01_20:57:46-fs-wip-yuri3-testing-2024-04-01-0837-squid-distro-default-smithi/7634387/data/mon.b.tgz 2024-04-01T23:05:47.286 DEBUG:teuthology.orchestra.run.smithi181:> mktemp 2024-04-01T23:05:47.302 INFO:teuthology.orchestra.run.smithi181.stdout:/tmp/tmp.7HDHptx8QH 2024-04-01T23:05:47.303 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.7HDHptx8QH 2024-04-01T23:05:47.461 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0666 /tmp/tmp.7HDHptx8QH 2024-04-01T23:05:47.546 DEBUG:teuthology.orchestra.remote:smithi181:/tmp/tmp.7HDHptx8QH is 346KB 2024-04-01T23:05:47.643 DEBUG:teuthology.orchestra.run.smithi181:> rm -fr /tmp/tmp.7HDHptx8QH 2024-04-01T23:05:47.658 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2024-04-01_20:57:46-fs-wip-yuri3-testing-2024-04-01-0837-squid-distro-default-smithi/7634387/data/mon.c.tgz 2024-04-01T23:05:47.658 DEBUG:teuthology.orchestra.run.smithi181:> mktemp 2024-04-01T23:05:47.712 INFO:teuthology.orchestra.run.smithi181.stdout:/tmp/tmp.sYQuZzRxqJ 2024-04-01T23:05:47.712 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.sYQuZzRxqJ 2024-04-01T23:05:47.843 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0666 /tmp/tmp.sYQuZzRxqJ 2024-04-01T23:05:47.928 DEBUG:teuthology.orchestra.remote:smithi181:/tmp/tmp.sYQuZzRxqJ is 346KB 2024-04-01T23:05:48.025 DEBUG:teuthology.orchestra.run.smithi181:> rm -fr /tmp/tmp.sYQuZzRxqJ 2024-04-01T23:05:48.040 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-01T23:05:48.041 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-01T23:05:48.043 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-01T23:05:48.367 DEBUG:tasks.ceph:valgrind exception message: valgrind error: Leak_StillReachable malloc malloc strdup 2024-04-01T23:05:49.131 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T23:05:49.135 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T23:05:49.327 INFO:tasks.ceph:Archiving crash dumps... 2024-04-01T23:05:49.337 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-04-01_20:57:46-fs-wip-yuri3-testing-2024-04-01-0837-squid-distro-default-smithi/7634387/remote/smithi047/crash 2024-04-01T23:05:49.343 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-01T23:05:49.394 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-04-01_20:57:46-fs-wip-yuri3-testing-2024-04-01-0837-squid-distro-default-smithi/7634387/remote/smithi181/crash 2024-04-01T23:05:49.402 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-01T23:05:49.434 INFO:tasks.ceph:Shutting down logrotate 2024-04-01T23:05:49.471 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-01T23:05:49.504 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-01T23:05:49.543 INFO:tasks.ceph:Compressing logs... 2024-04-01T23:05:49.544 DEBUG:teuthology.orchestra.run.smithi047:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-01T23:05:49.552 DEBUG:teuthology.orchestra.run.smithi181:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-01T23:05:49.581 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37518.log 2024-04-01T23:05:49.581 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47965.log 2024-04-01T23:05:49.581 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.37518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43948.log 2024-04-01T23:05:49.581 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.47965.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37518.log.gz 2024-04-01T23:05:49.581 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-01T23:05:49.581 INFO:teuthology.orchestra.run.smithi047.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47965.log.gz 2024-04-01T23:05:49.581 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.43948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45297.log 2024-04-01T23:05:49.581 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-mon.a.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43948.log.gz 2024-04-01T23:05:49.655 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-01T23:05:49.655 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2024-04-01T23:05:49.655 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.f.log/var/log/ceph/ceph-osd.6.log: 2024-04-01T23:05:49.655 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/valgrind/mon.c.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.b.log 2024-04-01T23:05:49.655 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/valgrind/mds.f.log: 69.6% -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2024-04-01T23:05:49.656 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2024-04-01T23:05:49.656 INFO:teuthology.orchestra.run.smithi181.stderr: 57.4% -- replaced with /var/log/ceph/valgrind/mds.f.log.gz 2024-04-01T23:05:49.656 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.d.log 2024-04-01T23:05:49.656 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/valgrind/mds.b.log: /var/log/ceph/valgrind/mon.b.log: 57.2% -- replaced with /var/log/ceph/valgrind/mds.b.log.gz 2024-04-01T23:05:49.656 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37470.log 2024-04-01T23:05:49.656 INFO:teuthology.orchestra.run.smithi181.stderr: 69.6% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2024-04-01T23:05:49.656 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/valgrind/mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37511.log 2024-04-01T23:05:49.656 INFO:teuthology.orchestra.run.smithi181.stderr: 57.3% -- replaced with /var/log/ceph/valgrind/mds.d.log.gz 2024-04-01T23:05:49.656 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.37470.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-01T23:05:49.657 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.37511.log: gzip -5 --verbose 87.9% -- /var/log/ceph/ceph-mds.b.log -- replaced with /var/log/ceph/ceph-client.admin.37470.log.gz 2024-04-01T23:05:49.657 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-04-01T23:05:49.657 INFO:teuthology.orchestra.run.smithi181.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37511.log.gz 2024-04-01T23:05:49.657 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-01T23:05:49.657 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37631.log 2024-04-01T23:05:49.657 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-mds.b.log: /var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37591.log 2024-04-01T23:05:49.657 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.37631.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-01T23:05:49.657 INFO:teuthology.orchestra.run.smithi181.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37631.log.gz 2024-04-01T23:05:49.657 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.37591.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-01T23:05:49.657 INFO:teuthology.orchestra.run.smithi181.stderr: 93.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-01T23:05:49.658 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-04-01T23:05:49.658 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-osd.7.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37591.log.gz 2024-04-01T23:05:49.658 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-01T23:05:49.658 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37379.log 2024-04-01T23:05:49.658 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37428.log 2024-04-01T23:05:49.658 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.37379.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37379.log.gz 2024-04-01T23:05:49.658 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-01T23:05:49.658 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.37428.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.37428.log.gz 2024-04-01T23:05:49.658 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-01T23:05:49.659 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph.log: 92.5% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-01T23:05:49.659 INFO:teuthology.orchestra.run.smithi181.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-04-01T23:05:49.659 INFO:teuthology.orchestra.run.smithi181.stderr: 93.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-01T23:05:49.659 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37551.log 2024-04-01T23:05:49.659 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-01T23:05:49.659 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.37551.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-01T23:05:49.659 INFO:teuthology.orchestra.run.smithi181.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.37551.log.gz 2024-04-01T23:05:49.659 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-mds.d.log: 92.5% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-01T23:05:49.660 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37682.log 2024-04-01T23:05:49.660 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-client.admin.37682.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37682.log.gz 2024-04-01T23:05:49.660 INFO:teuthology.orchestra.run.smithi181.stderr: 94.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-01T23:05:49.689 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45213.log 2024-04-01T23:05:49.689 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.45297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44127.log 2024-04-01T23:05:49.689 INFO:teuthology.orchestra.run.smithi047.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45297.log.gz 2024-04-01T23:05:49.689 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.45213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49131.log 2024-04-01T23:05:49.689 INFO:teuthology.orchestra.run.smithi047.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45213.log.gz 2024-04-01T23:05:49.690 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.44127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45045.log 2024-04-01T23:05:49.690 INFO:teuthology.orchestra.run.smithi047.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44127.log.gz 2024-04-01T23:05:49.690 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.49131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45171.log 2024-04-01T23:05:49.690 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.45045.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49131.log.gz 2024-04-01T23:05:49.690 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37064.log 2024-04-01T23:05:49.690 INFO:teuthology.orchestra.run.smithi047.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45045.log.gz 2024-04-01T23:05:49.690 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.45171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49483.log 2024-04-01T23:05:49.690 INFO:teuthology.orchestra.run.smithi047.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45171.log.gz 2024-04-01T23:05:49.691 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.37064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43431.log 2024-04-01T23:05:49.691 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.49483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47797.log 2024-04-01T23:05:49.691 INFO:teuthology.orchestra.run.smithi047.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.37064.log.gz 2024-04-01T23:05:49.691 INFO:teuthology.orchestra.run.smithi047.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49483.log.gz 2024-04-01T23:05:49.691 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.43431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42833.log 2024-04-01T23:05:49.691 INFO:teuthology.orchestra.run.smithi047.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43431.log.gz 2024-04-01T23:05:49.691 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42066.log 2024-04-01T23:05:49.691 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.47797.log: /var/log/ceph/ceph-client.admin.42833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44919.log 2024-04-01T23:05:49.691 INFO:teuthology.orchestra.run.smithi047.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47797.log.gz 2024-04-01T23:05:49.691 INFO:teuthology.orchestra.run.smithi047.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42833.log.gz 2024-04-01T23:05:49.692 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.42066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45003.log 2024-04-01T23:05:49.692 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.44919.log: 87.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.42066.log.gz 2024-04-01T23:05:49.692 INFO:teuthology.orchestra.run.smithi047.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45129.log 2024-04-01T23:05:49.692 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.45003.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44919.log.gz 2024-04-01T23:05:49.692 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49317.log 2024-04-01T23:05:49.692 INFO:teuthology.orchestra.run.smithi047.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45003.log.gz 2024-04-01T23:05:49.692 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.45129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42000.log 2024-04-01T23:05:49.692 INFO:teuthology.orchestra.run.smithi047.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45129.log.gz 2024-04-01T23:05:49.692 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.49317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41399.log 2024-04-01T23:05:49.692 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.42000.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49317.log.gz 2024-04-01T23:05:49.692 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49089.log 2024-04-01T23:05:49.692 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.41399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43944.log 2024-04-01T23:05:49.693 INFO:teuthology.orchestra.run.smithi047.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.42000.log.gz 2024-04-01T23:05:49.693 INFO:teuthology.orchestra.run.smithi047.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41399.log.gz 2024-04-01T23:05:49.693 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.49089.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.c.log 2024-04-01T23:05:49.693 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.43944.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49089.log.gz 2024-04-01T23:05:49.693 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.a.log 2024-04-01T23:05:49.694 INFO:teuthology.orchestra.run.smithi047.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43944.log.gz 2024-04-01T23:05:49.694 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/valgrind/mds.c.log: gzip -5 --verbose -- /var/log/ceph/valgrind/client.0.log 2024-04-01T23:05:49.694 INFO:teuthology.orchestra.run.smithi047.stderr: 57.3% -- replaced with /var/log/ceph/valgrind/mds.c.log.gz 2024-04-01T23:05:49.694 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/valgrind/mds.a.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.a.log 2024-04-01T23:05:49.694 INFO:teuthology.orchestra.run.smithi047.stderr: 57.3% -- replaced with /var/log/ceph/valgrind/mds.a.log.gz 2024-04-01T23:05:49.694 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/valgrind/client.0.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.e.log 2024-04-01T23:05:49.694 INFO:teuthology.orchestra.run.smithi047.stderr: 76.9% -- replaced with /var/log/ceph/valgrind/client.0.log.gz 2024-04-01T23:05:49.694 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/valgrind/mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41874.log 2024-04-01T23:05:49.695 INFO:teuthology.orchestra.run.smithi047.stderr: 69.6% -- replaced with /var/log/ceph/valgrind/mon.a.log.gz 2024-04-01T23:05:49.695 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/valgrind/mds.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48007.log 2024-04-01T23:05:49.695 INFO:teuthology.orchestra.run.smithi047.stderr: 67.8% -- replaced with /var/log/ceph/valgrind/mds.e.log.gz 2024-04-01T23:05:49.695 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.41874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48192.log 2024-04-01T23:05:49.695 INFO:teuthology.orchestra.run.smithi047.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41874.log.gz 2024-04-01T23:05:49.695 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.48007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45087.log 2024-04-01T23:05:49.695 INFO:teuthology.orchestra.run.smithi047.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48007.log.gz 2024-04-01T23:05:49.695 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.48192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41525.log 2024-04-01T23:05:49.695 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.45087.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48192.log.gz 2024-04-01T23:05:49.695 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44859.log 2024-04-01T23:05:49.696 INFO:teuthology.orchestra.run.smithi047.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45087.log.gz 2024-04-01T23:05:49.696 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.41525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43767.log 2024-04-01T23:05:49.696 INFO:teuthology.orchestra.run.smithi047.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41525.log.gz 2024-04-01T23:05:49.696 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.44859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41567.log 2024-04-01T23:05:49.696 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.43767.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44859.log.gz 2024-04-01T23:05:49.698 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44622.log 2024-04-01T23:05:49.698 INFO:teuthology.orchestra.run.smithi047.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43767.log.gz 2024-04-01T23:05:49.698 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.41567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42748.log 2024-04-01T23:05:49.698 INFO:teuthology.orchestra.run.smithi047.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41567.log.gz 2024-04-01T23:05:49.698 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.44622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41958.log 2024-04-01T23:05:49.698 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.42748.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44622.log.gz 2024-04-01T23:05:49.698 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45593.log 2024-04-01T23:05:49.698 INFO:teuthology.orchestra.run.smithi047.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42748.log.gz 2024-04-01T23:05:49.698 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.41958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43940.log 2024-04-01T23:05:49.699 INFO:teuthology.orchestra.run.smithi047.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41958.log.gz 2024-04-01T23:05:49.699 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.45593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48585.log 2024-04-01T23:05:49.699 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.43940.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45593.log.gz 2024-04-01T23:05:49.699 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41357.log 2024-04-01T23:05:49.699 INFO:teuthology.orchestra.run.smithi047.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43940.log.gz 2024-04-01T23:05:49.699 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.48585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45984.log 2024-04-01T23:05:49.699 INFO:teuthology.orchestra.run.smithi047.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48585.log.gz 2024-04-01T23:05:49.699 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.41357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43017.log 2024-04-01T23:05:49.699 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.0.45984.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41357.log.gz 2024-04-01T23:05:49.699 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48627.log 2024-04-01T23:05:49.699 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.43017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43347.log 2024-04-01T23:05:49.699 INFO:teuthology.orchestra.run.smithi047.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43017.log.gz 2024-04-01T23:05:49.699 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.48627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43227.log 2024-04-01T23:05:49.699 INFO:teuthology.orchestra.run.smithi047.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48627.log.gz 2024-04-01T23:05:49.700 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44232.log 2024-04-01T23:05:49.700 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.43347.log: /var/log/ceph/ceph-client.admin.43227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41483.log 2024-04-01T23:05:49.700 INFO:teuthology.orchestra.run.smithi047.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43347.log.gz 2024-04-01T23:05:49.700 INFO:teuthology.orchestra.run.smithi047.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43227.log.gz 2024-04-01T23:05:49.700 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.44232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41916.log 2024-04-01T23:05:49.700 INFO:teuthology.orchestra.run.smithi047.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44232.log.gz 2024-04-01T23:05:49.700 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43515.log 2024-04-01T23:05:49.700 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.41483.log: /var/log/ceph/ceph-client.admin.41916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48234.log 2024-04-01T23:05:49.700 INFO:teuthology.orchestra.run.smithi047.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41483.log.gz 2024-04-01T23:05:49.700 INFO:teuthology.orchestra.run.smithi047.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41916.log.gz 2024-04-01T23:05:49.700 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.43515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48795.log 2024-04-01T23:05:49.700 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.48234.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43515.log.gz 2024-04-01T23:05:49.700 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48669.log 2024-04-01T23:05:49.701 INFO:teuthology.orchestra.run.smithi047.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48234.log.gz 2024-04-01T23:05:49.701 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.48795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49215.log 2024-04-01T23:05:49.701 INFO:teuthology.orchestra.run.smithi047.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48795.log.gz 2024-04-01T23:05:49.701 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.48669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48276.log 2024-04-01T23:05:49.701 INFO:teuthology.orchestra.run.smithi047.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48669.log.gz 2024-04-01T23:05:49.701 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.49215.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-01T23:05:49.701 INFO:teuthology.orchestra.run.smithi047.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49215.log.gz 2024-04-01T23:05:49.701 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.48276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49005.log 2024-04-01T23:05:49.701 INFO:teuthology.orchestra.run.smithi047.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48276.log.gz 2024-04-01T23:05:49.701 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37332.log 2024-04-01T23:05:49.702 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.49005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45465.log 2024-04-01T23:05:49.702 INFO:teuthology.orchestra.run.smithi047.stderr: 88.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-01T23:05:49.702 INFO:teuthology.orchestra.run.smithi047.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49005.log.gz 2024-04-01T23:05:49.702 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.37332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44241.log 2024-04-01T23:05:49.702 INFO:teuthology.orchestra.run.smithi047.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.37332.log.gz 2024-04-01T23:05:49.702 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43683.log 2024-04-01T23:05:49.702 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.45465.log: /var/log/ceph/ceph-client.admin.44241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41441.log 2024-04-01T23:05:49.702 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.43683.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44241.log.gz 2024-04-01T23:05:49.702 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44283.log 2024-04-01T23:05:49.702 INFO:teuthology.orchestra.run.smithi047.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43683.log.gz 2024-04-01T23:05:49.702 INFO:teuthology.orchestra.run.smithi047.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.45465.log.gz 2024-04-01T23:05:49.703 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.41441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47839.log 2024-04-01T23:05:49.703 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.44283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48711.log 2024-04-01T23:05:49.703 INFO:teuthology.orchestra.run.smithi047.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41441.log.gz 2024-04-01T23:05:49.703 INFO:teuthology.orchestra.run.smithi047.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44283.log.gz/var/log/ceph/ceph-client.admin.47839.log: 2024-04-01T23:05:49.703 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44817.log 2024-04-01T23:05:49.703 INFO:teuthology.orchestra.run.smithi047.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47839.log.gz 2024-04-01T23:05:49.703 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.48711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43473.log 2024-04-01T23:05:49.703 INFO:teuthology.orchestra.run.smithi047.stderr:gzip/var/log/ceph/ceph-client.admin.44817.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.49609.log 2024-04-01T23:05:49.703 INFO:teuthology.orchestra.run.smithi047.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48711.log.gz 2024-04-01T23:05:49.703 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.43473.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44817.log.gz 2024-04-01T23:05:49.703 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49441.log 2024-04-01T23:05:49.703 INFO:teuthology.orchestra.run.smithi047.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43473.log.gz 2024-04-01T23:05:49.704 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.49609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48065.log 2024-04-01T23:05:49.704 INFO:teuthology.orchestra.run.smithi047.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49609.log.gz 2024-04-01T23:05:49.704 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.49441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43059.log 2024-04-01T23:05:49.704 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.48065.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49441.log.gz 2024-04-01T23:05:49.704 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-01T23:05:49.704 INFO:teuthology.orchestra.run.smithi047.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48065.log.gz 2024-04-01T23:05:49.704 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44961.log 2024-04-01T23:05:49.704 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.43059.log: /var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48459.log 2024-04-01T23:05:49.704 INFO:teuthology.orchestra.run.smithi047.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43059.log.gz 2024-04-01T23:05:49.704 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.44961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42875.log 2024-04-01T23:05:49.704 INFO:teuthology.orchestra.run.smithi047.stderr: 88.1%/var/log/ceph/ceph-client.admin.48459.log: -- replaced with /var/log/ceph/ceph-client.admin.44961.log.gz 2024-04-01T23:05:49.704 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43947.log 2024-04-01T23:05:49.705 INFO:teuthology.orchestra.run.smithi047.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48459.log.gz 2024-04-01T23:05:49.705 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.42875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47923.log 2024-04-01T23:05:49.705 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.43947.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42875.log.gz 2024-04-01T23:05:49.705 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43946.log 2024-04-01T23:05:49.705 INFO:teuthology.orchestra.run.smithi047.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43947.log.gz 2024-04-01T23:05:49.705 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.47923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43557.log 2024-04-01T23:05:49.705 INFO:teuthology.orchestra.run.smithi047.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47923.log.gz 2024-04-01T23:05:49.705 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.43946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41085.log 2024-04-01T23:05:49.705 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 88.1% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.43946.log.gz /var/log/ceph/ceph-client.admin.43641.log 2024-04-01T23:05:49.705 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-01T23:05:49.706 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.43557.log: /var/log/ceph/ceph-client.admin.41085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49693.log 2024-04-01T23:05:49.706 INFO:teuthology.orchestra.run.smithi047.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43557.log.gz 2024-04-01T23:05:49.706 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.43641.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41085.log.gz 2024-04-01T23:05:49.706 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41832.log 2024-04-01T23:05:49.706 INFO:teuthology.orchestra.run.smithi047.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43641.log.gz 2024-04-01T23:05:49.706 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.49693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49173.log 2024-04-01T23:05:49.706 INFO:teuthology.orchestra.run.smithi047.stderr: 87.3%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.49693.log.gz --verbose 2024-04-01T23:05:49.706 INFO:teuthology.orchestra.run.smithi047.stderr: -- /var/log/ceph/ceph-client.admin.41706.log 2024-04-01T23:05:49.706 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.41832.log: /var/log/ceph/ceph-client.admin.49173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42917.log 2024-04-01T23:05:49.706 INFO:teuthology.orchestra.run.smithi047.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41832.log.gz 2024-04-01T23:05:49.707 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.41706.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49173.log.gz 2024-04-01T23:05:49.707 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48963.log 2024-04-01T23:05:49.707 INFO:teuthology.orchestra.run.smithi047.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41706.log.gz 2024-04-01T23:05:49.707 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.42917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44561.log 2024-04-01T23:05:49.707 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.48963.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42917.log.gz 2024-04-01T23:05:49.707 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44502.log 2024-04-01T23:05:49.707 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.44561.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48963.log.gz 2024-04-01T23:05:49.707 INFO:teuthology.orchestra.run.smithi047.stderr:gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44561.log.gz 2024-04-01T23:05:49.707 INFO:teuthology.orchestra.run.smithi047.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48921.log 2024-04-01T23:05:49.707 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.44502.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-01T23:05:49.707 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.48921.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44502.log.gz 2024-04-01T23:05:49.708 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44337.log 2024-04-01T23:05:49.708 INFO:teuthology.orchestra.run.smithi047.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48921.log.gz 2024-04-01T23:05:49.708 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44249.log 2024-04-01T23:05:49.708 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.44337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49047.log 2024-04-01T23:05:49.708 INFO:teuthology.orchestra.run.smithi047.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44337.log.gz 2024-04-01T23:05:49.708 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.44249.log: gzip -5 88.2% --verbose -- replaced with /var/log/ceph/ceph-client.admin.44249.log.gz -- 2024-04-01T23:05:49.708 INFO:teuthology.orchestra.run.smithi047.stderr: /var/log/ceph/ceph-client.admin.48417.log 2024-04-01T23:05:49.708 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.49047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41151.log 2024-04-01T23:05:49.708 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.48417.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49047.log.gz 2024-04-01T23:05:49.709 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43389.log 2024-04-01T23:05:49.709 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.41151.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48417.log.gz 2024-04-01T23:05:49.709 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49525.log 2024-04-01T23:05:49.709 INFO:teuthology.orchestra.run.smithi047.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41151.log.gz 2024-04-01T23:05:49.709 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.43389.log: /var/log/ceph/ceph-client.admin.40925.log 2024-04-01T23:05:49.709 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.49525.log: gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43389.log.gz 2024-04-01T23:05:49.709 INFO:teuthology.orchestra.run.smithi047.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44235.log 2024-04-01T23:05:49.709 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.40925.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49525.log.gz 2024-04-01T23:05:49.709 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49275.log 2024-04-01T23:05:49.709 INFO:teuthology.orchestra.run.smithi047.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.40925.log.gz 2024-04-01T23:05:49.709 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.44235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41040.log 2024-04-01T23:05:49.709 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.49275.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44235.log.gz 2024-04-01T23:05:49.710 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44775.log 2024-04-01T23:05:49.710 INFO:teuthology.orchestra.run.smithi047.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49275.log.gz 2024-04-01T23:05:49.710 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.41040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48149.log 2024-04-01T23:05:49.710 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.44775.log: gzip 88.8% -5 --verbose -- /var/log/ceph/ceph-client.admin.43725.log 2024-04-01T23:05:49.710 INFO:teuthology.orchestra.run.smithi047.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41040.log.gz 2024-04-01T23:05:49.710 INFO:teuthology.orchestra.run.smithi047.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44775.log.gz 2024-04-01T23:05:49.710 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.48149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48837.log 2024-04-01T23:05:49.710 INFO:teuthology.orchestra.run.smithi047.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48149.log.gz 2024-04-01T23:05:49.711 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.43725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41748.log 2024-04-01T23:05:49.711 INFO:teuthology.orchestra.run.smithi047.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43725.log.gz 2024-04-01T23:05:49.711 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.48837.log: gzip -5 --verbose 88.4% -- -- replaced with /var/log/ceph/ceph-client.admin.48837.log.gz /var/log/ceph/ceph-client.admin.49567.log 2024-04-01T23:05:49.711 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-01T23:05:49.711 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.41748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48501.log 2024-04-01T23:05:49.711 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.49567.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41748.log.gz 2024-04-01T23:05:49.711 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-04-01T23:05:49.711 INFO:teuthology.orchestra.run.smithi047.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49567.log.gz 2024-04-01T23:05:49.711 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.48501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42791.log 2024-04-01T23:05:49.712 INFO:teuthology.orchestra.run.smithi047.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48501.log.gz 2024-04-01T23:05:49.712 INFO:teuthology.orchestra.run.smithi047.stderr:gzip/var/log/ceph/ceph-mds.e.log: -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-01T23:05:49.712 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.42791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48879.log 2024-04-01T23:05:49.712 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-mgr.y.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42791.log.gz 2024-04-01T23:05:49.712 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43143.log 2024-04-01T23:05:49.712 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44733.log 2024-04-01T23:05:49.712 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.48879.log: /var/log/ceph/ceph-client.admin.43143.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48879.log.gz 2024-04-01T23:05:49.712 INFO:teuthology.orchestra.run.smithi047.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43143.log.gz 2024-04-01T23:05:49.712 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44481.log 2024-04-01T23:05:49.712 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.44733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43185.log 2024-04-01T23:05:49.712 INFO:teuthology.orchestra.run.smithi047.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44733.log.gz 2024-04-01T23:05:49.712 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.44481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44601.log 2024-04-01T23:05:49.713 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.43185.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44481.log.gz 2024-04-01T23:05:49.713 INFO:teuthology.orchestra.run.smithi047.stderr: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45423.log 2024-04-01T23:05:49.713 INFO:teuthology.orchestra.run.smithi047.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43185.log.gz 2024-04-01T23:05:49.713 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.44601.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-01T23:05:49.713 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.45423.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44601.log.gz 2024-04-01T23:05:49.713 INFO:teuthology.orchestra.run.smithi047.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45423.log.gz 2024-04-01T23:05:49.713 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41315.log 2024-04-01T23:05:49.713 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43942.log 2024-04-01T23:05:49.713 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.41315.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41315.log.gz 2024-04-01T23:05:49.713 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43101.log 2024-04-01T23:05:49.713 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.43942.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43942.log.gz 2024-04-01T23:05:49.713 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49399.log 2024-04-01T23:05:49.713 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.43101.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43101.log.gz 2024-04-01T23:05:49.714 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.31035.log 2024-04-01T23:05:49.714 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.49399.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49399.log.gz 2024-04-01T23:05:49.714 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42476.log 2024-04-01T23:05:49.714 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph.tmp-client.admin.31035.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.31035.log.gz 2024-04-01T23:05:49.714 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-01T23:05:49.714 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.42476.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.42476.log.gz 2024-04-01T23:05:49.714 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44209.log 2024-04-01T23:05:49.714 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph.log: 88.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-01T23:05:49.714 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-01T23:05:49.714 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.44209.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44209.log.gz 2024-04-01T23:05:49.714 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44651.log 2024-04-01T23:05:49.715 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-01T23:05:49.715 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.44651.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44651.log.gz 2024-04-01T23:05:49.715 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41610.log 2024-04-01T23:05:49.715 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-mds.c.log: 92.7% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-01T23:05:49.715 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41255.log 2024-04-01T23:05:49.715 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.41610.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41610.log.gz 2024-04-01T23:05:49.716 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43305.log 2024-04-01T23:05:49.716 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.41255.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.41255.log.gz 2024-04-01T23:05:49.717 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43949.log 2024-04-01T23:05:49.719 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.43305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49651.log 2024-04-01T23:05:49.723 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.43949.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43305.log.gz 2024-04-01T23:05:49.733 INFO:teuthology.orchestra.run.smithi047.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.43949.log.gz 2024-04-01T23:05:49.735 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41790.log 2024-04-01T23:05:49.736 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.49651.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49651.log.gz 2024-04-01T23:05:49.753 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45381.log 2024-04-01T23:05:49.754 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.41790.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41790.log.gz 2024-04-01T23:05:49.764 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47881.log 2024-04-01T23:05:49.765 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.45381.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45381.log.gz 2024-04-01T23:05:49.776 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42959.log 2024-04-01T23:05:49.777 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.47881.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47881.log.gz 2024-04-01T23:05:49.791 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43599.log 2024-04-01T23:05:49.792 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.42959.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42959.log.gz 2024-04-01T23:05:49.800 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48543.log 2024-04-01T23:05:49.810 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.43599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45339.log 2024-04-01T23:05:49.811 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.48543.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48543.log.gz 2024-04-01T23:05:49.813 INFO:teuthology.orchestra.run.smithi047.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43599.log.gz 2024-04-01T23:05:49.818 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41660.log 2024-04-01T23:05:49.820 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.45339.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45339.log.gz 2024-04-01T23:05:49.834 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48107.log 2024-04-01T23:05:49.834 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.41660.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41660.log.gz 2024-04-01T23:05:49.842 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43945.log 2024-04-01T23:05:49.851 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.48107.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48107.log.gz 2024-04-01T23:05:49.861 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49357.log 2024-04-01T23:05:49.862 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.43945.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43945.log.gz 2024-04-01T23:05:49.870 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48753.log 2024-04-01T23:05:49.880 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.49357.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-01T23:05:49.880 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.48753.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48753.log.gz 2024-04-01T23:05:49.883 INFO:teuthology.orchestra.run.smithi047.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49357.log.gz 2024-04-01T23:05:49.896 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45255.log 2024-04-01T23:05:49.903 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-mds.a.log: 92.8% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-01T23:05:49.906 INFO:teuthology.orchestra.run.smithi047.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-01T23:05:49.906 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.45255.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45255.log.gz 2024-04-01T23:05:50.166 INFO:teuthology.orchestra.run.smithi181.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-01T23:05:50.340 INFO:teuthology.orchestra.run.smithi181.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-01T23:05:50.758 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-04-01T23:05:50.917 INFO:teuthology.orchestra.run.smithi047.stderr: 89.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-01T23:05:51.963 INFO:teuthology.orchestra.run.smithi181.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-01T23:05:52.420 INFO:teuthology.orchestra.run.smithi181.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-01T23:05:52.471 INFO:teuthology.orchestra.run.smithi047.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-01T23:05:52.700 INFO:teuthology.orchestra.run.smithi181.stderr: 91.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-01T23:05:53.038 INFO:teuthology.orchestra.run.smithi047.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-01T23:05:53.066 INFO:teuthology.orchestra.run.smithi181.stderr: 91.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-01T23:05:53.068 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-04-01T23:05:53.068 INFO:teuthology.orchestra.run.smithi181.stderr:real 0m3.465s 2024-04-01T23:05:53.068 INFO:teuthology.orchestra.run.smithi181.stderr:user 0m12.526s 2024-04-01T23:05:53.068 INFO:teuthology.orchestra.run.smithi181.stderr:sys 0m0.456s 2024-04-01T23:05:53.745 INFO:teuthology.orchestra.run.smithi047.stderr: 91.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-01T23:05:53.804 INFO:teuthology.orchestra.run.smithi047.stderr: 91.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-01T23:06:01.054 INFO:teuthology.orchestra.run.smithi047.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.0.45984.log.gz 2024-04-01T23:06:08.956 INFO:teuthology.orchestra.run.smithi047.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-04-01T23:06:08.958 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-01T23:06:08.958 INFO:teuthology.orchestra.run.smithi047.stderr:real 0m19.393s 2024-04-01T23:06:08.958 INFO:teuthology.orchestra.run.smithi047.stderr:user 0m45.637s 2024-04-01T23:06:08.958 INFO:teuthology.orchestra.run.smithi047.stderr:sys 0m1.437s 2024-04-01T23:06:08.959 INFO:tasks.ceph:Archiving logs... 2024-04-01T23:06:08.959 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-04-01_20:57:46-fs-wip-yuri3-testing-2024-04-01-0837-squid-distro-default-smithi/7634387/remote/smithi047/log 2024-04-01T23:06:08.960 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-01T23:06:16.208 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-04-01_20:57:46-fs-wip-yuri3-testing-2024-04-01-0837-squid-distro-default-smithi/7634387/remote/smithi181/log 2024-04-01T23:06:16.209 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-01T23:06:19.649 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_1f941761d08add4455f209f0f2e36f8151f834a0/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_1f941761d08add4455f209f0f2e36f8151f834a0/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_1f941761d08add4455f209f0f2e36f8151f834a0/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2024-04-01T23:06:19.650 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-01T23:06:19.659 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_1f941761d08add4455f209f0f2e36f8151f834a0/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_1f941761d08add4455f209f0f2e36f8151f834a0/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_1f941761d08add4455f209f0f2e36f8151f834a0/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2024-04-01T23:06:19.660 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-01T23:06:19.660 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-01T23:06:19.662 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-01T23:06:19.762 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-01T23:06:19.771 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-01T23:06:19.771 DEBUG:teuthology.orchestra.run.smithi047:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-01T23:06:19.773 DEBUG:teuthology.orchestra.run.smithi181:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-01T23:06:19.787 INFO:teuthology.orchestra.run.smithi047.stderr:bash: line 1: ntpq: command not found 2024-04-01T23:06:19.788 INFO:teuthology.orchestra.run.smithi181.stderr:bash: line 1: ntpq: command not found 2024-04-01T23:06:19.791 INFO:teuthology.orchestra.run.smithi047.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-01T23:06:19.791 INFO:teuthology.orchestra.run.smithi047.stdout:=============================================================================== 2024-04-01T23:06:19.791 INFO:teuthology.orchestra.run.smithi047.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 27 +380us[ +384us] +/- 93ms 2024-04-01T23:06:19.791 INFO:teuthology.orchestra.run.smithi047.stdout:^* hv02.front.sepia.ceph.com 3 6 377 21 -595us[ -591us] +/- 63ms 2024-04-01T23:06:19.791 INFO:teuthology.orchestra.run.smithi047.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 21 +552us[ +557us] +/- 81ms 2024-04-01T23:06:19.792 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T23:06:19.792 INFO:teuthology.orchestra.run.smithi181.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-01T23:06:19.792 INFO:teuthology.orchestra.run.smithi181.stdout:=============================================================================== 2024-04-01T23:06:19.792 INFO:teuthology.orchestra.run.smithi181.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 20 +295us[ +297us] +/- 93ms 2024-04-01T23:06:19.793 INFO:teuthology.orchestra.run.smithi181.stdout:^* hv02.front.sepia.ceph.com 3 6 377 20 -639us[ -638us] +/- 63ms 2024-04-01T23:06:19.793 INFO:teuthology.orchestra.run.smithi181.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 87 +540us[ +541us] +/- 80ms 2024-04-01T23:06:19.793 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T23:06:19.793 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-01T23:06:19.801 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-01T23:06:19.802 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-01T23:06:19.811 DEBUG:teuthology.orchestra.run.smithi047:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-01T23:06:19.910 DEBUG:teuthology.orchestra.run.smithi181:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-01T23:06:19.978 DEBUG:teuthology.orchestra.run.smithi047:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-01T23:06:20.009 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T23:06:20.009 DEBUG:teuthology.orchestra.run.smithi181:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-01T23:06:20.039 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T23:06:20.040 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-01T23:06:20.058 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-01T23:06:20.075 INFO:teuthology.task.internal:Duration was 2877.807012 seconds 2024-04-01T23:06:20.076 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-01T23:06:20.092 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-01T23:06:20.093 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-01T23:06:20.096 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-01T23:06:20.138 INFO:teuthology.orchestra.run.smithi047.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-01T23:06:20.140 INFO:teuthology.orchestra.run.smithi181.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-01T23:06:20.381 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-01T23:06:20.381 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi047.front.sepia.ceph.com 2024-04-01T23:06:20.381 DEBUG:teuthology.orchestra.run.smithi047:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-01T23:06:20.441 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi181.front.sepia.ceph.com 2024-04-01T23:06:20.441 DEBUG:teuthology.orchestra.run.smithi181:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-01T23:06:20.463 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-01T23:06:20.463 DEBUG:teuthology.orchestra.run.smithi047:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-01T23:06:20.483 DEBUG:teuthology.orchestra.run.smithi181:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-01T23:06:20.533 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-01T23:06:20.533 DEBUG:teuthology.orchestra.run.smithi047:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-01T23:06:20.554 DEBUG:teuthology.orchestra.run.smithi181:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-01T23:06:20.687 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-01T23:06:20.699 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-01T23:06:20.700 DEBUG:teuthology.orchestra.run.smithi047:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-01T23:06:20.727 DEBUG:teuthology.orchestra.run.smithi181:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-01T23:06:20.755 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-01T23:06:20.767 DEBUG:teuthology.orchestra.run.smithi047:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-01T23:06:20.769 DEBUG:teuthology.orchestra.run.smithi181:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-01T23:06:20.792 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = core 2024-04-01T23:06:20.821 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern = core 2024-04-01T23:06:20.847 DEBUG:teuthology.orchestra.run.smithi047:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-01T23:06:20.861 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T23:06:20.862 DEBUG:teuthology.orchestra.run.smithi181:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-01T23:06:20.901 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T23:06:20.902 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-01T23:06:20.912 INFO:teuthology.task.internal:Transferring archived files... 2024-04-01T23:06:20.913 DEBUG:teuthology.misc:Transferring archived files from smithi047:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-04-01_20:57:46-fs-wip-yuri3-testing-2024-04-01-0837-squid-distro-default-smithi/7634387/remote/smithi047 2024-04-01T23:06:20.913 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-01T23:06:20.951 DEBUG:teuthology.misc:Transferring archived files from smithi181:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-04-01_20:57:46-fs-wip-yuri3-testing-2024-04-01-0837-squid-distro-default-smithi/7634387/remote/smithi181 2024-04-01T23:06:20.952 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-01T23:06:20.987 INFO:teuthology.task.internal:Removing archive directory... 2024-04-01T23:06:20.988 DEBUG:teuthology.orchestra.run.smithi047:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-01T23:06:20.990 DEBUG:teuthology.orchestra.run.smithi181:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-01T23:06:21.037 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-01T23:06:21.050 INFO:teuthology.task.internal:Not uploading archives. 2024-04-01T23:06:21.050 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-01T23:06:21.061 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-01T23:06:21.062 DEBUG:teuthology.orchestra.run.smithi047:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-01T23:06:21.064 DEBUG:teuthology.orchestra.run.smithi181:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-01T23:06:21.076 INFO:teuthology.orchestra.run.smithi047.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 1 23:06 /home/ubuntu/cephtest 2024-04-01T23:06:21.091 INFO:teuthology.orchestra.run.smithi181.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 1 23:06 /home/ubuntu/cephtest 2024-04-01T23:06:21.092 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-01T23:06:21.104 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-01T23:06:21.117 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2024-04-01T23:06:21.117 INFO:teuthology.nuke:Checking targets against current locks 2024-04-01T23:06:21.152 DEBUG:teuthology.nuke:shortname: smithi047 2024-04-01T23:06:21.152 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-01T23:06:21.190 DEBUG:teuthology.nuke:shortname: smithi181 2024-04-01T23:06:21.190 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-01T23:06:21.202 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi047.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-04-01_20:57:46-fs-wip-yuri3-testing-2024-04-01-0837-squid-distro-default-smithi/7634387', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-01 22:09:42.405719', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMxDHLlPWlYJaO3zRBr2g98N5YqYQMbgWhje3WTb7zhJ1jwfSQ19t+zHVsIEorEGvl1YNmYD4PcvL6Og9xk4x1E='} 2024-04-01T23:06:21.245 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-04-01_20:57:46-fs-wip-yuri3-testing-2024-04-01-0837-squid-distro-default-smithi/7634387', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-01 22:09:42.407319', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEJ+vIOtDQ5Sgj8BzKFhXhOLFFDHXs31EIsIGEmbUwBhHr8eCoC2dLps6SpnG/3V91z6oSd2b4qjoqB+QvrJJrM='} 2024-04-01T23:06:21.282 INFO:teuthology.orchestra.console.smithi047:Power off 2024-04-01T23:06:21.282 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T23:06:21.332 INFO:teuthology.orchestra.console.smithi181:Power off 2024-04-01T23:06:21.332 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T23:06:21.341 DEBUG:teuthology.orchestra.console.smithi047:power off output: Chassis Power Control: Down/Off 2024-04-01T23:06:21.341 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T23:06:21.379 DEBUG:teuthology.orchestra.console.smithi181:power off output: Chassis Power Control: Down/Off 2024-04-01T23:06:21.379 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T23:06:21.397 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is on 2024-04-01T23:06:21.432 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2024-04-01T23:06:25.398 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T23:06:25.433 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T23:06:25.509 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is on 2024-04-01T23:06:25.544 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2024-04-01T23:06:29.514 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T23:06:29.545 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T23:06:29.625 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is off 2024-04-01T23:06:29.657 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2024-04-01T23:06:29.726 INFO:teuthology.orchestra.console.smithi047:Power off completed 2024-04-01T23:06:33.660 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T23:06:33.771 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2024-04-01T23:06:33.872 INFO:teuthology.orchestra.console.smithi181:Power off completed 2024-04-01T23:06:33.977 INFO:teuthology.run:Summary data: description: fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/valgrind} duration: 2877.8070118427277 failure_reason: 'valgrind error: Leak_StillReachable malloc malloc strdup' flavor: default owner: scheduled_yuriw@teuthology status: fail success: false 2024-04-01T23:06:33.977 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T23:06:34.081 INFO:teuthology.run:FAIL